00000100:00100000:0.0:1746147164.770188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.800183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.810382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.813518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.857300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.857348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.857383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.857409:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463105536 00000100:00100000:0.0:1746147164.857417:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463105536 00002000:00100000:0.0:1746147164.858087:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a4fad180 x1830967463105536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:540/0 lens 488/0 e 0 to 0 dl 1746147175 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147164.858096:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463105536 ext(2097152->3145727) 00002000:00010000:0.0:1746147164.858099:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad180 00000100:00100000:0.0:1746147164.858140:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3623 00000100:00100000:0.0:1746147164.858147:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463106048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147164.885400:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463106048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27242us (28005us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147164.885413:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3623 00002000:00100000:0.0:1746147164.885425:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880093d37b80 x1830967463106048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:540/0 lens 488/440 e 0 to 0 dl 1746147175 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147164.885435:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463106048 ext(2097152->3145727) 00002000:00010000:0.0:1746147164.885441:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:0.0:1746147164.895029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.897863:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463105536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 39711us (40575us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147164.897870:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3624 00002000:00100000:0.0:1746147164.897877:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a4fad180 x1830967463105536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:540/0 lens 488/440 e 0 to 0 dl 1746147175 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147164.897884:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463105536 ext(2097152->3145727) 00010000:00010000:0.0:1746147164.897889:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 27 pid: 6881 timeout: 651 lvb_type: 1 00010000:00010000:0.0:1746147164.897898:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 27 pid: 6881 timeout: 651 lvb_type: 1 00002000:00010000:0.0:1746147164.897903:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4fad180 00000100:00100000:0.0:1746147164.901297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.903444:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463106816 00000100:00100000:0.0:1746147164.903450:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463106816 00010000:00010000:0.0:1746147164.903474:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 26 pid: 6881 timeout: 651 lvb_type: 1 00000100:00100000:0.0:1746147164.903494:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4930 00000100:00100000:0.0:1746147164.903499:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463106816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147164.903509:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147164.903531:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 26 pid: 6881 timeout: 651 lvb_type: 1 00010000:00010000:0.0:1746147164.903543:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 26 pid: 6881 timeout: 651 lvb_type: 1 00010000:00010000:0.0:1746147164.903562:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eb1ca00/0xb4b2209fbdac2a6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43af expref: 26 pid: 6881 timeout: 651 lvb_type: 1 00010000:00010000:0.0:1746147164.903597:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147164.903599:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147164.903606:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147164.903614:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147164.903639:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147164.903650:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 20 pid: 8481 timeout: 651 lvb_type: 0 00000100:00100000:0.0:1746147164.903661:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466153728:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147164.903720:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147164.906311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.914740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.919222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.919309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.942463:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463107968 00000100:00100000:0.0:1746147164.942472:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463107968 00010000:00010000:0.0:1746147164.942506:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 23 pid: 8481 timeout: 651 lvb_type: 0 00000100:00100000:0.0:1746147164.942545:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4931 00000100:00100000:0.0:1746147164.942552:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463107968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147164.942566:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147164.942589:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 23 pid: 8481 timeout: 651 lvb_type: 0 00010000:00010000:0.0:1746147164.942601:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 23 pid: 8481 timeout: 651 lvb_type: 0 00010000:00010000:0.0:1746147164.942623:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f660000/0xb4b2209fbdac2ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3149824->3600383) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43e7 expref: 23 pid: 8481 timeout: 651 lvb_type: 0 00010000:00010000:0.0:1746147164.942655:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147164.942657:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147164.942665:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5379e00/0xb4b2209fbdac2ada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43ee expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147164.942673:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5379e00/0xb4b2209fbdac2ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43ee expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147164.942708:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5379e00/0xb4b2209fbdac2ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43ee expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147164.942719:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466153856:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147164.942813:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147164.949089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.950002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.955751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.958139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.958438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.968870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.969017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.974171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.976344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.985197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.985239:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.985423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.985453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147164.985485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.002897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.002967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.019706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.028095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.033781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.045601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.058357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.061080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.061125:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463112448 00000100:00100000:0.0:1746147165.061132:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463112448 00000100:00100000:0.0:1746147165.061178:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10160 00000100:00100000:0.0:1746147165.061185:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28170:x1830967463112448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147165.061208:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.061227:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42400/0xb4b2209fbdac2b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e442d expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.061333:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061346:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061358:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061372:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061377:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061382:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061495:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42a00/0xb4b2209fbdac2b4a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061504:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42a00/0xb4b2209fbdac2b4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061510:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42a00/0xb4b2209fbdac2b4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147165.061518:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 16777217 00010000:00010000:0.0:1746147165.061603:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061610:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061616:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061626:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc42200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.061629:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061636:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061647:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147165.061650:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.061654:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061659:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42200/0xb4b2209fbdac2b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061683:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061689:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061694:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061698:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc42000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.061700:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061705:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061711:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f37e400) 00010000:00010000:0.0:1746147165.061713:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.061716:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061720:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42000/0xb4b2209fbdac2b43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.061771:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42400/0xb4b2209fbdac2b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e442d expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.061784:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42a00/0xb4b2209fbdac2b4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e442d expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.061791:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147165.061793:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147165.061795:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc42a00, rc 0) 00000100:00100000:0.0:1746147165.061825:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28170:x1830967463112448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 640us (754us total) trans 8589943841 rc 0/0 00000100:00100000:0.0:1746147165.061831:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10160 00000100:00080000:0.0:1746147165.061856:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147165.071123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.075872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.081166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.094350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.102296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.107199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147165.107376:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147165.113637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.113723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.118488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.118527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.118559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.118581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.118603:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463114624 00000100:00100000:0.0:1746147165.118610:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463114624 00000100:00100000:0.0:1746147165.118640:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463114240 00000100:00100000:0.0:1746147165.119094:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463114240 00000100:00100000:0.0:1746147165.119125:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10139 00000100:00100000:0.0:1746147165.119130:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463114240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.119137:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.119147:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc42400/0xb4b2209fbdac2b9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4449 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.119158:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.119159:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.119163:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc42400/0xb4b2209fbdac2b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4449 expref: 35 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.119172:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc42400/0xb4b2209fbdac2b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4449 expref: 35 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.119178:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc42400, rc 0) 00000100:00100000:0.0:1746147165.119191:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463114240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 62us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147165.119196:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10139 00000100:00100000:0.0:1746147165.120872:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463114880 00000100:00100000:0.0:1746147165.120876:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463114880 00000100:00100000:0.0:1746147165.120907:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10162 00000100:00100000:0.0:1746147165.120910:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:28175:x1830967463114880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147165.120926:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.120950:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42c00/0xb4b2209fbdac2ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4465 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.121042:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42600/0xb4b2209fbdac2bac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147165.121053:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42600/0xb4b2209fbdac2bac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147165.121062:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc42600/0xb4b2209fbdac2bac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147165.121074:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc43e00/0xb4b2209fbdac2bb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147165.121079:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc43e00/0xb4b2209fbdac2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147165.121084:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc43e00/0xb4b2209fbdac2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147165.123948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.128664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.128824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.128843:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463115776 00000100:00100000:0.0:1746147165.128845:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463115776 00000100:00100000:0.0:1746147165.128878:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3947 00000100:00100000:0.0:1746147165.128884:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28175:x1830967463115776:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147165.130448:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:28175:x1830967463115776:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1563us (1623us total) trans 8589943845 rc 0/0 00000100:00100000:0.0:1746147165.130459:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3947 00000100:00100000:0.0:1746147165.131779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.131812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.137968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.137999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.144686:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463116800 00000100:00100000:0.0:1746147165.144695:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463116800 00000100:00100000:0.0:1746147165.144737:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10141 00000100:00100000:0.0:1746147165.144744:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28166:x1830967463116800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.144774:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.144792:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4473 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.144821:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5077800/0xb4b2209fbdac2bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e446c expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.144829:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147165.144831:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147165.144834:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4473 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.144860:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5077800/0xb4b2209fbdac2bc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e446c expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.144871:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5077800/0xb4b2209fbdac2bc8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e446c expref: 16 pid: 17548 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.144887:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466156544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147165.144966:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.151110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.157133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.157197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.159445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.159483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.159719:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10143 00000100:00100000:0.0:1746147165.159726:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463117696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.159734:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.159750:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc43000/0xb4b2209fbdac2bd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e447a expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147165.159805:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f81a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466156672:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147165.159914:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.164867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.182905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.194695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.201819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.209257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.227674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.235299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.238725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.252057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.278824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.284796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.293093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.293923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.300021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.300073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.300098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.300129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.300151:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463122048 00000100:00100000:0.0:1746147165.300153:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463122048 00010000:00010000:0.0:1746147165.300170:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed80a00/0xb4b2209fbdac2bf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4496 expref: 28 pid: 17548 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.300184:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463122176 00000100:00100000:0.0:1746147165.300186:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463122176 00010000:00010000:0.0:1746147165.300193:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed80600/0xb4b2209fbdac2bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e449d expref: 29 pid: 17548 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.300205:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4946 00000100:00100000:0.0:1746147165.300209:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463122048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147165.300217:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147165.300237:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed80a00/0xb4b2209fbdac2bf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4496 expref: 28 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300246:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed80a00/0xb4b2209fbdac2bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4496 expref: 28 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300260:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed80a00/0xb4b2209fbdac2bf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4496 expref: 28 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300274:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147165.300286:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463122048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147165.300292:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4946 00000100:00100000:0.0:1746147165.300301:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4947 00000100:00100000:0.0:1746147165.300305:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463122176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147165.300311:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147165.300481:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed80600/0xb4b2209fbdac2bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e449d expref: 31 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300491:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed80600/0xb4b2209fbdac2bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e449d expref: 31 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300501:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed80600/0xb4b2209fbdac2bf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e449d expref: 31 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.300507:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.300508:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.300513:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eef0800/0xb4b2209fbdac2c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3362816->4194303] (req 3362816->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ab expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.300520:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eef0800/0xb4b2209fbdac2c23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3362816->4194303] (req 3362816->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ab expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.300546:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eef0800/0xb4b2209fbdac2c23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3362816->4194303] (req 3362816->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ab expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147165.300558:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466157568:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147165.300609:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.303350:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466157568:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147165.303368:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147165.303389:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967463122176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3084us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147165.303396:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4947 00000100:00100000:0.0:1746147165.307616:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463122944 00000100:00100000:0.0:1746147165.307621:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463122944 00000100:00100000:0.0:1746147165.308407:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10154 00000100:00100000:0.0:1746147165.308415:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967463122944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.308425:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.308441:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5077800/0xb4b2209fbdac2c4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e44d5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.308469:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5077800/0xb4b2209fbdac2c4d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44d5 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.308479:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5077800/0xb4b2209fbdac2c4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44d5 expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.308502:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5077800, rc 0) 00000100:00100000:0.0:1746147165.308527:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967463122944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 113us (1272us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147165.308540:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10154 00000100:00100000:0.0:1746147165.349260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.355927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.358448:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463123328 00000100:00100000:0.0:1746147165.358456:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463123328 00010000:00010000:0.0:1746147165.358486:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4473 expref: 17 pid: 17548 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.358534:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4949 00000100:00100000:0.0:1746147165.358543:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463123328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147165.358559:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147165.358584:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4473 expref: 17 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.358596:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4473 expref: 17 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.358619:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc43400/0xb4b2209fbdac2bcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4473 expref: 17 pid: 17548 timeout: 652 lvb_type: 0 00010000:00010000:0.0:1746147165.358641:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.358644:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147165.358652:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb2c00/0xb4b2209fbdac2c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44dc expref: 34 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.358661:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb2c00/0xb4b2209fbdac2c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44dc expref: 34 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.358697:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ecb2c00/0xb4b2209fbdac2c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44dc expref: 34 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147165.358711:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466157952:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147165.358832:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.426922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.437471:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.437499:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466158080:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147165.438217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.443522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147165.444326:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076a00/0xb4b2209fbdac2c77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444340:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076a00/0xb4b2209fbdac2c77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444349:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076a00/0xb4b2209fbdac2c77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147165.444360:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 16777217 00010000:00010000:0.0:1746147165.444450:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444456:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444462:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444471:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb3a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.444475:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444481:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444490:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147165.444493:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.444496:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444500:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3a00/0xb4b2209fbdac2c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444526:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444531:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444535:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444539:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb3800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.444541:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444546:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444551:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880099ff9200) 00010000:00010000:0.0:1746147165.444553:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.444556:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444560:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3800/0xb4b2209fbdac2c70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.444605:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb3c00/0xb4b2209fbdac2c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ea expref: 318 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.444616:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076a00/0xb4b2209fbdac2c77 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ea expref: 317 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.444621:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147165.444623:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147165.444625:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5076a00, rc 0) 00000100:00100000:0.0:1746147165.444681:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28184:x1830967463124096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 848us (1167us total) trans 8589943848 rc 0/0 00000100:00100000:0.0:1746147165.444688:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10164 00000100:00100000:0.0:1746147165.452032:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466158208:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147165.452058:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb3200/0xb4b2209fbdac2c5b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1294336->2097151] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44e3 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.452848:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb3200, rc 0) 00000100:00100000:0.0:1746147165.457284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.457330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.472183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.475005:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463125376 00000100:00100000:0.0:1746147165.475012:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463125376 00000100:00100000:0.0:1746147165.475042:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10160 00000100:00100000:0.0:1746147165.475048:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28184:x1830967463125376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.475060:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.475072:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5076000/0xb4b2209fbdac2c9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4506 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.475092:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb3200/0xb4b2209fbdac2c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44e3 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.475098:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147165.475099:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147165.475101:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5076000/0xb4b2209fbdac2c9a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4506 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.475116:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb3200/0xb4b2209fbdac2c5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44e3 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.475122:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb3200/0xb4b2209fbdac2c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44e3 expref: 27 pid: 4444 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.475130:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466158848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147165.475758:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.482353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.482376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.483456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.483492:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463125760 00000100:00100000:0.0:1746147165.483496:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463125760 00010000:00010000:0.0:1746147165.483512:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed80400/0xb4b2209fbdac2be4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4488 expref: 29 pid: 17548 timeout: 652 lvb_type: 0 00000100:00100000:0.0:1746147165.490448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.502231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.502271:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463126272 00000100:00100000:0.0:1746147165.502278:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463126272 00000100:00100000:0.0:1746147165.502316:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3950 00000100:00100000:0.0:1746147165.502323:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28178:x1830967463126272:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147165.504028:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28178:x1830967463126272:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1700us (1802us total) trans 8589943850 rc 0/0 00000100:00100000:0.0:1746147165.504037:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3950 00000100:00100000:0.0:1746147165.505111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.512609:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463126912 00000100:00100000:0.0:1746147165.512618:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463126912 00000100:00100000:0.0:1746147165.512672:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10165 00000100:00100000:0.0:1746147165.512679:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28187:x1830967463126912:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147165.512704:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.512721:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077a00/0xb4b2209fbdac2ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e450d expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.513045:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513058:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513069:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513083:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513088:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513092:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513174:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077400/0xb4b2209fbdac2cb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513182:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077400/0xb4b2209fbdac2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513187:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077400/0xb4b2209fbdac2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147165.513194:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 16777217 00010000:00010000:0.0:1746147165.513260:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513265:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513271:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513276:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5077c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.513279:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513284:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513293:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147165.513296:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.513299:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513304:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077c00/0xb4b2209fbdac2ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513330:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513334:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513338:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513342:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5076c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.513344:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513349:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513355:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13000) 00010000:00010000:0.0:1746147165.513356:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.513358:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513363:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5076c00/0xb4b2209fbdac2caf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.513396:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077a00/0xb4b2209fbdac2ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e450d expref: 320 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.513407:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5077400/0xb4b2209fbdac2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e450d expref: 319 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.513414:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147165.513416:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147165.513418:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5077400, rc 0) 00000100:00100000:0.0:1746147165.513460:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28187:x1830967463126912:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 781us (977us total) trans 8589943851 rc 0/0 00000100:00100000:0.0:1746147165.513468:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10165 00000100:00100000:0.0:1746147165.522781:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463127168 00000100:00100000:0.0:1746147165.522789:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463127168 00000100:00100000:0.0:1746147165.522817:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3951 00000100:00100000:0.0:1746147165.522822:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28187:x1830967463127168:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147165.523040:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28187:x1830967463127168:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 217us (2832us total) trans 8589943852 rc 0/0 00000100:00100000:0.0:1746147165.523047:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3951 00000100:00100000:0.0:1746147165.535663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.540107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.540270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.543828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.546656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.551786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.552658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.552693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.568800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.570739:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463129728 00000100:00100000:0.0:1746147165.570744:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463129728 00000100:00100000:0.0:1746147165.570783:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3952 00000100:00100000:0.0:1746147165.570788:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28192:x1830967463129728:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147165.570986:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28192:x1830967463129728:12345-192.168.203.36@tcp:35:cat.0 Request processed in 197us (440us total) trans 8589943854 rc 0/0 00000100:00100000:0.0:1746147165.570992:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3952 00000100:00100000:0.0:1746147165.572648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.574991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.576563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.577661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.587604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.588526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.588626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.596621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.596666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.596691:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463131136 00000100:00100000:0.0:1746147165.596697:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463131136 00002000:00100000:0.0:1746147165.596734:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800936dfb80 x1830967463131136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:541/0 lens 488/0 e 0 to 0 dl 1746147176 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147165.596744:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967463131136 ext(3145728->4194303) 00002000:00010000:0.0:1746147165.596759:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746147165.596782:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463131392 00000100:00100000:0.0:1746147165.596784:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463131392 00002000:00100000:0.0:1746147165.596795:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3211264->4194303) req@ffff8800936df480 x1830967463131392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:541/0 lens 488/0 e 0 to 0 dl 1746147176 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147165.596802:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df480 with x1830967463131392 ext(3211264->4194303) 00002000:00010000:0.0:1746147165.596806:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df480 00000100:00100000:0.0:1746147165.596815:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3656 00000100:00100000:0.0:1746147165.596821:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463131136:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147165.611576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.618708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.618780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.639681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.643110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.678639:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463133440 00000100:00100000:0.0:1746147165.678643:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463133440 00000100:00100000:0.0:1746147165.678675:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10167 00000100:00100000:0.0:1746147165.678683:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28196:x1830967463133440:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147165.678695:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.678707:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64000/0xb4b2209fbdac2d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4553 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.678793:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678804:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678812:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678822:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678827:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678835:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678914:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64600/0xb4b2209fbdac2d34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678922:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64600/0xb4b2209fbdac2d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.678928:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64600/0xb4b2209fbdac2d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147165.678948:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 16777217 00010000:00010000:0.0:1746147165.679005:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679012:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679017:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679021:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef64200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.679024:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679029:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679038:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147165.679040:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.679044:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679051:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64200/0xb4b2209fbdac2d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679062:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679067:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679070:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679074:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef64400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147165.679076:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679080:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679085:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48400) 00010000:00010000:0.0:1746147165.679087:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147165.679089:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679093:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64400/0xb4b2209fbdac2d2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147165.679120:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64000/0xb4b2209fbdac2d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4553 expref: 322 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.679129:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64600/0xb4b2209fbdac2d34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4553 expref: 321 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147165.679138:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147165.679140:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147165.679142:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef64600, rc 0) 00000100:00100000:0.0:1746147165.679184:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+321:28196:x1830967463133440:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 503us (777us total) trans 8589943855 rc 0/0 00000100:00100000:0.0:1746147165.679190:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10167 00000100:00100000:0.0:1746147165.679236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.679302:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463133184 00000100:00100000:0.0:1746147165.679305:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463133184 00002000:00100000:0.0:1746147165.679319:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ee5d880 x1830967463133184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:541/0 lens 488/0 e 0 to 0 dl 1746147176 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147165.679326:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d880 with x1830967463133184 ext(3145728->4194303) 00002000:00010000:0.0:1746147165.679328:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5d880 00000100:00100000:0.0:1746147165.679344:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3662 00000100:00100000:0.0:1746147165.679349:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463133184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147165.722271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.741406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.747332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.753217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.756098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.765845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.857293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.860498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.864550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.867615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.883715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.889435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.894114:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466160640:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147165.894138:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935dc800/0xb4b2209fbdac2db2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4576 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.894148:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935dc800/0xb4b2209fbdac2db2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4576 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147165.894448:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dc800, rc 0) 00000100:00100000:0.0:1746147165.894481:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463136640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6977us (10775us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147165.894488:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10170 00000100:00100000:0.0:1746147165.907504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.907625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.907683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.916615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.916835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.916871:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463138048 00000100:00100000:0.0:1746147165.916874:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463138048 00000100:00100000:0.0:1746147165.916901:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10173 00000100:00100000:0.0:1746147165.916905:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463138048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147165.916913:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147165.916925:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab29c00/0xb4b2209fbdac2dc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e458b expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147165.916994:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466161280:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147165.917093:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147165.928911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.933361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.933830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.941017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.941072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.948961:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463139072 00000100:00100000:0.0:1746147165.948969:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463139072 00002000:00100000:0.0:1746147165.949009:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1368064->1372159) req@ffff8800a0448000 x1830967463139072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:541/0 lens 488/0 e 0 to 0 dl 1746147176 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147165.949019:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463139072 ext(1368064->1372159) 00002000:00010000:0.0:1746147165.949024:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:0.0:1746147165.949052:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3668 00000100:00100000:0.0:1746147165.949059:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463139072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147165.950253:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463139072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1192us (1447us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147165.950261:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3668 00002000:00100000:0.0:1746147165.950268:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1368064->1372159) req@ffff8800a0448000 x1830967463139072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:541/0 lens 488/4536 e 0 to 0 dl 1746147176 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147165.950275:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463139072 ext(1368064->1372159) 00002000:00010000:0.0:1746147165.950279:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:0.0:1746147165.953516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.953539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.953583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.953616:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463139584 00000100:00100000:0.0:1746147165.953623:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463139584 00000100:00100000:0.0:1746147165.953665:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3956 00000100:00100000:0.0:1746147165.953672:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28198:x1830967463139584:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147165.953860:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28198:x1830967463139584:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 188us (276us total) trans 8589943862 rc 0/0 00000100:00100000:0.0:1746147165.953867:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3956 00000100:00100000:0.0:1746147165.956699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.963414:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466162176:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147165.963435:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147165.963486:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463139712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6615us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147165.963496:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4964 00000100:00100000:0.0:1746147165.965011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.991295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147165.996012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.004206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.006346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.006380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.006396:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463141248 00000100:00100000:0.0:1746147166.006400:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463141248 00000100:00100000:0.0:1746147166.006431:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3957 00000100:00100000:0.0:1746147166.006435:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:28210:x1830967463141248:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147166.006593:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28210:x1830967463141248:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 156us (211us total) trans 8589943864 rc 0/0 00000100:00100000:0.0:1746147166.006599:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3957 00000100:00100000:0.0:1746147166.016886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147166.017356:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147166.020357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.027022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.029116:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3672 00000100:00100000:0.0:1746147166.029123:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463142016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147166.031829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.033443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.039801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.047137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.048178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.050707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.050744:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463142912 00000100:00100000:0.0:1746147166.050760:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463142912 00010000:00010000:0.0:1746147166.050783:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935dce00/0xb4b2209fbdac2dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4584 expref: 20 pid: 4445 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.050812:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4968 00000100:00100000:0.0:1746147166.051397:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463142912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.051410:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.051422:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935dce00/0xb4b2209fbdac2dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4584 expref: 18 pid: 4445 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.051433:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935dce00/0xb4b2209fbdac2dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4584 expref: 18 pid: 4445 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.051451:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935dce00/0xb4b2209fbdac2dc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4584 expref: 18 pid: 4445 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.051647:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.051649:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.051656:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a627ec00/0xb4b2209fbdac2e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45c3 expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.051664:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a627ec00/0xb4b2209fbdac2e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45c3 expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.054979:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466163200:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147166.054999:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.055916:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463142912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5096us (5208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.055924:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4968 00000100:00100000:0.0:1746147166.056117:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463143424 00000100:00100000:0.0:1746147166.056121:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463143424 00002000:00100000:0.0:1746147166.056145:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1101824->1105919) req@ffff8800a5a0f100 x1830967463143424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:542/0 lens 488/0 e 0 to 0 dl 1746147177 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147166.056154:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463143424 ext(1101824->1105919) 00002000:00010000:0.0:1746147166.056158:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:0.0:1746147166.056170:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3674 00000100:00100000:0.0:1746147166.056175:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463143424:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147166.057123:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463143424:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 945us (1125us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147166.057129:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3674 00002000:00100000:0.0:1746147166.057134:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1101824->1105919) req@ffff8800a5a0f100 x1830967463143424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:542/0 lens 488/4536 e 0 to 0 dl 1746147177 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147166.057142:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463143424 ext(1101824->1105919) 00002000:00010000:0.0:1746147166.057145:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:0.0:1746147166.062020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.062113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.082052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147166.083310:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147166.088462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.092426:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463144192 00000100:00100000:0.0:1746147166.092434:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463144192 00010000:00010000:0.0:1746147166.092464:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac2a8d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43c4 expref: 326 pid: 14049 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.092556:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4969 00000100:00100000:0.0:1746147166.092564:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1956:x1830967463144192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.092576:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.092583:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac2a8d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43c4 expref: 326 pid: 14049 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.092594:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac2a8d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43c4 expref: 326 pid: 14049 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.092620:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac2a8d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e43c4 expref: 326 pid: 14049 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.092648:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147166.092653:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147166.092661:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147166.092667:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147166.092692:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.092782:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1956:x1830967463144192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 219us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.092788:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4969 00000100:00100000:0.0:1746147166.098073:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463144320 00000100:00100000:0.0:1746147166.098083:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463144320 00000100:00100000:0.0:1746147166.098100:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463144448 00000100:00100000:0.0:1746147166.098102:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463144448 00000100:00100000:0.0:1746147166.098141:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463144576 00000100:00100000:0.0:1746147166.098143:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463144576 00000100:00100000:0.0:1746147166.098163:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463144704 00000100:00100000:0.0:1746147166.098164:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463144704 00000100:00100000:0.0:1746147166.098179:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10186 00000100:00100000:0.0:1746147166.098275:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10187 00000100:00100000:0.0:1746147166.098282:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463144576:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147166.098299:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147166.098316:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef65c00/0xb4b2209fbdac2e68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4602 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.098361:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466164096:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147166.098433:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00080000:0.0:1746147166.098446:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147166.098449:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147166.098456:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463144448:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147166.098462:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147166.098469:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef64e00/0xb4b2209fbdac2e76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e45fb expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.098490:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090740700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466164224:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147166.098515:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.098538:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10191 00000100:00100000:0.0:1746147166.098543:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463144320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147166.098549:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147166.098555:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdac2e84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e45f4 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.098565:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.098566:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.098571:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdac2e84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45f4 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.098581:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef65a00/0xb4b2209fbdac2e84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45f4 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.098593:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65a00, rc 0) 00000100:00100000:0.0:1746147166.098626:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463144320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 83us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.098631:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10191 00000100:00100000:0.0:1746147166.100708:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466164096:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147166.100735:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef65c00/0xb4b2209fbdac2e68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4602 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.100758:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef65c00/0xb4b2209fbdac2e68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4602 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.100779:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef65c00, rc 0) 00000100:00100000:0.0:1746147166.100809:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463144576:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2528us (3556us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147166.100815:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10187 00000100:00100000:0.0:1746147166.105200:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463145216 00000100:00100000:0.0:1746147166.105209:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463145216 00000100:00100000:0.0:1746147166.105262:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10173 00000100:00100000:0.0:1746147166.105269:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28214:x1830967463145216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147166.105288:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147166.105305:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64a00/0xb4b2209fbdac2e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e461e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.105401:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64c00/0xb4b2209fbdac2e92 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147166.105416:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ed expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.105422:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef64c00/0xb4b2209fbdac2e92 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147166.105451:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ed expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.105461:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a627f800/0xb4b2209fbdac2e5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ed expref: 11 pid: 14049 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.105473:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466164352:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147166.105572:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.113785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.116669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.120725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.127103:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10193 00000100:00100000:0.0:1746147166.127112:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463145984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147166.127121:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147166.127131:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef64c00/0xb4b2209fbdac2eb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e463a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.127159:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090740000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466164736:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147166.127193:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.130754:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466164864:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147166.130774:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935dc000/0xb4b2209fbdac2ebc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4633 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.130783:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935dc000/0xb4b2209fbdac2ebc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4633 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147166.130795:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dc000, rc 0) 00000100:00100000:0.0:1746147166.130811:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463145856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3308us (4309us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147166.130817:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10194 00000100:00100000:0.0:1746147166.132679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.135678:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463146624 00000100:00100000:0.0:1746147166.135681:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463146624 00000100:00100000:0.0:1746147166.135697:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463147008 00000100:00100000:0.0:1746147166.135699:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463147008 00000100:00100000:0.0:1746147166.135799:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10196 00000100:00100000:0.0:1746147166.135805:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463146496:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147166.135833:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.135844:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a627e600/0xb4b2209fbdac2e14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45bc expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.135851:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147166.135852:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147166.135854:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.135869:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a627e600/0xb4b2209fbdac2e14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45bc expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.135878:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a627e600/0xb4b2209fbdac2e14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45bc expref: 37 pid: 4444 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.135886:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800952f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466165120:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147166.136051:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.141215:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800952f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466165120:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147166.141231:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.141260:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466165632:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147166.141270:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.143706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.143883:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463147776 00000100:00100000:0.0:1746147166.143886:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463147776 00010000:00010000:0.0:1746147166.143898:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a627fa00/0xb4b2209fbdac2e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4617 expref: 17 pid: 8478 timeout: 653 lvb_type: 1 00000100:00100000:0.0:1746147166.143909:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463148544 00000100:00100000:0.0:1746147166.143910:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463148544 00010000:00010000:0.0:1746147166.143918:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935dd200/0xb4b2209fbdac2d11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4545 expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.143927:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463147904 00000100:00100000:0.0:1746147166.143929:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463147904 00010000:00010000:0.0:1746147166.143950:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb2800/0xb4b2209fbdac2c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ce expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.143961:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463148672 00000100:00100000:0.0:1746147166.143963:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463148672 00010000:00010000:0.0:1746147166.143972:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a627e800/0xb4b2209fbdac2dea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ae expref: 17 pid: 4444 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.143982:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4978 00000100:00100000:0.0:1746147166.143987:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463147776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.143995:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.144006:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a627fa00/0xb4b2209fbdac2e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4617 expref: 17 pid: 8478 timeout: 653 lvb_type: 1 00010000:00010000:0.0:1746147166.144013:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a627fa00/0xb4b2209fbdac2e6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4617 expref: 17 pid: 8478 timeout: 653 lvb_type: 1 00010000:00010000:0.0:1746147166.144026:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a627fa00/0xb4b2209fbdac2e6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4617 expref: 17 pid: 8478 timeout: 653 lvb_type: 1 00010000:00010000:0.0:1746147166.144039:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.144055:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463147776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.144060:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4978 00000100:00100000:0.0:1746147166.144071:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4979 00000100:00100000:0.0:1746147166.144075:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463148544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.144081:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.144088:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935dd200/0xb4b2209fbdac2d11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4545 expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144095:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935dd200/0xb4b2209fbdac2d11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4545 expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144103:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935dd200/0xb4b2209fbdac2d11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4545 expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144110:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.144120:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463148544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.144124:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4979 00000100:00100000:0.0:1746147166.144131:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4980 00000100:00100000:0.0:1746147166.144135:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463147904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.144140:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.144145:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb2800/0xb4b2209fbdac2c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ce expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144151:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecb2800/0xb4b2209fbdac2c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ce expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144159:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb2800/0xb4b2209fbdac2c46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e44ce expref: 28 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144164:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.144173:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463147904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.144177:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4980 00000100:00100000:0.0:1746147166.144183:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4981 00000100:00100000:0.0:1746147166.144186:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463148672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.144190:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.144195:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a627e800/0xb4b2209fbdac2dea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ae expref: 17 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144201:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a627e800/0xb4b2209fbdac2dea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ae expref: 17 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144210:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a627e800/0xb4b2209fbdac2dea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45ae expref: 17 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.144220:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.144221:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.144224:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab4be00/0xb4b2209fbdac2efb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.144235:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab4be00/0xb4b2209fbdac2efb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.144247:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.144257:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463148672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.144261:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4981 00000100:00100000:0.0:1746147166.144318:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1342 00000100:00100000:0.0:1746147166.144323:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463147648:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147166.146428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.148559:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463147648:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4230us (4771us total) trans 17179872916 rc 0/0 00000100:00100000:0.0:1746147166.148567:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1342 00002000:00100000:0.0:1746147166.148576:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1105919) req@ffff880090508000 x1830967463147648/t17179872916(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:542/0 lens 488/448 e 0 to 0 dl 1746147177 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147166.148584:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508000 with x1830967463147648 ext(1048576->1105919) 00010000:00010000:0.0:1746147166.148593:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a627ec00/0xb4b2209fbdac2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45c3 expref: 42 pid: 4444 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.148607:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a627ec00/0xb4b2209fbdac2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e45c3 expref: 42 pid: 4444 timeout: 653 lvb_type: 0 00002000:00010000:0.0:1746147166.148613:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090508000 00010000:00010000:0.0:1746147166.152955:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.152965:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.152985:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.152992:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.152999:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.153006:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935dd800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.153010:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.153017:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.153032:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.153039:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935dd800/0xb4b2209fbdac2eed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.154307:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463146624:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 18408us (18707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.154314:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10198 00010000:00010000:0.0:1746147166.154351:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154359:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154378:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154384:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154390:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154395:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef64400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.154398:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154405:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154415:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.154419:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef64400/0xb4b2209fbdac2edf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.154452:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463146496:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 18647us (18879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.154457:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10196 00000100:00100000:0.0:1746147166.154688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.157028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.161090:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463149568 00000100:00100000:0.0:1746147166.161096:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463149568 00000100:00100000:0.0:1746147166.162664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.162692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.162709:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463150464 00000100:00100000:0.0:1746147166.162713:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463150464 00000100:00100000:0.0:1746147166.162751:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463150592 00000100:00100000:0.0:1746147166.162754:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463150592 00000100:00100000:0.0:1746147166.162768:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3959 00000100:00100000:0.0:1746147166.162774:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:7641:x1830967463150464:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147166.163629:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:7641:x1830967463150464:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 854us (966us total) trans 8589943869 rc 0/0 00000100:00100000:0.0:1746147166.163639:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3959 00000100:00100000:0.0:1746147166.164961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.165634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.194857:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466167680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.194880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147166.194892:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466168192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.194910:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466167808 00000100:00100000:0.0:1746147166.194916:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466167808 00000100:00100000:0.0:1746147166.194965:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168320 00000100:00100000:0.0:1746147166.194967:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168320 00000100:00100000:0.0:1746147166.195669:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466167936 00000100:00100000:0.0:1746147166.195672:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466167936 00000100:00100000:0.0:1746147166.195688:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466167680 00000100:00100000:0.0:1746147166.195690:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466167680 00000100:00100000:0.0:1746147166.195696:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168448 00000100:00100000:0.0:1746147166.195697:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168448 00000100:00100000:0.0:1746147166.195703:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168064 00000100:00100000:0.0:1746147166.195704:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168064 00000100:00100000:0.0:1746147166.195710:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168576 00000100:00100000:0.0:1746147166.195712:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168576 00000100:00100000:0.0:1746147166.195718:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466169088 00000100:00100000:0.0:1746147166.195719:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466169088 00000100:00100000:0.0:1746147166.195733:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10201 00000100:00100000:0.0:1746147166.195855:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3294:x1830967466167808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.196668:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3294:x1830967466167808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 929us (1883us total) trans 21474840286 rc 0/0 00000100:00100000:0.0:1746147166.196684:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10201 00000100:00100000:0.0:1746147166.196692:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168832 00000100:00100000:0.0:1746147166.196696:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168832 00000100:00100000:0.0:1746147166.196706:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466169344 00000100:00100000:0.0:1746147166.196707:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466169344 00000100:00100000:0.0:1746147166.196715:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10210 00000100:00100000:0.0:1746147166.196719:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3294:x1830967466168832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147166.196821:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3294:x1830967466168832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (210us total) trans 17179872920 rc 0/0 00000100:00100000:0.0:1746147166.196826:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10210 00000100:00100000:0.0:1746147166.196833:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168704 00000100:00100000:0.0:1746147166.196836:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168704 00000100:00100000:0.0:1746147166.196849:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466169216 00000100:00100000:0.0:1746147166.196851:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466169216 00000100:00100000:0.0:1746147166.196858:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10211 00000100:00100000:0.0:1746147166.196861:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967466169344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147166.196925:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147166.196928:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.196929:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147166.196931:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.196932:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147166.196967:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3294:x1830967466169344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (326us total) trans 17179872921 rc 0/0 00000100:00100000:0.0:1746147166.196972:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10211 00000100:00100000:0.0:1746147166.196983:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10212 00000100:00100000:0.0:1746147166.196987:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967466168704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147166.197062:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3294:x1830967466168704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (347us total) trans 17179872922 rc 0/0 00000100:00100000:0.0:1746147166.197066:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10212 00000100:00100000:0.0:1746147166.197076:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10213 00000100:00100000:0.0:1746147166.197080:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967466169216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147166.197145:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147166.197147:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.197148:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147166.197150:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.197152:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147166.197168:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3294:x1830967466169216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (433us total) trans 17179872923 rc 0/0 00000100:00100000:0.0:1746147166.197172:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10213 00000100:00100000:0.0:1746147166.197191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147166.197217:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466168192 00000100:00100000:0.0:1746147166.197220:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466168192 00000100:00100000:0.0:1746147166.197234:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10214 00000100:00100000:0.0:1746147166.197238:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3293:x1830967466168192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147166.197307:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147166.197309:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.197310:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147166.197312:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.197314:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147166.197333:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3293:x1830967466168192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (141us total) trans 21474840287 rc 0/0 00000100:00100000:0.0:1746147166.197337:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10214 00000004:00080000:0.0:1746147166.197354:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba58a80/2, rc 0, transno 21474840287 00000100:00100000:0.0:1746147166.197358:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466168192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.197981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147166.198380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466169472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147166.198403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147166.198423:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509880/2, rc 0, transno 21474840284 00000100:00100000:0.0:1746147166.198426:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466167936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.198439:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466169728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147166.198454:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147166.198468:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466169472 00000100:00100000:0.0:1746147166.198470:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466169472 00000100:00100000:0.0:1746147166.198481:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466169728 00000100:00100000:0.0:1746147166.198483:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466169728 00000100:00100000:0.0:1746147166.198491:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10216 00000100:00100000:0.0:1746147166.198495:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967466169472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147166.198562:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147166.198564:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.198566:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147166.198567:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147161 -> 1746147161 00002000:00010000:0.0:1746147166.198569:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147166.198585:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3295:x1830967466169472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (182us total) trans 17179872925 rc 0/0 00000100:00100000:0.0:1746147166.198590:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10216 00000004:00080000:0.0:1746147166.198606:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585f80/2, rc 0, transno 17179872924 00000100:00100000:0.0:1746147166.198608:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466168960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147166.198614:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585c00/2, rc 0, transno 17179872925 00000100:00100000:0.0:1746147166.198616:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466169472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147166.200135:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7ce680/2, rc 0, transno 21474840289 00000100:00100000:0.0:1746147166.200139:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466168576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147166.200147:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7cd500/2, rc 0, transno 21474840288 00000100:00100000:0.0:1746147166.200149:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466168448:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147166.200384:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147166.200386:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147162 -> 1746147162 00002000:00010000:0.0:1746147166.200388:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147166.200390:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147162 -> 1746147162 00002000:00010000:0.0:1746147166.200392:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147166.200449:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3293:x1830967466169728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1940us (1993us total) trans 21474840290 rc 0/0 00000100:00100000:0.0:1746147166.200455:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10217 00000100:00100000:0.0:1746147166.201774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.204724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.205020:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10218 00000100:00100000:0.0:1746147166.205434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.205513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.205528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.211846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.211907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.223311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.223353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.223380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.223405:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463153536 00000100:00100000:0.0:1746147166.223412:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463153536 00000100:00100000:0.0:1746147166.223459:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463153664 00000100:00100000:0.0:1746147166.223461:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463153664 00000100:00100000:0.0:1746147166.223479:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3680 00000100:00100000:0.0:1746147166.223486:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967463153536:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147166.223517:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ef65000/0xb4b2209fbdac2f72 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.223531:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.223532:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.223538:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef65000/0xb4b2209fbdac2f72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.223549:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef65000/0xb4b2209fbdac2f72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.230329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147166.238517:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238534:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238543:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238550:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d6400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.238554:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238561:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238580:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.238586:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac2f48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.238659:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+26:1956:x1830967463152384:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 25643us (26748us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147166.238668:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3676 00010000:00010000:0.0:1746147166.247875:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247893:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247901:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247908:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e3800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.247912:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247920:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247954:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.247961:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3800/0xb4b2209fbdac2f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.248036:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+24:1957:x1830967463152896:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 29943us (30624us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147166.248047:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3678 00000100:00100000:0.0:1746147166.266821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.268323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.269446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.269485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.424169:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463155712 00000100:00100000:0.0:1746147166.424174:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463155712 00000100:00100000:0.0:1746147166.424206:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463155840 00000100:00100000:0.0:1746147166.424209:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463155840 00000100:00100000:0.0:1746147166.424226:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3688 00000100:00100000:0.0:1746147166.424231:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463155712:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147166.424255:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424267:0:11283:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131045800/0xb4b2209fbdac23c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f87 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424274:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.424275:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.424278:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424296:0:11283:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131045800/0xb4b2209fbdac23c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f87 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424311:0:11283:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131045800/0xb4b2209fbdac23c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f87 expref: 18 pid: 8480 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.424321:0:11283:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:11283:1830967466170240:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147166.424371:0:11283:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090f6df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.424388:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3689 00000100:00100000:0.0:1746147166.424393:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463155840:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147166.424406:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef43800/0xb4b2209fbdac2faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424413:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.424414:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.424416:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef43800/0xb4b2209fbdac2faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.424422:0:8485:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ef43800/0xb4b2209fbdac2faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.429546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.429586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147166.429909:0:8486:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd4a00/0xb4b2209fbdac2f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.429917:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd4a00/0xb4b2209fbdac2f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.430459:0:8485:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ef43800/0xb4b2209fbdac2faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.430467:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef43800/0xb4b2209fbdac2faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746147166.538699:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872928 is committed 00010000:00010000:0.0:1746147166.606859:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606875:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606883:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606890:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef42000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.606894:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606901:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606918:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.606924:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef42000/0xb4b2209fbdac2fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.607028:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463155712:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 182791us (182893us total) trans 17179872929 rc 0/0 00000100:00100000:0.0:1746147166.607038:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3688 00000001:00080000:0.0:1746147166.607069:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872929 is committed 00000100:00100000:0.0:1746147166.635798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.635850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.639016:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463156992 00000100:00100000:0.0:1746147166.639023:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463156992 00010000:00010000:0.0:1746147166.639053:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5800/0xb4b2209fbdac2291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3ed1 expref: 12 pid: 8481 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.639076:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4997 00000100:00100000:0.0:1746147166.639082:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463156992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147166.639094:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147166.639116:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5800/0xb4b2209fbdac2291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3ed1 expref: 12 pid: 8481 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.639125:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5800/0xb4b2209fbdac2291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3ed1 expref: 12 pid: 8481 timeout: 653 lvb_type: 0 00010000:00010000:0.0:1746147166.639154:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.639156:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.639161:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d622200/0xb4b2209fbdac2fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.639168:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d622200/0xb4b2209fbdac2fb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.639185:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147166.639219:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463156992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147166.639226:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4997 00000100:00100000:0.0:1746147166.730815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.733455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147166.733830:0:8486:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130f09800/0xb4b2209fbdac2fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.733839:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f09800/0xb4b2209fbdac2fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.805222:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463157632 00000100:00100000:0.0:1746147166.805231:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463157632 00000100:00100000:0.0:1746147166.805300:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3693 00000100:00100000:0.0:1746147166.805308:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463157632:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147166.805344:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac2fc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.805363:0:8486:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac23a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f72 expref: 5 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.805371:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.805372:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.805375:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac2fc6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.805503:0:8486:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac23a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f72 expref: 5 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.805514:0:8486:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac23a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f72 expref: 5 pid: 8481 timeout: 653 lvb_type: 0 00000100:00100000:0.0:1746147166.805527:0:8486:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8486:1830967466170752:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147166.805621:0:8486:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147166.806156:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463157760 00000100:00100000:0.0:1746147166.806160:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463157760 00000100:00100000:0.0:1746147166.806181:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463157888 00000100:00100000:0.0:1746147166.806183:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463157888 00000100:00100000:0.0:1746147166.806198:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3694 00000100:00100000:0.0:1746147166.806203:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463157760:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147166.806217:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.806225:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.806226:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147166.806229:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.806964:0:8485:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.807103:0:8486:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8486:1830967466170752:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147166.807122:0:8486:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac2fc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.809304:0:8485:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.809311:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.809559:0:8486:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac2fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.809567:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac2fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147166.859870:0:21472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147161 -> 1746147166 00002000:00010000:0.0:1746147166.859875:0:21472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147161 -> 1746147166 00010000:00010000:0.0:1746147166.859891:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859902:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859910:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859916:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b94be00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.859919:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859928:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859962:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.859971:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac2fd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.860055:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:60817ea3-97af-43a7-ab2a-b628d12800db+23:1957:x1830967463157888:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 53834us (53931us total) trans 21474840295 rc 0/0 00000100:00100000:0.0:1746147166.860065:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3695 00010000:00010000:0.0:1746147166.901833:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901846:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901855:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901862:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095371000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147166.901866:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901875:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901897:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.901904:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095371000/0xb4b2209fbdac2fcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.902008:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463157760:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 95798us (96213us total) trans 21474840297 rc 0/0 00000100:00100000:0.0:1746147166.902018:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3694 00000100:00100000:0.0:1746147166.908479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.908761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.909037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.909067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147166.910116:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3697 00000100:00100000:0.0:1746147166.910123:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463158656:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147166.910159:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdac2fe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.910800:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147166.910802:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147166.910804:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdac2fe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.910812:0:21473:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdac2fe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147166.914124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147166.916094:0:21473:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdac2fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147166.916102:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1515c00/0xb4b2209fbdac2fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.110245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.114613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147167.177875:0:21473:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147162 -> 1746147166 00002000:00010000:0.0:1746147167.177881:0:21473:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147162 -> 1746147166 00010000:00010000:0.0:1746147167.177893:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.177904:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.177911:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.177916:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85c3000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147167.177920:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.177927:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.178060:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.178065:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3000/0xb4b2209fbdac2ffe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.178352:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463159424:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 67517us (68107us total) trans 21474840303 rc 0/0 00000100:00100000:0.0:1746147167.178364:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3701 00000100:00100000:0.0:1746147167.198813:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463159936 00000100:00100000:0.0:1746147167.198821:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463159936 00000100:00100000:0.0:1746147167.198858:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10224 00000100:00100000:0.0:1746147167.198864:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+9:28214:x1830967463159936:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147167.198882:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.198905:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e24200/0xb4b2209fbdac300c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4680 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147167.198932:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41b:0x0] initial LVB size: 2097152, mtime: 0x6814175e, atime: 0x0, ctime: 0x6814175e, blocks: 0x1007 00010000:00010000:0.0:1746147167.198977:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.198979:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.198987:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e24200/0xb4b2209fbdac300c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4680 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.199003:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e24200/0xb4b2209fbdac300c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4680 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.199019:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e24200, rc 0) 00000100:00100000:0.0:1746147167.199374:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:28214:x1830967463159936:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 509us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.199381:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10224 00000100:00100000:0.0:1746147167.207236:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463160064 00000100:00100000:0.0:1746147167.207245:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463160064 00000100:00100000:0.0:1746147167.207302:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10225 00000100:00100000:0.0:1746147167.207310:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:28214:x1830967463160064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147167.207329:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.207349:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e25200/0xb4b2209fbdac3013 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4687 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147167.207373:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41f:0x0] initial LVB size: 3145728, mtime: 0x6814175e, atime: 0x0, ctime: 0x6814175e, blocks: 0x1029 00010000:00010000:0.0:1746147167.207395:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.207397:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.207405:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e25200/0xb4b2209fbdac3013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4687 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.207420:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e25200/0xb4b2209fbdac3013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4687 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.207431:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e25200, rc 0) 00000100:00100000:0.0:1746147167.207478:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:28214:x1830967463160064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 168us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.207483:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10225 00000100:00100000:0.0:1746147167.217052:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463160192 00000100:00100000:0.0:1746147167.217060:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463160192 00000100:00100000:0.0:1746147167.217109:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10226 00000100:00100000:0.0:1746147167.217116:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28214:x1830967463160192:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147167.217135:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.217153:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e468e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147167.217179:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x41a:0x0] initial LVB size: 3145728, mtime: 0x6814175e, atime: 0x0, ctime: 0x6814175e, blocks: 0x1029 00010000:00010000:0.0:1746147167.217199:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.217201:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.217208:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e468e expref: 10 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.217222:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e468e expref: 10 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.217231:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e25c00, rc 0) 00000100:00100000:0.0:1746147167.217282:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28214:x1830967463160192:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 167us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.217288:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10226 00000100:00100000:0.0:1746147167.225807:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463160320 00000100:00100000:0.0:1746147167.225816:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463160320 00000100:00100000:0.0:1746147167.225859:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10227 00000100:00100000:0.0:1746147167.225866:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:28214:x1830967463160320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147167.225885:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.225906:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4695 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147167.225931:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x420:0x0] initial LVB size: 4194304, mtime: 0x6814175e, atime: 0x0, ctime: 0x6814175e, blocks: 0x821 00010000:00010000:0.0:1746147167.225993:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.225996:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.226004:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4695 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.226019:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4695 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.226029:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e24000, rc 0) 00000100:00100000:0.0:1746147167.226089:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:28214:x1830967463160320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 223us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.226096:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10227 00000100:00100000:0.0:1746147167.246846:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463160704 00000100:00100000:0.0:1746147167.246855:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463160704 00002000:00010000:0.0:1746147167.246891:0:21473:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1057 (4870144->18446744073709551615) 00002000:00100000:0.0:1746147167.246895:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463160704 ext(4870144->18446744073709551615) 00002000:00010000:0.0:1746147167.246907:0:21473:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5e0380. 00000100:00100000:0.0:1746147167.247529:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3702 00000100:00100000:0.0:1746147167.247538:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463160704:12345-192.168.203.36@tcp:10:lfs.0 00002000:00010000:0.0:1746147167.247867:0:21473:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147167.247870:0:21473:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.247872:0:21473:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147167.247873:0:21473:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.247875:0:21473:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147167.247932:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463160704:12345-192.168.203.36@tcp:10:lfs.0 Request processed in 395us (1169us total) trans 17179872932 rc 0/0 00000100:00100000:0.0:1746147167.247956:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3702 00002000:00010000:0.0:1746147167.247959:0:21473:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1057 (4870144->18446744073709551615) 00002000:00100000:0.0:1746147167.247962:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463160704 ext(4870144->18446744073709551615) 00002000:00010000:0.0:1746147167.247967:0:21473:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5e0380. 00010000:00010000:0.0:1746147167.262444:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262458:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262465:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262471:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb0f200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147167.262476:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262482:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262497:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147167.262511:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147167.262515:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.262520:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac3044 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147167.266596:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463161344 00000100:00100000:0.0:1746147167.266605:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463161344 00000100:00100000:0.0:1746147167.266653:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10230 00000100:00100000:0.0:1746147167.266659:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:28214:x1830967463161344:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147167.266678:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.266699:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e25400/0xb4b2209fbdac304b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e46b1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147167.266725:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x417:0x0] initial LVB size: 4194304, mtime: 0x6814175e, atime: 0x0, ctime: 0x6814175e, blocks: 0x2007 00010000:00010000:0.0:1746147167.266753:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.266755:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.266762:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e25400/0xb4b2209fbdac304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46b1 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.266776:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e25400/0xb4b2209fbdac304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46b1 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.266785:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e25400, rc 0) 00000100:00100000:0.0:1746147167.266836:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:28214:x1830967463161344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.266842:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10230 00000100:00100000:0.0:1746147167.277367:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3705 00000100:00100000:0.0:1746147167.277376:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463161856:12345-192.168.203.36@tcp:10:lfs.0 00002000:00010000:0.0:1746147167.277643:0:21473:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147167.277647:0:21473:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147162 -> 1746147167 00002000:00010000:0.0:1746147167.277649:0:21473:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147167.277651:0:21473:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147162 -> 1746147167 00002000:00010000:0.0:1746147167.277653:0:21473:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1746147167.277692:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463161856:12345-192.168.203.36@tcp:10:lfs.0 Request processed in 317us (670us total) trans 17179872933 rc 0/0 00000100:00100000:0.0:1746147167.277698:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3705 00002000:00010000:0.0:1746147167.277700:0:21473:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1058 (4194304->18446744073709551615) 00002000:00100000:0.0:1746147167.277702:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967463161856 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1746147167.277706:0:21473:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0380. 00000100:00100000:0.0:1746147167.281621:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463162112 00000100:00100000:0.0:1746147167.281629:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463162112 00000100:00100000:0.0:1746147167.282283:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10182 00000100:00100000:0.0:1746147167.282293:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:28214:x1830967463162112:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1746147167.282391:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdac3060 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147167.282407:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdac3060 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147167.282418:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdac3060 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00010000:0.0:1746147167.282544:0:16361:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012c9f2300 reply state ffff880090778000 transno 8589943875 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7547600/0xb4b2209fbdac3060 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147167.282551:0:16361:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147167.283883:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:28214:x1830967463162112:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 1587us (2402us total) trans 8589943875 rc 0/0 00000100:00100000:0.0:1746147167.283892:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10182 00000100:00100000:0.0:1746147167.289035:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466171264:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.289050:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.289092:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463162368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2084us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.289101:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5003 00000100:00100000:0.0:1746147167.294862:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463162624 00000100:00100000:0.0:1746147167.294869:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463162624 00010000:00010000:0.0:1746147167.294893:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac2f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e465d expref: 16 pid: 17530 timeout: 654 lvb_type: 1 00000100:00100000:0.0:1746147167.294924:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5004 00000100:00100000:0.0:1746147167.294930:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463162624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147167.294970:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147167.294993:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac2f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e465d expref: 16 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.295003:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac2f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e465d expref: 16 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.295025:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac2f25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e465d expref: 16 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.295039:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.295041:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.295047:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e767600/0xb4b2209fbdac306e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46cd expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.295054:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e767600/0xb4b2209fbdac306e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46cd expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.295080:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e767600/0xb4b2209fbdac306e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46cd expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.295093:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466171520:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147167.295151:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.297622:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466171520:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.297640:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.297884:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463162624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2952us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.297893:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5004 00000100:00100000:0.0:1746147167.301969:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463162880 00000100:00100000:0.0:1746147167.301977:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463162880 00010000:00010000:0.0:1746147167.302010:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc78000/0xb4b2209fbdac2f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4664 expref: 16 pid: 8478 timeout: 654 lvb_type: 1 00000100:00100000:0.0:1746147167.302034:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5005 00000100:00100000:0.0:1746147167.302219:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463162880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147167.302233:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147167.302253:0:7121:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746147167.302260:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc78000/0xb4b2209fbdac2f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4664 expref: 16 pid: 8478 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.302272:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc78000/0xb4b2209fbdac2f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4664 expref: 16 pid: 8478 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.302295:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc78000/0xb4b2209fbdac2f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4664 expref: 16 pid: 8478 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.302324:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.302326:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.302332:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e766600/0xb4b2209fbdac3075 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46d4 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.302340:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e766600/0xb4b2209fbdac3075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46d4 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.302369:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e766600/0xb4b2209fbdac3075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46d4 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.302380:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466171776:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147167.302459:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.311565:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466171776:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.311584:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.311645:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463162880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9603us (9757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.311654:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5005 00000100:00100000:0.0:1746147167.315684:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466171904:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147167.315716:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.315812:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e766200, rc 0) 00000100:00100000:0.0:1746147167.315931:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:28214:x1830967463163008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4617us (4874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.315969:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10236 00000100:00100000:0.0:1746147167.316059:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463163136 00000100:00100000:0.0:1746147167.316064:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463163136 00010000:00010000:0.0:1746147167.316090:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac2f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e466b expref: 17 pid: 17530 timeout: 654 lvb_type: 1 00000100:00100000:0.0:1746147167.316116:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5006 00000100:00100000:0.0:1746147167.316122:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463163136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147167.316134:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147167.316156:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac2f2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e466b expref: 17 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.316168:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac2f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e466b expref: 17 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.316189:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac2f2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e466b expref: 17 pid: 17530 timeout: 654 lvb_type: 1 00010000:00010000:0.0:1746147167.316215:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.316217:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.316225:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.316233:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.316262:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.316279:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466172032:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147167.316343:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.319135:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466172032:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.319158:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.319214:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463163136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3091us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.319225:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5006 00000100:00100000:0.0:1746147167.319599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.321650:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466172160:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147167.321675:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e767c00/0xb4b2209fbdac3083 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46e2 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.321688:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e767c00, rc 0) 00000100:00100000:0.0:1746147167.321722:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:28214:x1830967463163264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2048us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.321729:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10237 00000100:00100000:0.0:1746147167.324566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.333793:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10241 00000100:00100000:0.0:1746147167.333802:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463164288:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147167.333882:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147167.333884:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.333886:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.333888:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147165 -> 1746147167 00002000:00010000:0.0:1746147167.333890:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5483 -> 5483 00000100:00100000:0.0:1746147167.333905:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463164288:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 106us (627us total) trans 21474840307 rc 0/0 00000100:00100000:0.0:1746147167.333911:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10241 00000100:00100000:0.0:1746147167.333920:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10243 00000100:00100000:0.0:1746147167.333924:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463164160:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147167.334003:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147167.334005:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.334007:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.334008:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147165 -> 1746147167 00002000:00010000:0.0:1746147167.334010:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147167.334023:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463164160:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 99us (720us total) trans 21474840308 rc 0/0 00000100:00100000:0.0:1746147167.334028:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10243 00000100:00100000:0.0:1746147167.338661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.343036:0:14050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14050:1830967466172672:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147167.343058:0:14050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.344282:0:14050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.344288:0:14050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00000040:00080000:0.0:1746147167.345069:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off223032 00000004:00080000:0.0:1746147167.345077:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554332138733ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.345131:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2672, 88 off220824 00000004:00080000:0.0:1746147167.345136:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554332198671ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.345159:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2673, 88 off220912 00000004:00080000:0.0:1746147167.345162:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554332224541ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.345169:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off223120 00000004:00080000:0.0:1746147167.345171:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554332234009ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.345188:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2699, 88 off223208 00000004:00080000:0.0:1746147167.345191:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554332253828ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.345225:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2674, 88 off221000 00000004:00080000:0.0:1746147167.345869:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554332931721ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.345900:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2675, 88 off221088 00000004:00080000:0.0:1746147167.345903:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554332965721ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.345960:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2677, 88 off221272 00000004:00080000:0.0:1746147167.345963:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554333026276ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.345976:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off223296 00000004:00080000:0.0:1746147167.345978:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333041069ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.345996:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off221360 00000004:00080000:0.0:1746147167.345999:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554333061809ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.346005:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off223384 00000004:00080000:0.0:1746147167.346007:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333070006ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.346012:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off221448 00000004:00080000:0.0:1746147167.346015:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554333077731ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147167.346020:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off223472 00000004:00080000:0.0:1746147167.346023:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333086006ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.346030:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2703, 88 off223560 00000004:00080000:0.0:1746147167.346033:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333095701ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.346040:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2704, 88 off223648 00000004:00080000:0.0:1746147167.346043:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333105926ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.346050:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2705, 88 off223736 00000004:00080000:0.0:1746147167.346052:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554333114626ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147167.346058:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2680, 88 off221536 00000004:00080000:0.0:1746147167.346060:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554333123256ns, next at 537465048041ns, rc = 0 00010000:00010000:0.0:1746147167.374127:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374137:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374143:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374148:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4678e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147167.374151:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374158:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374172:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff880134d0ae00) 00010000:00010000:0.0:1746147167.374174:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147167.374177:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147167.374181:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac3091 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14050 initiator: MDT0 00000100:00100000:0.0:1746147167.380489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.386458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.415598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.418763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.418843:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463165696 00000100:00100000:0.0:1746147167.418849:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463165696 00000100:00100000:0.0:1746147167.418892:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10185 00000100:00100000:0.0:1746147167.418906:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+300:28227:x1830967463165696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.418925:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.418958:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094069c00/0xb4b2209fbdac30c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e46fe expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.419398:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419410:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419418:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419429:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419434:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419438:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419531:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419537:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419542:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147167.419551:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147167.419620:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419626:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419631:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419636:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85ad600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147167.419642:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419647:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419656:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147167.419658:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147167.419661:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.419665:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac30c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420908:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420918:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420924:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420933:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85acc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147167.420950:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420956:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420966:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:0.0:1746147167.420969:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147167.420971:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.420975:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac30d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.421029:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094069c00/0xb4b2209fbdac30c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46fe expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.421042:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46fe expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.421048:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147167.421050:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147167.421052:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85ada00, rc 0) 00000100:00100000:0.0:1746147167.421114:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28227:x1830967463165696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2215us (2356us total) trans 8589943879 rc 0/0 00000100:00100000:0.0:1746147167.421122:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10185 00000100:00100000:0.0:1746147167.424642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.424677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.426016:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463166080 00000100:00100000:0.0:1746147167.426026:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463166080 00000100:00100000:0.0:1746147167.426067:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463166464 00000100:00100000:0.0:1746147167.426070:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463166464 00000100:00100000:0.0:1746147167.426142:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10186 00000100:00100000:0.0:1746147167.426150:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28226:x1830967463166080:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147167.426174:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.426203:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094068c00/0xb4b2209fbdac30e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e470c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426302:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.426314:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdac30b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46f7 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426321:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46fe expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426326:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147167.426344:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46fe expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426352:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac30d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46fe expref: 302 pid: 14049 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.426359:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466175104:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147167.426390:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdac30b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46f7 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426398:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8c6e00/0xb4b2209fbdac30b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46f7 expref: 9 pid: 16361 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.426406:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466175232:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147167.426422:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.426595:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463166336 00000100:00100000:0.0:1746147167.426599:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463166336 00000100:00100000:0.0:1746147167.426633:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10263 00000100:00100000:0.0:1746147167.426639:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28227:x1830967463166336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.426647:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.426654:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948da600/0xb4b2209fbdac3108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4713 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426667:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147167.426671:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948da600/0xb4b2209fbdac3108 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4713 expref: 19 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426681:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948da600/0xb4b2209fbdac3108 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4713 expref: 19 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.426688:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948da600, rc 0) 00000100:00100000:0.0:1746147167.426709:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28227:x1830967463166336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.426714:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10263 00000100:00100000:0.0:1746147167.433028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.434528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.434617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.443468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.445685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.445868:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463166976 00000100:00100000:0.0:1746147167.445875:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463166976 00000100:00100000:0.0:1746147167.445922:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463167104 00000100:00100000:0.0:1746147167.445925:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463167104 00000100:00100000:0.0:1746147167.445956:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10188 00000100:00100000:0.0:1746147167.445963:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28227:x1830967463166976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.445988:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.446007:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac311d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4721 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.446137:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4721 expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.446162:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4721 expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.446349:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147167.446352:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147167.446354:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94a000, rc 0) 00000100:00100000:0.0:1746147167.446724:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28227:x1830967463166976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 760us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.446729:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10188 00000100:00100000:0.0:1746147167.449641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.449690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.452222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.472996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.473041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.477178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.480273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.482846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.482886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.482900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.482932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.482967:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463168896 00000100:00100000:0.0:1746147167.482974:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463168896 00002000:00100000:0.0:1746147167.483013:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x417:0x0] (1048576->2097151) req@ffff8800929f6a00 x1830967463168896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.483023:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6a00 with x1830967463168896 ext(1048576->2097151) 00002000:00010000:0.0:1746147167.483028:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f6a00 00000100:00100000:0.0:1746147167.483042:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463169152 00000100:00100000:0.0:1746147167.483044:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463169152 00002000:00100000:0.0:1746147167.483054:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x417:0x0] (3145728->4194303) req@ffff880099f6a300 x1830967463169152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.483060:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967463169152 ext(3145728->4194303) 00002000:00010000:0.0:1746147167.483062:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:0.0:1746147167.483070:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463168768 00000100:00100000:0.0:1746147167.483071:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463168768 00002000:00100000:0.0:1746147167.483080:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x417:0x0] (0->1048575) req@ffff880099f6aa00 x1830967463168768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.483086:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6aa00 with x1830967463168768 ext(0->1048575) 00002000:00010000:0.0:1746147167.483088:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6aa00 00000100:00100000:0.0:1746147167.483095:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463169024 00000100:00100000:0.0:1746147167.483097:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463169024 00002000:00100000:0.0:1746147167.483105:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x417:0x0] (2097152->3145727) req@ffff880099f69880 x1830967463169024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.483111:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463169024 ext(2097152->3145727) 00002000:00010000:0.0:1746147167.483114:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:0.0:1746147167.483123:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3710 00000100:00100000:0.0:1746147167.483129:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967463168896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147167.483799:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3711 00000100:00100000:0.0:1746147167.483804:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967463169152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147167.484392:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3712 00000100:00100000:0.0:1746147167.484398:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463168768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147167.484965:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3713 00000100:00100000:0.0:1746147167.484971:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463169024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147167.569338:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1959:x1830967463169024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 84367us (86406us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147167.569346:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3713 00002000:00100000:0.0:1746147167.569354:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x417:0x0] (2097152->3145727) req@ffff880099f69880 x1830967463169024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/440 e 0 to 0 dl 1746147178 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.569363:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463169024 ext(2097152->3145727) 00002000:00010000:0.0:1746147167.569367:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:0.0:1746147167.573044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.573087:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463170688 00000100:00100000:0.0:1746147167.573095:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463170688 00000100:00100000:0.0:1746147167.573132:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10191 00000100:00100000:0.0:1746147167.573138:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28223:x1830967463170688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.573156:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.573172:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac3171 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e476e expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.576696:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147167.576714:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac3171 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e476e expref: 13 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.576733:0:16361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147167.576756:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac3171 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e476e expref: 13 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.576769:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147167.576772:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147167.576775:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac3171 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e476e expref: 13 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.576781:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904a00, rc 0) 00000100:00100000:0.0:1746147167.576841:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28223:x1830967463170688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3702us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.576849:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10191 00000100:00100000:0.0:1746147167.582419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.582449:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463170816 00000100:00100000:0.0:1746147167.582457:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463170816 00000100:00100000:0.0:1746147167.582495:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10192 00000100:00100000:0.0:1746147167.582502:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28227:x1830967463170816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.582522:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.582540:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac3178 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4775 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.582595:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac3178 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4775 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.582606:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac3178 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4775 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.582617:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147167.582620:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147167.582624:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac3171 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e476e expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.582630:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904800, rc 0) 00000100:00100000:0.0:1746147167.582673:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28227:x1830967463170816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 171us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.582679:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10192 00000100:00100000:0.0:1746147167.611634:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466177024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147167.612554:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147167.612567:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466177408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147167.612581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147167.612587:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466178048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147167.612601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147167.612607:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466178560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147167.612618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147167.612741:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466178048 00000100:00100000:0.0:1746147167.612744:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466178048 00000100:00100000:0.0:1746147167.612757:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466178560 00000100:00100000:0.0:1746147167.612758:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466178560 00000100:00100000:0.0:1746147167.612766:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10279 00000100:00100000:0.0:1746147167.612770:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3293:x1830967466178944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147167.612856:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147167.612858:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.612860:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147167.612861:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.612863:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147167.612881:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967466178944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (478us total) trans 21474840322 rc 0/0 00000100:00100000:0.0:1746147167.612886:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10279 00000100:00100000:0.0:1746147167.612896:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10280 00000100:00100000:0.0:1746147167.612900:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967466177024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147167.612992:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147167.612995:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.612997:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.612998:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147167.613000:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147167.613020:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466177024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (466us total) trans 17179872947 rc 0/0 00000100:00100000:0.0:1746147167.613028:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10280 00000100:00100000:0.0:1746147167.613036:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10281 00000100:00100000:0.0:1746147167.613041:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466177408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147167.613105:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147167.613107:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.613109:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.613110:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147167.613112:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147167.613127:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466177408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (545us total) trans 21474840323 rc 0/0 00000100:00100000:0.0:1746147167.613131:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10281 00000100:00100000:0.0:1746147167.613138:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10282 00000100:00100000:0.0:1746147167.613142:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967466178048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147167.613197:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147167.613199:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.613201:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147167.613202:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.613204:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147167.613218:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466178048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (616us total) trans 17179872948 rc 0/0 00000100:00100000:0.0:1746147167.613222:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10282 00000100:00100000:0.0:1746147167.613236:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10283 00000100:00100000:0.0:1746147167.613239:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967466178560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147167.613299:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147167.613301:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.613303:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147167.613304:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147167.613306:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147167.613322:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466178560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (702us total) trans 17179872950 rc 0/0 00000100:00100000:0.0:1746147167.613327:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10283 00000100:00100000:0.0:1746147167.613344:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466177152 00000100:00100000:0.0:1746147167.613346:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466177152 00000100:00100000:0.0:1746147167.613358:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10284 00000100:00100000:0.0:1746147167.613362:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466177152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147167.613423:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147167.613425:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.613426:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.613428:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147167.613430:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147167.613452:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466177152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (122us total) trans 17179872951 rc 0/0 00000100:00100000:0.0:1746147167.613457:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10284 00000100:00100000:0.0:1746147167.614823:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466178176 00000100:00100000:0.0:1746147167.614829:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466178176 00000100:00100000:0.0:1746147167.614844:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466178688 00000100:00100000:0.0:1746147167.614847:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466178688 00000100:00100000:0.0:1746147167.614854:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466178816 00000100:00100000:0.0:1746147167.614855:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466178816 00000100:00100000:0.0:1746147167.614865:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10285 00000100:00100000:0.0:1746147167.614871:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466177664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147167.615615:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147167.615619:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.615621:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.615622:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147167.615624:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5483 -> 5483 00000100:00100000:0.0:1746147167.615645:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967466177664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 775us (2281us total) trans 21474840326 rc 0/0 00000100:00100000:0.0:1746147167.615650:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10285 00000004:00080000:0.0:1746147167.616318:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312a4700/2, rc 0, transno 17179872951 00000100:00100000:0.0:1746147167.616323:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466177152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147167.616870:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e135500/2, rc 0, transno 21474840326 00000100:00100000:0.0:1746147167.616876:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466177664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147167.616890:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e135880/2, rc 0, transno 21474840324 00000100:00100000:0.0:1746147167.616892:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466178176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147167.616899:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a46f2680/2, rc 0, transno 21474840325 00000100:00100000:0.0:1746147167.616901:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466178688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147167.616909:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4672a00/2, rc 0, transno 17179872952 00000100:00100000:0.0:1746147167.616912:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466178816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147167.620191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.624788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.625120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.625134:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463171456 00000100:00100000:0.0:1746147167.625137:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463171456 00000100:00100000:0.0:1746147167.625171:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10290 00000100:00100000:0.0:1746147167.625177:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463171456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.625183:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.625192:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a347000/0xb4b2209fbdac3186 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4783 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.625222:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466179584:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147167.625299:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.625393:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463171584 00000100:00100000:0.0:1746147167.625396:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463171584 00000100:00100000:0.0:1746147167.625416:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463171712 00000100:00100000:0.0:1746147167.625418:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463171712 00000100:00100000:0.0:1746147167.625430:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10291 00000100:00100000:0.0:1746147167.625435:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1956:x1830967463171584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.625443:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.625454:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099e11e00/0xb4b2209fbdac318d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e478a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.625479:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466179712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147167.625505:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.625690:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10294 00000100:00100000:0.0:1746147167.625695:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463171968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.625700:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.625706:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac31a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e479f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.625723:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466180096:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147167.625812:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987600 going to sleep for 11 seconds 00010000:00010000:0.0:1746147167.628367:0:11147:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88008e767600/0xb4b2209fbdac306e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46cd expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.628412:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466179712:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147167.628457:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099e11e00/0xb4b2209fbdac318d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e478a expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.628475:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099e11e00/0xb4b2209fbdac318d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e478a expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.630561:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e11e00, rc 0) 00010000:00010000:0.0:1746147167.630588:0:8481:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88008e767c00/0xb4b2209fbdac3083 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46e2 expref: 18 pid: 8481 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.630601:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e767c00/0xb4b2209fbdac3083 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46e2 expref: 18 pid: 8481 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.630610:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466180096:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147167.630636:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac31a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e479f expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.630651:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac31a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e479f expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.630658:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a0800, rc 0) 00000100:00100000:0.0:1746147167.630715:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1956:x1830967463171968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5019us (5127us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147167.630724:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10294 00000100:00100000:0.0:1746147167.630773:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463171584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5337us (5459us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147167.630778:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10291 00010000:00010000:0.0:1746147167.631347:0:17548:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac308a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46e9 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.631362:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466180224:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147167.631377:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xb4b2209fbdac31a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47a6 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.631385:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xb4b2209fbdac31a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47a6 expref: 7 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.631391:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541800, rc 0) 00000100:00100000:0.0:1746147167.631419:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1956:x1830967463172096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5716us (5820us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147167.631423:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10295 00000100:00100000:0.0:1746147167.632331:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466180608:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.632341:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.632357:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463172480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2367us (2683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.632363:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5017 00000100:00100000:0.0:1746147167.633603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.634969:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463172864 00000100:00100000:0.0:1746147167.634974:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463172864 00000100:00100000:0.0:1746147167.635008:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10297 00000100:00100000:0.0:1746147167.635014:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28223:x1830967463172864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.635025:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.635042:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac31b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e47b4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.635069:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.635071:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.635078:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac31b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47b4 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.635092:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac31b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47b4 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.635101:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1a00, rc 0) 00000100:00100000:0.0:1746147167.635128:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28223:x1830967463172864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.635134:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10297 00000100:00100000:0.0:1746147167.642018:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3716 00000100:00100000:0.0:1746147167.642031:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463173760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147167.653388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.658317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.659286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.661608:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463174144 00000100:00100000:0.0:1746147167.661619:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463174144 00010000:00010000:0.0:1746147167.661653:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4759 expref: 10 pid: 14125 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.661689:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5020 00000100:00100000:0.0:1746147167.661696:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463174144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147167.661704:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147167.661708:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4759 expref: 10 pid: 14125 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.663182:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4759 expref: 10 pid: 14125 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.663197:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eacc200/0xb4b2209fbdac3147 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4759 expref: 9 pid: 14125 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.663249:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147167.663253:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.663308:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463174144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1612us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.663316:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5020 00000100:00100000:0.0:1746147167.665219:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967463173120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24589us (24866us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147167.665228:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3715 00002000:00100000:0.0:1746147167.665237:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880134d00380 x1830967463173120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/440 e 0 to 0 dl 1746147178 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.665246:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00380 with x1830967463173120 ext(2097152->3145727) 00002000:00010000:0.0:1746147167.665250:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00380 00000100:00100000:0.0:1746147167.665830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.674958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.675222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.675366:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463174656 00000100:00100000:0.0:1746147167.675369:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463174656 00000100:00100000:0.0:1746147167.698411:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10309 00000100:00100000:0.0:1746147167.700147:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3293:x1830967466182144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147167.700241:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147167.700243:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.700245:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147167.700247:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147167.700249:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147167.700274:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3293:x1830967466182144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (4605us total) trans 17179872960 rc 0/0 00000100:00100000:0.0:1746147167.700279:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10309 00000100:00100000:0.0:1746147167.701107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.701177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.702403:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463175040 00000100:00100000:0.0:1746147167.702406:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463175040 00000100:00100000:0.0:1746147167.702435:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3967 00000100:00100000:0.0:1746147167.702441:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28226:x1830967463175040:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:0.0:1746147167.702483:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28226:x1830967463175040:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 43us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.702488:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3967 00000100:00100000:0.0:1746147167.706132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.707357:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463175424 00000100:00100000:0.0:1746147167.707362:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463175424 00000100:00100000:0.0:1746147167.707538:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3969 00000100:00100000:0.0:1746147167.707546:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28223:x1830967463175424:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147167.708240:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28223:x1830967463175424:12345-192.168.203.36@tcp:49:cat.0 Request processed in 693us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.708248:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3969 00000100:00100000:0.0:1746147167.708531:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463175552 00000100:00100000:0.0:1746147167.708535:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463175552 00002000:00100000:0.0:1746147167.708572:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (663552->1048575) req@ffff88009f76a300 x1830967463175552/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.708581:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463175552 ext(663552->1048575) 00002000:00010000:0.0:1746147167.708591:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:0.0:1746147167.708605:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3717 00000100:00100000:0.0:1746147167.708610:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463175552:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147167.718780:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3720 00000100:00100000:0.0:1746147167.718790:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463176448:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147167.728387:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463175552:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19766us (20002us total) trans 21474840336 rc 0/0 00000100:00100000:0.0:1746147167.728401:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3717 00002000:00100000:0.0:1746147167.728413:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (663552->1048575) req@ffff88009f76a300 x1830967463175552/t21474840336(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:543/0 lens 488/448 e 0 to 0 dl 1746147178 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.728422:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463175552 ext(663552->1048575) 00002000:00010000:0.0:1746147167.728429:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:0.0:1746147167.732151:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466184192:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147167.732173:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147167.732203:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463176704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9526us (9638us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147167.732213:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5022 00000100:00100000:0.0:1746147167.732248:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463176960 00000100:00100000:0.0:1746147167.732252:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463176960 00002000:00100000:0.0:1746147167.732282:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1945600->1949695) req@ffff8800a46f0a80 x1830967463176960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/0 e 0 to 0 dl 1746147178 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.732291:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f0a80 with x1830967463176960 ext(1945600->1949695) 00002000:00010000:0.0:1746147167.732295:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a46f0a80 00000100:00100000:0.0:1746147167.732318:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3721 00000100:00100000:0.0:1746147167.732323:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463176960:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147167.732521:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463176960:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 198us (1337us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147167.732526:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3721 00002000:00100000:0.0:1746147167.732530:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1945600->1949695) req@ffff8800a46f0a80 x1830967463176960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:543/0 lens 488/4536 e 0 to 0 dl 1746147178 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147167.732537:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f0a80 with x1830967463176960 ext(1945600->1949695) 00002000:00010000:0.0:1746147167.732539:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a46f0a80 00000100:00100000:0.0:1746147167.750239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.750488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.750525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.750542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.750572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.752452:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463178112 00000100:00100000:0.0:1746147167.752457:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463178112 00000100:00100000:0.0:1746147167.752488:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10319 00000100:00100000:0.0:1746147167.752494:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28225:x1830967463178112:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147167.752503:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.752521:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8c000/0xb4b2209fbdac31fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e47f3 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.752546:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.752554:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147167.752555:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147167.752559:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8c000/0xb4b2209fbdac31fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->1867775] (req 1048576->1867775) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47f3 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.752586:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.752597:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 15 pid: 8481 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.752608:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466184320:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147167.752668:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.757652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.757676:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463178240 00000100:00100000:0.0:1746147167.757682:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463178240 00010000:00010000:0.0:1746147167.757711:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 654 lvb_type: 0 00000100:00100000:0.0:1746147167.757764:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5023 00000100:00100000:0.0:1746147167.757771:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463178240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147167.757787:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147167.757808:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.757818:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e766200/0xb4b2209fbdac307c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e46db expref: 16 pid: 8481 timeout: 654 lvb_type: 0 00010000:00010000:0.0:1746147167.757844:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.757846:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147167.757854:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb8c000/0xb4b2209fbdac31fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1867775) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47f3 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.757862:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8c000/0xb4b2209fbdac31fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1867775) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47f3 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147167.757890:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb8c000/0xb4b2209fbdac31fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1867775) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47f3 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.757901:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466184448:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147167.757969:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.768179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.771436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.771666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.777879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.777972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.782414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.798140:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463179776 00000100:00100000:0.0:1746147167.798148:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463179776 00000100:00100000:0.0:1746147167.798463:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10327 00000100:00100000:0.0:1746147167.798469:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463179776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.798477:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.798484:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094eb0800/0xb4b2209fbdac3235 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e481d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.798509:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466185472:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147167.798532:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.803099:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466185472:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147167.803139:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094eb0800/0xb4b2209fbdac3235 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e481d expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.803152:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094eb0800/0xb4b2209fbdac3235 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e481d expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.803167:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb0800, rc 0) 00000100:00100000:0.0:1746147167.803227:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463179776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4758us (6164us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147167.803234:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10327 00000100:00100000:0.0:1746147167.803310:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466185344:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147167.803328:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491e400/0xb4b2209fbdac322e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4824 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.803337:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491e400/0xb4b2209fbdac322e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4824 expref: 9 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147167.803344:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e400, rc 0) 00000100:00100000:0.0:1746147167.803371:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463179904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4988us (5438us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147167.803376:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10326 00000100:00100000:0.0:1746147167.806571:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463180160 00000100:00100000:0.0:1746147167.806581:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463180160 00000100:00100000:0.0:1746147167.806613:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463180288 00000100:00100000:0.0:1746147167.806615:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463180288 00000100:00100000:0.0:1746147167.806636:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10328 00000100:00100000:0.0:1746147167.806643:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967463180160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147167.806657:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147167.806677:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac323c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4832 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147167.806719:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466185600:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147167.806798:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147167.807816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.807853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.818193:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463181056 00000100:00100000:0.0:1746147167.818201:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463181056 00000100:00100000:0.0:1746147167.818421:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3971 00000100:00100000:0.0:1746147167.818429:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28227:x1830967463181056:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147167.818532:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28227:x1830967463181056:12345-192.168.203.36@tcp:35:cat.0 Request processed in 104us (501us total) trans 8589943885 rc 0/0 00000100:00100000:0.0:1746147167.818539:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3971 00000100:00100000:0.0:1746147167.880614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.889425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.891092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.891128:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463181824 00000100:00100000:0.0:1746147167.891135:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463181824 00000100:00100000:0.0:1746147167.900776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.905448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.907902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147167.907965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.007228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.020167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.023987:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466188800:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147168.024007:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147168.024041:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1959:x1830967463183104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4947us (5265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.024049:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5027 00000100:00100000:0.0:1746147168.026294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.027792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.027901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.027930:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463184128 00000100:00100000:0.0:1746147168.027934:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463184128 00010000:00010000:0.0:1746147168.027976:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e470c expref: 7 pid: 14049 timeout: 655 lvb_type: 0 00000100:00100000:0.0:1746147168.028012:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463184000 00000100:00100000:0.0:1746147168.028014:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463184000 00010000:00010000:0.0:1746147168.028029:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a310400/0xb4b2209fbdac3101 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e471a expref: 302 pid: 14125 timeout: 655 lvb_type: 0 00000100:00100000:0.0:1746147168.028041:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5028 00000100:00100000:0.0:1746147168.028047:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463184128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147168.028057:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147168.028062:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e470c expref: 7 pid: 14049 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028071:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e470c expref: 7 pid: 14049 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028092:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac30f3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e470c expref: 7 pid: 14049 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028114:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147168.028118:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028125:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028129:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028134:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147168.028159:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1959:x1830967463184128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.028169:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5028 00000100:00100000:0.0:1746147168.028182:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5029 00000100:00100000:0.0:1746147168.028186:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1959:x1830967463184000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147168.028192:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147168.028196:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a310400/0xb4b2209fbdac3101 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e471a expref: 302 pid: 14125 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028203:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a310400/0xb4b2209fbdac3101 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e471a expref: 302 pid: 14125 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028213:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a310400/0xb4b2209fbdac3101 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e471a expref: 302 pid: 14125 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.028223:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147168.028225:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028231:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028237:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac32c8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147168.028254:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147168.028267:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:1959:x1830967463184000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.028272:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5029 00000100:00100000:0.0:1746147168.034721:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10351 00000100:00100000:0.0:1746147168.034741:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463184640:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147168.034751:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.034761:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac32d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4878 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147168.034792:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466189312:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147168.034821:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147168.034880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.034895:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463185024 00000100:00100000:0.0:1746147168.034898:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463185024 00000100:00100000:0.0:1746147168.034912:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10354 00000100:00100000:0.0:1746147168.034917:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463185152:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147168.034923:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.034930:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1200/0xb4b2209fbdac32eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4894 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.034958:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147168.034960:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147168.034969:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1200/0xb4b2209fbdac32eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4894 expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.035436:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1200/0xb4b2209fbdac32eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4894 expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.035446:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1200, rc 0) 00000100:00100000:0.0:1746147168.035479:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+19:1959:x1830967463185152:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 561us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.035486:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10354 00000100:00100000:0.0:1746147168.043413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.045356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.046627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.049355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.049389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.049417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147168.050171:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147168.050788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.054236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.055040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.060829:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463187328 00000100:00100000:0.0:1746147168.060833:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463187328 00000100:00100000:0.0:1746147168.060857:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10359 00000100:00100000:0.0:1746147168.060861:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28234:x1830967463187328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147168.060874:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.060886:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac3377 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e48cc expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.061350:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c8c3600/0xb4b2209fbdac3370 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48c5 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.061356:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147168.061361:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147168.061363:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac3377 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [720896->1048575] (req 720896->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48cc expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.061392:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c8c3600/0xb4b2209fbdac3370 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48c5 expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.061404:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c8c3600/0xb4b2209fbdac3370 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70080400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48c5 expref: 18 pid: 8478 timeout: 655 lvb_type: 0 00000100:00100000:0.0:1746147168.061416:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466190336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147168.061478:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147168.061901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.061928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.061969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.062008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.062024:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463187456 00000100:00100000:0.0:1746147168.062028:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463187456 00000100:00100000:0.0:1746147168.062045:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463187584 00000100:00100000:0.0:1746147168.062047:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463187584 00000100:00100000:0.0:1746147168.062058:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463187712 00000100:00100000:0.0:1746147168.062060:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463187712 00000100:00100000:0.0:1746147168.062068:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463187840 00000100:00100000:0.0:1746147168.062070:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463187840 00000100:00100000:0.0:1746147168.062081:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10360 00000100:00100000:0.0:1746147168.062086:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463187456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147168.062095:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.062102:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdac337e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e48d3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.062114:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147168.062121:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdac337e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48d3 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.062128:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952c4600/0xb4b2209fbdac337e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48d3 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.062139:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c4600, rc 0) 00000100:00100000:0.0:1746147168.062159:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463187456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (259us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147168.062164:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10360 00000100:00100000:0.0:1746147168.062175:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10361 00000100:00100000:0.0:1746147168.062180:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463187584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147168.062187:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.062196:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac3385 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e48da expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147168.062221:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466190592:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147168.062257:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147168.067322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.067874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.088065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.088116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.093786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.096185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.102129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.103124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.103153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.103180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.103202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.115378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.121707:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463189504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17869us (18541us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147168.121721:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1346 00002000:00100000:0.0:1746147168.121742:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009b208380 x1830967463189504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/440 e 0 to 0 dl 1746147179 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.121753:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208380 with x1830967463189504 ext(1048576->2097151) 00010000:00010000:0.0:1746147168.121764:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094061e00/0xb4b2209fbdac33a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48f6 expref: 26 pid: 17530 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.121778:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094061e00/0xb4b2209fbdac33a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48f6 expref: 26 pid: 17530 timeout: 655 lvb_type: 0 00002000:00010000:0.0:1746147168.121785:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b208380 00000100:00100000:0.0:1746147168.124005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.125911:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463189760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21867us (22727us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147168.125917:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3734 00002000:00100000:0.0:1746147168.125923:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009b20a300 x1830967463189760/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/440 e 0 to 0 dl 1746147179 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.125928:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a300 with x1830967463189760 ext(1048576->2097151) 00002000:00010000:0.0:1746147168.125932:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a300 00000100:00100000:0.0:1746147168.138388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.152528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.153384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.174858:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463192320 00000100:00100000:0.0:1746147168.174864:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463192320 00000100:00100000:0.0:1746147168.187616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.189449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.200205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.200244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.220690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.221238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.221359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.224110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.229993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.230081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.230980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.249802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.257276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.261986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.264744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.280102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.280150:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.289034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.289077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.289106:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463196160 00000100:00100000:0.0:1746147168.289114:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463196160 00002000:00100000:0.0:1746147168.289149:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008d5dca80 x1830967463196160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:544/0 lens 488/0 e 0 to 0 dl 1746147179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.289157:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dca80 with x1830967463196160 ext(3145728->4194303) 00002000:00010000:0.0:1746147168.289163:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dca80 00000100:00100000:0.0:1746147168.289177:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463196032 00000100:00100000:0.0:1746147168.289179:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463196032 00002000:00100000:0.0:1746147168.289187:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008d5df480 x1830967463196032/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:544/0 lens 488/0 e 0 to 0 dl 1746147179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.289192:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967463196032 ext(2097152->3145727) 00002000:00010000:0.0:1746147168.289195:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:0.0:1746147168.289204:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3748 00000100:00100000:0.0:1746147168.289212:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463196160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147168.311239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.312403:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463196160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23190us (23377us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147168.312411:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3748 00002000:00100000:0.0:1746147168.312418:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008d5dca80 x1830967463196160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:544/0 lens 488/440 e 0 to 0 dl 1746147179 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.312425:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dca80 with x1830967463196160 ext(3145728->4194303) 00002000:00010000:0.0:1746147168.312428:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dca80 00000100:00100000:0.0:1746147168.332304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.350130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.354897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.362092:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.379499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.386981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.387017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.387904:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10379 00000100:00100000:0.0:1746147168.387922:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463197696:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147168.387969:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147168.389013:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463198464 00000100:00100000:0.0:1746147168.389018:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463198464 00002000:00100000:0.0:1746147168.389046:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1138688->1142783) req@ffff88009f453800 x1830967463198464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/0 e 0 to 0 dl 1746147179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.389056:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f453800 with x1830967463198464 ext(1138688->1142783) 00002000:00010000:0.0:1746147168.389061:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f453800 00000100:00100000:0.0:1746147168.389084:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3751 00000100:00100000:0.0:1746147168.389090:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463198464:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147168.389224:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463198464:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 133us (768us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147168.389230:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3751 00002000:00100000:0.0:1746147168.389234:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1138688->1142783) req@ffff88009f453800 x1830967463198464/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/4536 e 0 to 0 dl 1746147179 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.389242:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f453800 with x1830967463198464 ext(1138688->1142783) 00002000:00010000:0.0:1746147168.389245:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f453800 00000100:00100000:0.0:1746147168.389282:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466193152:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147168.389298:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147168.390230:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463197568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10472us (10736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.390239:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5039 00000100:00100000:0.0:1746147168.397656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.398277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.398306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.402270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.403243:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463199872 00000100:00100000:0.0:1746147168.403247:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463199872 00002000:00100000:0.0:1746147168.403464:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1138688->1740799) req@ffff880093d35500 x1830967463199872/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/0 e 0 to 0 dl 1746147179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.403474:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35500 with x1830967463199872 ext(1138688->1740799) 00010000:00010000:0.0:1746147168.403481:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f486e00/0xb4b2209fbdac3434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4951 expref: 24 pid: 4444 timeout: 655 lvb_type: 0 00010000:00010000:0.0:1746147168.403586:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f486e00/0xb4b2209fbdac3434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4951 expref: 24 pid: 4444 timeout: 655 lvb_type: 0 00002000:00010000:0.0:1746147168.403592:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093d35500 00000100:00100000:0.0:1746147168.403607:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1350 00000100:00100000:0.0:1746147168.403613:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463199872:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147168.403691:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463200384 00000100:00100000:0.0:1746147168.403693:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463200384 00000100:00100000:0.0:1746147168.403713:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3979 00000100:00100000:0.0:1746147168.403717:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28249:x1830967463200384:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147168.405465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.420014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.420224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.427378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.429212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.436344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.436857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.442397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.442445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.442492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.458706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.472879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.472922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.472992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.529229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.532338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.554626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.559635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.562399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.563635:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3759 00000100:00100000:0.0:1746147168.563647:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463204992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147168.587679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.591110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.593067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.596495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.601032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.603658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.606234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.636457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.644791:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.650445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.678007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.692626:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463208192 00000100:00100000:0.0:1746147168.692635:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463208192 00010000:00010000:0.0:1746147168.692671:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac31e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e47d7 expref: 26 pid: 11147 timeout: 655 lvb_type: 0 00000100:00100000:0.0:1746147168.692864:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463208064 00000100:00100000:0.0:1746147168.692867:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463208064 00010000:00010000:0.0:1746147168.692881:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55a1200/0xb4b2209fbdac32eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4894 expref: 16 pid: 6881 timeout: 655 lvb_type: 1 00000100:00100000:0.0:1746147168.697154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.700370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.704980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.707195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.837326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.846716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147168.852320:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147165 -> 1746147168 00002000:00010000:0.0:1746147168.852325:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147165 -> 1746147168 00002000:00010000:0.0:1746147168.852327:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147167 -> 1746147168 00000100:00100000:0.0:1746147168.852351:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466196224:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147168.852383:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdac3561 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e49f9 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.852398:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d800/0xb4b2209fbdac3561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e49f9 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.852424:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31d800, rc 0) 00000100:00100000:0.0:1746147168.852479:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463209216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9576us (15164us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147168.852488:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10392 00000100:00100000:0.0:1746147168.854297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.859616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.871445:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463209856 00000100:00100000:0.0:1746147168.871510:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463209856 00010000:00010000:0.0:1746147168.871546:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5427e00/0xb4b2209fbdac33bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e490b expref: 24 pid: 8478 timeout: 655 lvb_type: 1 00000100:00100000:0.0:1746147168.871570:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463210112 00000100:00100000:0.0:1746147168.871572:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463210112 00010000:00010000:0.0:1746147168.871581:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094060800/0xb4b2209fbdac339a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48ef expref: 12 pid: 4444 timeout: 655 lvb_type: 0 00000100:00100000:0.0:1746147168.871592:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463209984 00000100:00100000:0.0:1746147168.871594:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463209984 00010000:00010000:0.0:1746147168.871602:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac346c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e495f expref: 17 pid: 6881 timeout: 655 lvb_type: 1 00000100:00100000:0.0:1746147168.871614:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5054 00000100:00100000:0.0:1746147168.871620:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463209856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147168.871632:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147168.871652:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5427e00/0xb4b2209fbdac33bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e490b expref: 24 pid: 8478 timeout: 655 lvb_type: 1 00010000:00010000:0.0:1746147168.871662:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5427e00/0xb4b2209fbdac33bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e490b expref: 23 pid: 8478 timeout: 655 lvb_type: 1 00010000:00010000:0.0:1746147168.871689:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5427e00/0xb4b2209fbdac33bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e490b expref: 23 pid: 8478 timeout: 655 lvb_type: 1 00010000:00010000:0.0:1746147168.872659:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147168.874017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.880444:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463210880 00000100:00100000:0.0:1746147168.880452:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463210880 00002000:00100000:0.0:1746147168.880487:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (331776->335871) req@ffff88009f450380 x1830967463210880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/0 e 0 to 0 dl 1746147179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.880497:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450380 with x1830967463210880 ext(331776->335871) 00002000:00010000:0.0:1746147168.880502:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f450380 00000100:00100000:0.0:1746147168.887766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.887801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.887837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.899228:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f450e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466197120:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147168.899264:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab3200/0xb4b2209fbdac35c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a23 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.899279:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab3200/0xb4b2209fbdac35c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a23 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147168.899926:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab3200, rc 0) 00000100:00100000:0.0:1746147168.900151:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463211648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7662us (9017us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147168.900160:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10396 00000100:00100000:0.0:1746147168.905076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.909665:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f452a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466197248:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147168.909698:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac35ca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a2a expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147168.909715:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab3000, rc 0) 00000100:00100000:0.0:1746147168.910782:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28282:x1830967463211904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5591us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147168.910789:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10397 00000100:00100000:0.0:1746147168.920152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.920213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.922032:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463212672 00000100:00100000:0.0:1746147168.922038:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463212672 00000100:00100000:0.0:1746147168.929741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.943057:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463212672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19876us (22840us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147168.943065:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3770 00002000:00100000:0.0:1746147168.943072:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e683480 x1830967463212672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:544/0 lens 488/440 e 0 to 0 dl 1746147179 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147168.943079:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967463212672 ext(3145728->4194303) 00002000:00010000:0.0:1746147168.943083:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e683480 00000100:00100000:0.0:1746147168.954701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.957261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.960551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.968233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.971113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.971151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.971315:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10400 00000100:00100000:0.0:1746147168.971324:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463214336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147168.971333:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147168.971343:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac35df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4a3f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147168.971383:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466198016:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147168.971451:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147168.972444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.977513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.977722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147168.986442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.000261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147169.002314:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147169.009871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.009918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.010078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.015222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.034608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147169.034919:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147169.041476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.041531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.082442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147169.082630:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147169.129814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.141617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.174196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.185998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.186048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.197364:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463217664 00000100:00100000:0.0:1746147169.197376:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463217664 00010000:00010000:0.0:1746147169.197421:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0000/0xb4b2209fbdac348f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4989 expref: 24 pid: 21080 timeout: 656 lvb_type: 1 00000100:00100000:0.0:1746147169.197482:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5064 00000100:00100000:0.0:1746147169.197493:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463217664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147169.197510:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147169.197540:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0000/0xb4b2209fbdac348f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4989 expref: 24 pid: 21080 timeout: 656 lvb_type: 1 00010000:00010000:0.0:1746147169.197554:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0000/0xb4b2209fbdac348f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4989 expref: 24 pid: 21080 timeout: 656 lvb_type: 1 00010000:00010000:0.0:1746147169.197580:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0000/0xb4b2209fbdac348f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4989 expref: 24 pid: 21080 timeout: 656 lvb_type: 1 00010000:00010000:0.0:1746147169.197625:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.197628:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.197638:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e558000/0xb4b2209fbdac362c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a70 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.197647:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e558000/0xb4b2209fbdac362c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a70 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.197688:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e558000/0xb4b2209fbdac362c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a70 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147169.197704:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466199040:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147169.200389:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147169.220997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.221076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.232687:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.232731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.232760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.232806:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463218560 00000100:00100000:0.0:1746147169.232811:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463218560 00010000:00010000:0.0:1746147169.232838:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab2400/0xb4b2209fbdac35b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a15 expref: 25 pid: 21080 timeout: 656 lvb_type: 0 00000100:00100000:0.0:1746147169.232864:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463218688 00000100:00100000:0.0:1746147169.232866:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463218688 00000100:00100000:0.0:1746147169.232882:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5066 00000100:00100000:0.0:1746147169.232887:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463218432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147169.232895:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147169.232911:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b829000/0xb4b2209fbdac3602 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a62 expref: 19 pid: 21080 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.232921:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b829000/0xb4b2209fbdac3602 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a62 expref: 19 pid: 21080 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.233049:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b829000/0xb4b2209fbdac3602 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a62 expref: 19 pid: 21080 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.233141:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147169.233176:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463218432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 287us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147169.233182:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5066 00000100:00100000:0.0:1746147169.234001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147169.241286:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147168 -> 1746147169 00002000:00010000:0.0:1746147169.241291:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147168 -> 1746147169 00000100:00100000:0.0:1746147169.241309:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466199552:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147169.241333:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdac365d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a85 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.241345:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360400/0xb4b2209fbdac365d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a85 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.241355:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360400, rc 0) 00000100:00100000:0.0:1746147169.241376:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463218816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7298us (7375us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.241382:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10408 00000100:00100000:0.0:1746147169.248762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.257675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.277359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.287126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.290448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.290896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.290926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.290975:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463220736 00000100:00100000:0.0:1746147169.290982:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463220736 00002000:00100000:0.0:1746147169.291021:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a5ba0a80 x1830967463220736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.291032:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0a80 with x1830967463220736 ext(2097152->3145727) 00002000:00010000:0.0:1746147169.291037:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba0a80 00000100:00100000:0.0:1746147169.291051:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463221120 00000100:00100000:0.0:1746147169.291053:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463221120 00002000:00100000:0.0:1746147169.291064:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (3162112->4194303) req@ffff8800a5ba0e00 x1830967463221120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.291071:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0e00 with x1830967463221120 ext(3162112->4194303) 00002000:00010000:0.0:1746147169.291073:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba0e00 00000100:00100000:0.0:1746147169.291086:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3784 00000100:00100000:0.0:1746147169.291094:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463220736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.292551:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3785 00000100:00100000:0.0:1746147169.292561:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463221120:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.304650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.311049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.311399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.311905:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463220736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20811us (21008us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147169.311912:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3784 00002000:00100000:0.0:1746147169.311921:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a5ba0a80 x1830967463220736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/440 e 0 to 0 dl 1746147180 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.311956:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0a80 with x1830967463220736 ext(2097152->3145727) 00002000:00010000:0.0:1746147169.311961:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba0a80 00000100:00100000:0.0:1746147169.311976:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463221632 00000100:00100000:0.0:1746147169.311981:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463221632 00002000:00100000:0.0:1746147169.312002:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1089536->1818623) req@ffff8800a5ba3480 x1830967463221632/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.312008:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967463221632 ext(1089536->1818623) 00010000:00010000:0.0:1746147169.312013:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac35d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a31 expref: 19 pid: 21080 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.312023:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac35d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a31 expref: 19 pid: 21080 timeout: 656 lvb_type: 0 00002000:00010000:0.0:1746147169.312029:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ba3480 00000100:00100000:0.0:1746147169.312050:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1355 00000100:00100000:0.0:1746147169.312056:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463221632:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147169.318555:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10415 00000100:00100000:0.0:1746147169.318566:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463222144:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147169.318575:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.318584:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab2400/0xb4b2209fbdac36aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4abd expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147169.318608:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466200832:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147169.319812:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00002000:00010000:0.0:1746147169.324250:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147168 -> 1746147169 00002000:00010000:0.0:1746147169.324259:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147168 -> 1746147169 00002000:00010000:0.0:1746147169.324261:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147168 -> 1746147169 00000100:00100000:0.0:1746147169.324286:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466200576:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147169.324319:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac36a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ab6 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.324333:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac36a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ab6 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.324358:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9e00, rc 0) 00000100:00100000:0.0:1746147169.324398:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463222016:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7182us (7249us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.324406:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10414 00000100:00100000:0.0:1746147169.330328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.330368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.330390:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463222912 00000100:00100000:0.0:1746147169.330397:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463222912 00000100:00100000:0.0:1746147169.330436:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463223040 00000100:00100000:0.0:1746147169.330438:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463223040 00000100:00100000:0.0:1746147169.330455:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10419 00000100:00100000:0.0:1746147169.330462:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463222912:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147169.331448:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.331460:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab3e00/0xb4b2209fbdac36cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ad9 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147169.331486:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466201344:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147169.331511:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987600 going to sleep for 11 seconds 00002000:00010000:0.0:1746147169.331599:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147168 -> 1746147169 00000100:00100000:0.0:1746147169.331614:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466200832:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147169.331635:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab2400/0xb4b2209fbdac36aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4abd expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.331644:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab2400/0xb4b2209fbdac36aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4abd expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.331653:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab2400, rc 0) 00000100:00100000:0.0:1746147169.331670:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463222144:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 13108us (14509us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.331676:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10415 00000100:00100000:0.0:1746147169.333209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.334286:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466201216:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147169.334465:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4e200/0xb4b2209fbdac36c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ae0 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.334475:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4e200/0xb4b2209fbdac36c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ae0 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.334483:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4e200, rc 0) 00000100:00100000:0.0:1746147169.334510:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463223040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3997us (4142us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.334516:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10420 00000100:00100000:0.0:1746147169.336001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.339068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.339814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.340241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.349036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.349080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.350087:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463224960 00000100:00100000:0.0:1746147169.350091:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463224960 00000100:00100000:0.0:1746147169.350117:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3987 00000100:00100000:0.0:1746147169.350122:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:28298:x1830967463224960:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147169.350303:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:28298:x1830967463224960:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 180us (372us total) trans 8589943919 rc 0/0 00000100:00100000:0.0:1746147169.350310:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3987 00000100:00100000:0.0:1746147169.350684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.350928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.360110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.370157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.370247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.370281:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463225728 00000100:00100000:0.0:1746147169.370288:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463225728 00000100:00100000:0.0:1746147169.370338:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10426 00000100:00100000:0.0:1746147169.370346:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463225728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147169.370361:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.370374:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab2c00/0xb4b2209fbdac371a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4b18 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.370453:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.370465:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab2c00/0xb4b2209fbdac371a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b18 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.370639:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab2c00/0xb4b2209fbdac371a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b18 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.370657:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab2c00, rc 0) 00000100:00100000:0.0:1746147169.370708:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463225728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 363us (460us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.370715:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10426 00000100:00100000:0.0:1746147169.371349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.374162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.378641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.379377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.399200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.404586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.429155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.431877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.439104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.456990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.459447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.459469:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463228032 00000100:00100000:0.0:1746147169.459477:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463228032 00002000:00100000:0.0:1746147169.459506:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f368000 x1830967463228032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.459513:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368000 with x1830967463228032 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.459518:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f368000 00000100:00100000:0.0:1746147169.459534:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3791 00000100:00100000:0.0:1746147169.459541:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463228032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.460651:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463228288 00000100:00100000:0.0:1746147169.460656:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463228288 00002000:00100000:0.0:1746147169.460677:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e680700 x1830967463228288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.460684:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967463228288 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.460687:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680700 00000100:00100000:0.0:1746147169.460700:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3792 00000100:00100000:0.0:1746147169.460704:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463228288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.492568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.509014:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466203008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147169.509053:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147169.510734:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147169.520376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.526140:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967466203392:0@lo:400:kworker.0 00000100:00100000:0.0:1746147169.526215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147169.527801:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b57d6275-d138-4373-818f-9bad59bb9e6f:3295:1830967466203392:0@lo:400:kworker.0 00000100:00080000:0.0:1746147169.527823:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746147169.528366:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147169.540498:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.550684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.555377:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466204032:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147169.555395:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147169.555430:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967463229440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4545us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147169.555438:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5076 00000100:00100000:0.0:1746147169.566350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.591354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.603414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.603449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.604233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.604535:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463230464 00000100:00100000:0.0:1746147169.604539:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463230464 00000100:00100000:0.0:1746147169.605695:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10432 00000100:00100000:0.0:1746147169.605707:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463230464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147169.605736:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.605755:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092904600/0xb4b2209fbdac379f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4b5e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147169.605812:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466204160:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147169.605910:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147169.605985:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.608912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.618022:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466204416:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147169.618040:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac37ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b65 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.618051:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac37ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b65 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147169.618420:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99f200, rc 0) 00000100:00100000:0.0:1746147169.618450:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463230592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12544us (14217us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147169.618455:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10434 00000100:00100000:0.0:1746147169.630524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.632784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.642743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.653865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.656445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.659123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.664842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.666242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.666273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.674080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.674102:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463232512 00000100:00100000:0.0:1746147169.674109:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463232512 00002000:00100000:0.0:1746147169.674148:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3244032->3604479) req@ffff88008ddec000 x1830967463232512/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.674159:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddec000 with x1830967463232512 ext(3244032->3604479) 00010000:00010000:0.0:1746147169.674167:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b82b200/0xb4b2209fbdac3775 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b49 expref: 28 pid: 8481 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.674181:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b82b200/0xb4b2209fbdac3775 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b49 expref: 28 pid: 8481 timeout: 656 lvb_type: 0 00002000:00010000:0.0:1746147169.674192:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ddec000 00000100:00100000:0.0:1746147169.674210:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1360 00000100:00100000:0.0:1746147169.674217:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463232512:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147169.704123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.704213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.706200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.707877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.710476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.712588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.713502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.713538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.713548:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463233792 00000100:00100000:0.0:1746147169.713555:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463233792 00010000:00010000:0.0:1746147169.713570:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac3736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b34 expref: 26 pid: 8481 timeout: 656 lvb_type: 0 00000100:00100000:0.0:1746147169.714216:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5080 00000100:00100000:0.0:1746147169.714222:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463233792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147169.714230:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147169.714241:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac3736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b34 expref: 28 pid: 8481 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.714249:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac3736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b34 expref: 28 pid: 8481 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.714266:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac3736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b34 expref: 28 pid: 8481 timeout: 656 lvb_type: 0 00010000:00010000:0.0:1746147169.714282:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.714283:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.714290:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b60da00/0xb4b2209fbdac37de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b9d expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.714298:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b60da00/0xb4b2209fbdac37de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b9d expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.714322:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b60da00/0xb4b2209fbdac37de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b9d expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147169.714331:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466205824:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147169.714381:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147169.723233:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466205824:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147169.723255:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147169.723292:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463233792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9069us (9752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147169.723303:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5080 00000100:00100000:0.0:1746147169.732710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.735980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.736029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.741990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.761617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.765201:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.773067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.778150:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.805858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.806520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.840863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.840900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.840927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.841020:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463236480 00000100:00100000:0.0:1746147169.841026:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463236480 00002000:00100000:0.0:1746147169.841061:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008f81bb80 x1830967463236480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.841070:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81bb80 with x1830967463236480 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.841075:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81bb80 00000100:00100000:0.0:1746147169.841094:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3804 00000100:00100000:0.0:1746147169.841101:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463236224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.842464:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3806 00000100:00100000:0.0:1746147169.842474:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463236736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.847396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.847437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.847462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.847492:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463236992 00000100:00100000:0.0:1746147169.847500:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463236992 00002000:00100000:0.0:1746147169.847541:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008f818e00 x1830967463236992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.847558:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818e00 with x1830967463236992 ext(2097152->3145727) 00002000:00010000:0.0:1746147169.847564:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f818e00 00000100:00100000:0.0:1746147169.847579:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463237248 00000100:00100000:0.0:1746147169.847582:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463237248 00002000:00100000:0.0:1746147169.847591:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008f818380 x1830967463237248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.847597:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818380 with x1830967463237248 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.847599:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f818380 00000100:00100000:0.0:1746147169.847607:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463237504 00000100:00100000:0.0:1746147169.847609:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463237504 00002000:00100000:0.0:1746147169.847621:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008f819880 x1830967463237504/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1746147180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.847627:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819880 with x1830967463237504 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.847630:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f819880 00000100:00100000:0.0:1746147169.847640:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3807 00000100:00100000:0.0:1746147169.847646:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463236992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147169.870615:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463236736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28134us (29678us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147169.870627:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3806 00002000:00100000:0.0:1746147169.870639:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008f818000 x1830967463236736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:545/0 lens 488/440 e 0 to 0 dl 1746147180 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147169.870648:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818000 with x1830967463236736 ext(3145728->4194303) 00002000:00010000:0.0:1746147169.870653:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818000 00000100:00100000:0.0:1746147169.886336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.902096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.902675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.902712:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463238144 00000100:00100000:0.0:1746147169.902727:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463238144 00000100:00100000:0.0:1746147169.902765:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10225 00000100:00100000:0.0:1746147169.902771:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28321:x1830967463238144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147169.902796:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.902812:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdac3808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4bc0 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.902913:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.902925:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.902964:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.902977:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.902983:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.902988:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903094:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac381d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903104:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac381d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903110:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac381d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147169.903119:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 16777217 00010000:00010000:0.0:1746147169.903208:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903215:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903221:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903227:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147169.903231:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903237:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903248:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147169.903251:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147169.903255:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903259:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195000/0xb4b2209fbdac380f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903274:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903279:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903287:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903291:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f194e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147169.903294:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903298:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903303:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134d0ad00) 00010000:00010000:0.0:1746147169.903305:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147169.903307:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903312:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194e00/0xb4b2209fbdac3816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147169.903345:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194800/0xb4b2209fbdac3808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bc0 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.903356:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac381d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bc0 expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.903362:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147169.903364:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147169.903366:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f195800, rc 0) 00000100:00100000:0.0:1746147169.903416:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28321:x1830967463238144:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 638us (734us total) trans 8589943926 rc 0/0 00000100:00100000:0.0:1746147169.903422:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10225 00000100:00100000:0.0:1746147169.915007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.917000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.921080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.924391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.936117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.951319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.956012:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463239296 00000100:00100000:0.0:1746147169.956020:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463239296 00000100:00100000:0.0:1746147169.956070:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10450 00000100:00100000:0.0:1746147169.956077:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28311:x1830967463239296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147169.956095:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147169.956111:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab2a00/0xb4b2209fbdac3840 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4bdc expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.956136:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.956139:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147169.956148:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab2a00/0xb4b2209fbdac3840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bdc expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.956163:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab2a00/0xb4b2209fbdac3840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bdc expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147169.956175:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab2a00, rc 0) 00000100:00100000:0.0:1746147169.956218:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28311:x1830967463239296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147169.956224:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10450 00000100:00100000:0.0:1746147169.965038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.965070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.967423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.974105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.975645:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.975756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.982185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.982208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.983084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.989819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.990512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147169.995549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.003003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.009275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147170.009684:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147170.025422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147170.026125:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147170.026743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.026832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.026850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.027126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.027143:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463242112 00000100:00100000:0.0:1746147170.027146:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463242112 00000100:00100000:0.0:1746147170.031353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.037785:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463242880 00000100:00100000:0.0:1746147170.037794:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463242880 00010000:00010000:0.0:1746147170.037831:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac3767 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b42 expref: 314 pid: 14125 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.037873:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5090 00000100:00100000:0.0:1746147170.037881:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463242880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.037895:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.037901:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac3767 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b42 expref: 314 pid: 14125 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.037912:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac3767 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b42 expref: 314 pid: 14125 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.037933:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac3767 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b42 expref: 314 pid: 14125 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.037971:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147170.037976:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485be00/0xb4b2209fbdac3871 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.037985:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485be00/0xb4b2209fbdac3871 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.037991:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b485be00/0xb4b2209fbdac3871 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.038023:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.038066:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1957:x1830967463242880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.038072:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5090 00000100:00100000:0.0:1746147170.041989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.042538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.046079:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463243264 00000100:00100000:0.0:1746147170.046085:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463243264 00000100:00100000:0.0:1746147170.046114:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10456 00000100:00100000:0.0:1746147170.046120:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463243264:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147170.046132:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147170.046143:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab2c00/0xb4b2209fbdac3886 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4c0d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.046162:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab2c00/0xb4b2209fbdac3886 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c0d expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.046170:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab2c00/0xb4b2209fbdac3886 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c0d expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.046179:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab2c00, rc 0) 00000100:00100000:0.0:1746147170.046205:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463243264:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 85us (215us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147170.046210:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10456 00000100:00100000:0.0:1746147170.047572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.052077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.056377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.068555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.074271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.074303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.074323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.074336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.074533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.075780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.075793:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463244928 00000100:00100000:0.0:1746147170.075796:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463244928 00000100:00100000:0.0:1746147170.075812:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10463 00000100:00100000:0.0:1746147170.075817:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463244928:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147170.075831:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab3c00/0xb4b2209fbdac38e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.075839:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485aa00/0xb4b2209fbdac3855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bf1 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.075844:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147170.075846:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147170.075848:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab3c00/0xb4b2209fbdac38e8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.075860:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485aa00/0xb4b2209fbdac3855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bf1 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.075867:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b485aa00/0xb4b2209fbdac3855 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bf1 expref: 27 pid: 21080 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.075874:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466210048:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147170.075889:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147170.095321:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466210048:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147170.095338:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fab3c00/0xb4b2209fbdac38e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147170.095360:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147170.097518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.097544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098064:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463245184 00000100:00100000:0.0:1746147170.098070:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463245184 00010000:00010000:0.0:1746147170.098185:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa0cc00/0xb4b2209fbdac3878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4bff expref: 20 pid: 21080 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.098211:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463245312 00000100:00100000:0.0:1746147170.098214:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463245312 00010000:00010000:0.0:1746147170.098224:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdac3465 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e496d expref: 19 pid: 17530 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.098239:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5095 00000100:00100000:0.0:1746147170.098244:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463245312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.098253:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.098267:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdac3465 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e496d expref: 19 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.098274:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdac3465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e496d expref: 19 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.098288:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486400/0xb4b2209fbdac3465 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e496d expref: 19 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.098301:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.098637:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463245312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 392us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.098643:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5095 00000100:00100000:0.0:1746147170.098680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.098982:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463246080 00000100:00100000:0.0:1746147170.098985:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463246080 00010000:00010000:0.0:1746147170.099000:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac33af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4904 expref: 24 pid: 17530 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.099013:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463245696 00000100:00100000:0.0:1746147170.099015:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463245696 00010000:00010000:0.0:1746147170.099022:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5426600/0xb4b2209fbdac33cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4927 expref: 30 pid: 17530 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.099033:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5096 00000100:00100000:0.0:1746147170.099038:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463246080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.099045:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.099052:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac33af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4904 expref: 24 pid: 17530 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.099060:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac33af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4904 expref: 24 pid: 17530 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.099070:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac33af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4904 expref: 24 pid: 17530 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.099078:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.099094:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463246080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.099102:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5096 00000100:00100000:0.0:1746147170.099110:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5097 00000100:00100000:0.0:1746147170.099115:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463245696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.099131:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.099139:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5426600/0xb4b2209fbdac33cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4927 expref: 30 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099146:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5426600/0xb4b2209fbdac33cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4927 expref: 30 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099160:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5426600/0xb4b2209fbdac33cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4927 expref: 30 pid: 17530 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099168:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.099169:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.099173:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0xb4b2209fbdac38cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.099180:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0xb4b2209fbdac38cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.099203:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.099220:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463245696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.099224:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5097 00000100:00100000:0.0:1746147170.099251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.099263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.099269:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463245952 00000100:00100000:0.0:1746147170.099272:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463245952 00010000:00010000:0.0:1746147170.099280:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa0ca00/0xb4b2209fbdac387f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c06 expref: 18 pid: 8478 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.099289:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463246208 00000100:00100000:0.0:1746147170.099290:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463246208 00010000:00010000:0.0:1746147170.099296:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac37e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b96 expref: 23 pid: 8478 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.099307:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5098 00000100:00100000:0.0:1746147170.099311:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463245952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.099316:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.099323:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aa0ca00/0xb4b2209fbdac387f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c06 expref: 18 pid: 8478 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099329:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aa0ca00/0xb4b2209fbdac387f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c06 expref: 18 pid: 8478 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099338:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa0ca00/0xb4b2209fbdac387f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c06 expref: 18 pid: 8478 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.099346:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.099357:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463245952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.099362:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5098 00000100:00100000:0.0:1746147170.099370:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5099 00000100:00100000:0.0:1746147170.099374:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463246208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.099379:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.099385:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac37e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b96 expref: 23 pid: 8478 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100263:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac37e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b96 expref: 23 pid: 8478 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100275:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac37e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b96 expref: 23 pid: 8478 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100283:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.100298:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463246208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 923us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.100303:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5099 00000100:00100000:0.0:1746147170.100352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.100361:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463246848 00000100:00100000:0.0:1746147170.100363:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463246848 00010000:00010000:0.0:1746147170.100373:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac36b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ac4 expref: 19 pid: 21080 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.100388:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5102 00000100:00100000:0.0:1746147170.100392:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463246848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.100397:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.100406:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac36b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ac4 expref: 19 pid: 21080 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100418:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac36b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ac4 expref: 19 pid: 21080 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100427:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac36b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ac4 expref: 19 pid: 21080 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100434:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.100443:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+18:1958:x1830967463246848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.100447:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5102 00000100:00100000:0.0:1746147170.100470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.100479:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463246720 00000100:00100000:0.0:1746147170.100481:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463246720 00010000:00010000:0.0:1746147170.100490:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e28c00/0xb4b2209fbdac37bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b73 expref: 19 pid: 8481 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.100511:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5103 00000100:00100000:0.0:1746147170.100515:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463246720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.100520:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.100528:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e28c00/0xb4b2209fbdac37bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b73 expref: 19 pid: 8481 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100535:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e28c00/0xb4b2209fbdac37bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b73 expref: 19 pid: 8481 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100549:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e28c00/0xb4b2209fbdac37bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4b73 expref: 19 pid: 8481 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.100556:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.100557:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.100560:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdac38c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.100565:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a800/0xb4b2209fbdac38c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.100577:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.100593:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463246720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 78us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.100599:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5103 00000100:00100000:0.0:1746147170.100633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.100642:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463246592 00000100:00100000:0.0:1746147170.100644:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463246592 00010000:00010000:0.0:1746147170.100654:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac35fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a5b expref: 29 pid: 4444 timeout: 657 lvb_type: 1 00000100:00100000:0.0:1746147170.100666:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5104 00000100:00100000:0.0:1746147170.100670:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463246592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.100674:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.100681:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac35fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a5b expref: 29 pid: 4444 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100692:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac35fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a5b expref: 29 pid: 4444 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100701:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac35fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4a5b expref: 29 pid: 4444 timeout: 657 lvb_type: 1 00010000:00010000:0.0:1746147170.100708:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.100726:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463246592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.100730:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5104 00000100:00100000:0.0:1746147170.113012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.116054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147170.116990:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.116997:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117013:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117018:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117024:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117035:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f194a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147170.117038:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117043:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117057:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147170.117063:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194a00/0xb4b2209fbdac38d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147170.117108:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463244800:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 41853us (42784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.117114:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10460 00000100:00100000:0.0:1746147170.120121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.125443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.125473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.125486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.125521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.125542:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463247488 00000100:00100000:0.0:1746147170.125550:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463247488 00010000:00010000:0.0:1746147170.125580:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdac333f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a9 expref: 30 pid: 14125 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.125603:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463248000 00000100:00100000:0.0:1746147170.125604:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463248000 00010000:00010000:0.0:1746147170.125611:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009491fa00/0xb4b2209fbdac32a5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e485c expref: 313 pid: 14048 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.125620:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463247616 00000100:00100000:0.0:1746147170.125621:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463247616 00010000:00010000:0.0:1746147170.125627:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131045c00/0xb4b2209fbdac331c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a2 expref: 314 pid: 16361 timeout: 657 lvb_type: 0 00000100:00100000:0.0:1746147170.125636:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5107 00000100:00100000:0.0:1746147170.125642:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463247488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.125654:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.125658:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdac333f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a9 expref: 30 pid: 14125 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125666:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800904ed400/0xb4b2209fbdac333f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a9 expref: 30 pid: 14125 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125682:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147170.125686:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.125692:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.125735:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463247488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.125741:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5107 00000100:00100000:0.0:1746147170.125754:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5108 00000100:00100000:0.0:1746147170.125758:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463248000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.125763:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.125766:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009491fa00/0xb4b2209fbdac32a5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e485c expref: 314 pid: 14048 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125773:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009491fa00/0xb4b2209fbdac32a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e485c expref: 314 pid: 14048 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125781:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147170.125784:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.125788:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.125800:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463248000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.125805:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5108 00000100:00100000:0.0:1746147170.125813:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5109 00000100:00100000:0.0:1746147170.125817:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1957:x1830967463247616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147170.125822:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147170.125825:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131045c00/0xb4b2209fbdac331c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a2 expref: 313 pid: 16361 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125832:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131045c00/0xb4b2209fbdac331c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e48a2 expref: 313 pid: 16361 timeout: 657 lvb_type: 0 00010000:00010000:0.0:1746147170.125839:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147170.125842:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.125846:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147170.125856:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463247616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.125860:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5109 00000100:00100000:0.0:1746147170.130917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147170.168004:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168012:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168017:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168022:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f195800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147170.168025:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168031:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168043:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147170.168045:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147170.168048:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147170.168052:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f195800/0xb4b2209fbdac38ef lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147170.168688:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466210688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147170.170920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147170.170935:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466211200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147170.170965:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147170.170981:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466211712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147170.170995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147170.171006:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466212224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147170.171018:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147170.171036:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466212224 00000100:00100000:0.0:1746147170.171039:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466212224 00000100:00100000:0.0:1746147170.171054:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10479 00000100:00100000:0.0:1746147170.171058:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967466211712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147170.171144:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147170.171146:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147170.171148:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147170.171149:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147166 -> 1746147166 00002000:00010000:0.0:1746147170.171151:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147170.171171:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3295:x1830967466211712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (174us total) trans 21474840364 rc 0/0 00000100:00100000:0.0:1746147170.171176:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10479 00000004:00080000:0.0:1746147170.171198:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4fac000/2, rc 0, transno 21474840362 00000100:00100000:0.0:1746147170.171201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466210688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147170.171207:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4faf480/2, rc 0, transno 21474840363 00000100:00100000:0.0:1746147170.171209:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466211200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147170.171213:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f369880/2, rc 0, transno 21474840364 00000100:00100000:0.0:1746147170.171216:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466211712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147170.171223:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585f80/2, rc 0, transno 17179872988 00000100:00100000:0.0:1746147170.171225:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466212224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147170.186062:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463248512 00000100:00100000:0.0:1746147170.186071:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463248512 00000100:00100000:0.0:1746147170.186114:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10481 00000100:00100000:0.0:1746147170.186122:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463248512:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147170.186135:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147170.186150:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4c3e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147170.186168:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141761, atime: 0x68141760, ctime: 0x68141761, blocks: 0x7f7 00010000:00010000:0.0:1746147170.186184:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.186186:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.186193:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c3e expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.186206:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c3e expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.186215:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab3000, rc 0) 00000100:00100000:0.0:1746147170.186252:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463248512:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 131us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.186258:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10481 00000100:00100000:0.0:1746147170.188213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.190244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.190272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147170.192100:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463249152 00000100:00100000:0.0:1746147170.192105:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463249152 00000100:00100000:0.0:1746147170.192183:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10486 00000100:00100000:0.0:1746147170.192189:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463249152:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147170.192198:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147170.192208:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac392e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4c61 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147170.192220:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141761, atime: 0x68141761, ctime: 0x68141761, blocks: 0x102b 00010000:00010000:0.0:1746147170.192230:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.192231:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147170.192235:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac392e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c61 expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.192244:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac392e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c61 expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147170.192251:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dca00, rc 0) 00000100:00100000:0.0:1746147170.192284:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463249152:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147170.192290:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10486 00000100:00100000:0.0:1746147171.204454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.209977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.210617:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3816 00000100:00100000:0.0:1746147171.210624:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463249920:12345-192.168.203.36@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147171.210638:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.210646:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.210647:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.210650:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.210657:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.219117:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3819 00000100:00100000:0.0:1746147171.219126:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+22:1959:x1830967463250688:12345-192.168.203.36@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147171.219186:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac395f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.219192:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.219193:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.219196:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac395f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.219203:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac395f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243640:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243655:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243662:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243669:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308b5600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147171.243672:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243679:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243693:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.243699:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5600/0xb4b2209fbdac3943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.243793:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:1959:x1830967463249920:12345-192.168.203.36@tcp:3:mirror_io.0 Request processed in 33165us (33532us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147171.243803:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3816 00010000:00010000:0.0:1746147171.293083:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293097:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293104:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293111:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa0c200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147171.293116:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293124:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293139:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.293145:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa0c200/0xb4b2209fbdac396d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.293214:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+20:1958:x1830967463251328:12345-192.168.203.36@tcp:3:mirror_io.0 Request processed in 72477us (72565us total) trans 0 rc 675840/675840 00000100:00100000:0.0:1746147171.293223:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3822 00000100:00100000:0.0:1746147171.310125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.310166:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.317849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.318253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147171.319183:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147171.520914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.524550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.524574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.524611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.524631:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463253248 00000100:00100000:0.0:1746147171.524637:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463253248 00000100:00100000:0.0:1746147171.524670:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463253376 00000100:00100000:0.0:1746147171.524672:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463253376 00000100:00100000:0.0:1746147171.524698:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3826 00000100:00100000:0.0:1746147171.524704:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463253248:12345-192.168.203.36@tcp:4:mirror_io.0 00010000:00010000:0.0:1746147171.524735:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.524748:0:31324:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e468e expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.524754:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147171.524756:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147171.524758:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.524782:0:31324:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e468e expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.524791:0:31324:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e25c00/0xb4b2209fbdac301a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e468e expref: 18 pid: 8481 timeout: 658 lvb_type: 0 00000100:00100000:0.0:1746147171.524801:0:31324:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:31324:1830967466213248:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147171.524971:0:31324:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147171.526525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.530619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.530660:0:31324:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:31324:1830967466213248:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147171.530680:0:31324:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.531518:0:8485:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.531528:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.532364:0:31324:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.532372:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147171.660388:0:8485:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147166 -> 1746147171 00002000:00010000:0.0:1746147171.660391:0:8485:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147166 -> 1746147171 00010000:00010000:0.0:1746147171.660402:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660410:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660417:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660423:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d606800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147171.660426:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660434:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660454:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.660459:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d606800/0xb4b2209fbdac3997 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.661773:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463252736:12345-192.168.203.36@tcp:4:mirror_io.0 Request processed in 135167us (135242us total) trans 21474840366 rc 0/0 00000100:00100000:0.0:1746147171.661782:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3828 00010000:00010000:0.0:1746147171.723699:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723723:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723730:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723737:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f064600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147171.723740:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723747:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723762:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.723773:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac3989 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.723858:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463253248:12345-192.168.203.36@tcp:4:mirror_io.0 Request processed in 199149us (199278us total) trans 21474840367 rc 0/0 00000100:00100000:0.0:1746147171.723866:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3826 00000100:00100000:0.0:1746147171.728231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.728278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.728669:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3830 00000100:00100000:0.0:1746147171.728676:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463254016:12345-192.168.203.36@tcp:4:mirror_io.0 00010000:00010000:0.0:1746147171.728693:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e558000/0xb4b2209fbdac39a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.728701:0:8485:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4695 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.728717:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147171.728718:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147171.728721:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e558000/0xb4b2209fbdac39a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.728735:0:8485:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4695 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.728742:0:8485:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e24000/0xb4b2209fbdac3021 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4695 expref: 11 pid: 6881 timeout: 658 lvb_type: 0 00000100:00100000:0.0:1746147171.728756:0:8485:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:8485:1830967466213504:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147171.728776:0:8485:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147171.732332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.733452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147171.819768:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872993 is committed 00000100:00100000:0.0:1746147171.834029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.838801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.919204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.920344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.921870:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463255168 00000100:00100000:0.0:1746147171.921873:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463255168 00000100:00100000:0.0:1746147171.921911:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3834 00000100:00100000:0.0:1746147171.921917:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463255168:12345-192.168.203.36@tcp:4:mirror_io.0 00010000:00010000:0.0:1746147171.921932:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac39c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.921964:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.921966:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.921968:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac39c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.921974:0:31324:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac39c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147171.922479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147171.923428:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147171.923460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147171.926045:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463255680 00000100:00100000:0.0:1746147171.926052:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463255680 00010000:00010000:0.0:1746147171.926074:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e200/0xb4b2209fbdac312b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e472f expref: 13 pid: 11147 timeout: 658 lvb_type: 0 00000100:00100000:0.0:1746147171.926094:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5119 00000100:00100000:0.0:1746147171.926100:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1956:x1830967463255680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147171.926110:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147171.926127:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e200/0xb4b2209fbdac312b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e472f expref: 13 pid: 11147 timeout: 658 lvb_type: 0 00010000:00010000:0.0:1746147171.926137:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb0e200/0xb4b2209fbdac312b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e472f expref: 13 pid: 11147 timeout: 658 lvb_type: 0 00010000:00010000:0.0:1746147171.926154:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926155:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926159:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e766800/0xb4b2209fbdac39b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926165:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e766800/0xb4b2209fbdac39b3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926172:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926173:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926175:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7546200/0xb4b2209fbdac39ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926180:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7546200/0xb4b2209fbdac39ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926185:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926185:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926188:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac39c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926193:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac39c1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926198:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926199:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147171.926201:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac39c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926206:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ec3a00/0xb4b2209fbdac39c8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147171.926884:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147171.926920:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+12:1956:x1830967463255680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 820us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147171.926927:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5119 00000100:00100000:0.0:1746147172.054024:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463255936 00000100:00100000:0.0:1746147172.054034:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463255936 00000100:00100000:0.0:1746147172.055037:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463256320 00000100:00100000:0.0:1746147172.055039:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463256320 00000100:00100000:0.0:1746147172.055058:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3838 00000100:00100000:0.0:1746147172.055061:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463256064:12345-192.168.203.36@tcp:4:mirror_io.0 00010000:00010000:0.0:1746147172.055163:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.055209:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.055210:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.055212:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.055216:0:8484:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147172.055231:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147172.058906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147172.060608:0:8484:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.060617:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270344:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270360:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270368:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270375:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800912cdc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147172.270379:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270392:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270412:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.270417:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912cdc00/0xb4b2209fbdac39e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147172.270499:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+20:1958:x1830967463256064:12345-192.168.203.36@tcp:4:mirror_io.0 Request processed in 215431us (215946us total) trans 21474840375 rc 0/0 00000100:00100000:0.0:1746147172.270508:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3838 00000100:00100000:0.0:1746147172.286086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147172.361093:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746147172.366290:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147172.369743:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463257472 00000100:00100000:0.0:1746147172.369752:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463257472 00000100:00100000:0.0:1746147172.369797:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10488 00000100:00100000:0.0:1746147172.369804:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:28326:x1830967463257472:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147172.369820:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.369835:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4c6f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147172.369855:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41f:0x0] initial LVB size: 3145728, mtime: 0x68141763, atime: 0x0, ctime: 0x68141763, blocks: 0x1029 00010000:00010000:0.0:1746147172.369871:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.369873:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.369879:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c6f expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.369891:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c6f expref: 11 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.369899:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cac00, rc 0) 00000100:00100000:0.0:1746147172.369961:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:28326:x1830967463257472:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.369966:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10488 00000100:00100000:0.0:1746147172.375926:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463257728 00000100:00100000:0.0:1746147172.375934:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463257728 00000100:00100000:0.0:1746147172.376044:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10490 00000100:00100000:0.0:1746147172.376051:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:28326:x1830967463257728:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147172.376064:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.376078:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac3a0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4c7d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147172.376096:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x420:0x0] initial LVB size: 4194304, mtime: 0x68141763, atime: 0x0, ctime: 0x68141763, blocks: 0x821 00010000:00010000:0.0:1746147172.376111:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.376113:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.376118:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac3a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c7d expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.376129:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac3a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c7d expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.376136:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca000, rc 0) 00000100:00100000:0.0:1746147172.376591:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:28326:x1830967463257728:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 539us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.376598:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10490 00010000:00010000:0.0:1746147172.405061:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405068:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405074:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405079:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b94ac00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147172.405082:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405088:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405098:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800b52b8b00) 00010000:00010000:0.0:1746147172.405101:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147172.405103:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147172.405108:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ac00/0xb4b2209fbdac3a31 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147172.412110:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463259136 00000100:00100000:0.0:1746147172.412118:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463259136 00002000:00010000:0.0:1746147172.412146:0:8485:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1054 (4870144->18446744073709551615) 00002000:00100000:0.0:1746147172.412150:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463259136 ext(4870144->18446744073709551615) 00002000:00010000:0.0:1746147172.412159:0:8485:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818a80. 00000100:00100000:0.0:1746147172.412179:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463259264 00000100:00100000:0.0:1746147172.412182:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463259264 00002000:00010000:0.0:1746147172.412191:0:8485:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1058 (4194304->18446744073709551615) 00002000:00100000:0.0:1746147172.412193:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81b480 with x1830967463259264 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1746147172.412198:0:8485:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81b480. 00000100:00100000:0.0:1746147172.412209:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3843 00000100:00100000:0.0:1746147172.412215:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463259136:12345-192.168.203.36@tcp:10:mirror_io.0 00002000:00010000:0.0:1746147172.412390:0:8485:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147172.412392:0:8485:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.412394:0:8485:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.412396:0:8485:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.412398:0:8485:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147172.412477:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463259136:12345-192.168.203.36@tcp:10:mirror_io.0 Request processed in 261us (396us total) trans 21474840379 rc 0/0 00000100:00100000:0.0:1746147172.412483:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3843 00002000:00010000:0.0:1746147172.412485:0:8485:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1054 (4870144->18446744073709551615) 00002000:00100000:0.0:1746147172.412486:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463259136 ext(4870144->18446744073709551615) 00002000:00010000:0.0:1746147172.412490:0:8485:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818a80. 00000100:00100000:0.0:1746147172.466231:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10236 00000100:00100000:0.0:1746147172.466243:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+6:28326:x1830967463259776:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147172.466262:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.466279:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4cae expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.466324:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.466337:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.466353:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.466355:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147172.466358:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed800, rc 0) 00000100:00100000:0.0:1746147172.467237:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28326:x1830967463259776:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 994us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.467243:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10236 00000100:00100000:0.0:1746147172.469848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147172.495067:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147172.499741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.499835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.499881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.499922:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463260928 00000100:00100000:0.0:1746147172.499932:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463260928 00000100:00100000:0.0:1746147172.500033:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463261184 00000100:00100000:0.0:1746147172.500038:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463261184 00000100:00100000:0.0:1746147172.500064:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10239 00000100:00100000:0.0:1746147172.500074:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28338:x1830967463260928:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147172.500098:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.500116:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdac3aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4cca expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500208:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.500225:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac3a70 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cbc expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500231:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac3a93 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cb5 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500237:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.500270:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac3a93 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cb5 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500281:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac3a93 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cb5 expref: 8 pid: 14048 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.500292:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466216576:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.500394:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac3a70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cbc expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500404:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac3a70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cbc expref: 303 pid: 14125 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.500412:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466216704:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.500439:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.500473:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10240 00000100:00100000:0.0:1746147172.500482:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28342:x1830967463261184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.500494:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.500503:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095371a00/0xb4b2209fbdac3aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4cd1 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500548:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac3ab6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147172.500558:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac3ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147172.500567:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac3ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147172.500577:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147172.500689:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095371a00/0xb4b2209fbdac3aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cd1 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500725:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac3ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cd1 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.500733:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.500736:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147172.500738:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.500743:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.500748:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095371000, rc 0) 00000100:00100000:0.0:1746147172.500774:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28342:x1830967463261184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 293us (894us total) trans 8589943942 rc 0/0 00000100:00100000:0.0:1746147172.500780:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10240 00000100:00080000:0.0:1746147172.503086:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147172.507864:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac3a93 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cb5 expref: 9 pid: 14048 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.510478:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466216576:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.510523:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac3a70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cbc expref: 303 pid: 14125 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.510541:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa96300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466216704:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.510564:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.510571:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.510576:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147172.510594:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147172.510745:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdac3aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.510758:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.510764:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.510767:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147172.510769:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ece00, rc 0) 00000100:00100000:0.0:1746147172.510849:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28338:x1830967463260928:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10775us (11012us total) trans 8589943943 rc 0/0 00000100:00100000:0.0:1746147172.510861:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10239 00000100:00100000:0.0:1746147172.510978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.517394:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463261952 00000100:00100000:0.0:1746147172.517397:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463261952 00010000:00010000:0.0:1746147172.517410:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 304 pid: 16361 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.517425:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5126 00000100:00100000:0.0:1746147172.517430:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967463261952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147172.517438:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147172.517441:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 304 pid: 16361 timeout: 659 lvb_type: 0 00010000:00010000:0.0:1746147172.517449:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 304 pid: 16361 timeout: 659 lvb_type: 0 00010000:00010000:0.0:1746147172.517460:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3aa8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cca expref: 304 pid: 16361 timeout: 659 lvb_type: 0 00010000:00010000:0.0:1746147172.517469:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.517472:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c2c00/0xb4b2209fbdac3ad9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.517478:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c2c00/0xb4b2209fbdac3ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.517483:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c2c00/0xb4b2209fbdac3ad9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.517499:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147172.517517:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967463261952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.517522:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5126 00000100:00100000:0.0:1746147172.523326:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463262080 00000100:00100000:0.0:1746147172.523335:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463262080 00000100:00100000:0.0:1746147172.523391:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463262208 00000100:00100000:0.0:1746147172.523394:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463262208 00000100:00100000:0.0:1746147172.523410:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10514 00000100:00100000:0.0:1746147172.523417:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+12:28341:x1830967463262080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.523432:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.523447:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac3ae7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ce6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523471:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4714600/0xb4b2209fbdac3a38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c99 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523477:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.523478:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.523482:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac3ae7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ce6 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523512:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4714600/0xb4b2209fbdac3a38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c99 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523522:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4714600/0xb4b2209fbdac3a38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c99 expref: 15 pid: 8480 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.523537:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466217216:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.523598:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.523617:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10515 00000100:00100000:0.0:1746147172.523622:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+5:28342:x1830967463262208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.523630:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.523638:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ced expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523649:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.523650:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.523656:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 6 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523666:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 6 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.523674:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370600, rc 0) 00000100:00100000:0.0:1746147172.523765:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28342:x1830967463262208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 72us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.523772:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10515 00000100:00100000:0.0:1746147172.528882:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466217216:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.528906:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095370e00/0xb4b2209fbdac3ae7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ce6 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.528926:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370e00, rc 0) 00000100:00100000:0.0:1746147172.528992:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+13:28341:x1830967463262080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5575us (5882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.529000:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10514 00000100:00100000:0.0:1746147172.532387:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466217344:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147172.532406:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147172.532453:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463262336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3108us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.532462:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5127 00000100:00100000:0.0:1746147172.539035:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463262592 00000100:00100000:0.0:1746147172.539044:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463262592 00002000:00100000:0.0:1746147172.539081:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41b:0x0] (0->1048575) req@ffff880093d34000 x1830967463262592/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:548/0 lens 488/0 e 0 to 0 dl 1746147183 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.539091:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34000 with x1830967463262592 ext(0->1048575) 00002000:00010000:0.0:1746147172.539100:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34000 00000100:00100000:0.0:1746147172.539613:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463262848 00000100:00100000:0.0:1746147172.539617:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463262848 00002000:00100000:0.0:1746147172.539630:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41b:0x0] (1048576->2097151) req@ffff880093d37b80 x1830967463262848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:548/0 lens 488/0 e 0 to 0 dl 1746147183 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.539637:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463262848 ext(1048576->2097151) 00002000:00010000:0.0:1746147172.539639:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:0.0:1746147172.539659:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3846 00000100:00100000:0.0:1746147172.539664:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1958:x1830967463262848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147172.543188:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463263104 00000100:00100000:0.0:1746147172.543196:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463263104 00000100:00100000:0.0:1746147172.543244:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10243 00000100:00100000:0.0:1746147172.543252:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28337:x1830967463263104:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147172.543269:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.543272:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746147172.543292:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85c2c00/0xb4b2209fbdac3ad9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cd8 expref: 10 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543313:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac3ab6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cd1 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543321:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.543325:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147172.543355:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095370800/0xb4b2209fbdac3af5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4cf4 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543396:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.543407:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543413:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3ae0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cdf expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543419:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 5/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.543446:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cdf expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543454:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cdf expref: 302 pid: 14048 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.543463:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217472:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.543527:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.543533:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.543540:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217600:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.543557:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147172.550969:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3ae0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cdf expref: 302 pid: 14048 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.550985:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217472:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.550995:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac3a54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cae expref: 7 pid: 14125 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.551001:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217600:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.551015:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.551024:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147172.551028:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:02000000:0.0:1746147172.551065:0:16361:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:0.0:1746147172.554431:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2751, 88 off227784 00000004:00080000:0.0:1746147172.554436:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559541498240ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.555234:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off225144 00000004:00080000:0.0:1746147172.555239:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559542301518ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557053:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2722, 88 off225232 00000004:00080000:0.0:1746147172.557062:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544124486ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557085:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2752, 88 off227872 00000004:00080000:0.0:1746147172.557088:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544151068ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557105:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2753, 88 off227960 00000004:00080000:0.0:1746147172.557108:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544170413ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557115:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2723, 88 off225320 00000004:00080000:0.0:1746147172.557117:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544180132ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557124:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2724, 88 off225408 00000004:00080000:0.0:1746147172.557126:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544188601ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557132:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2725, 88 off225496 00000004:00080000:0.0:1746147172.557135:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544197368ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557141:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2754, 88 off228048 00000004:00080000:0.0:1746147172.557144:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544206462ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557150:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2726, 88 off225584 00000004:00080000:0.0:1746147172.557152:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544214849ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557158:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2755, 88 off228136 00000004:00080000:0.0:1746147172.557160:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544222936ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557167:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2727, 88 off225672 00000004:00080000:0.0:1746147172.557169:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544231892ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147172.557175:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2756, 88 off228224 00000004:00080000:0.0:1746147172.557178:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544240569ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557185:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2757, 88 off228312 00000004:00080000:0.0:1746147172.557187:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544250252ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557195:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2758, 88 off228400 00000004:00080000:0.0:1746147172.557197:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544260254ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557203:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2759, 88 off228488 00000004:00080000:0.0:1746147172.557205:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559544268279ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147172.557211:0:16361:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2728, 88 off225760 00000004:00080000:0.0:1746147172.557213:0:16361:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559544276169ns, next at 537465048041ns, rc = 0 00000100:00100000:0.0:1746147172.564439:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3850 00000100:00100000:0.0:1746147172.564446:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463264512:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147172.584599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.584660:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463264640 00000100:00100000:0.0:1746147172.584668:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463264640 00000100:00100000:0.0:1746147172.584729:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10516 00000100:00100000:0.0:1746147172.584738:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28342:x1830967463264640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.584754:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.584768:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f09a00/0xb4b2209fbdac3b0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4d02 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.584797:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c6f expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.584804:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.584806:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147172.584809:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f09a00/0xb4b2209fbdac3b0a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d02 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.584835:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c6f expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.584846:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53cac00/0xb4b2209fbdac3a00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c6f expref: 13 pid: 8478 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.584857:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466217728:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.584920:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.586190:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463263744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 23438us (23580us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147172.586198:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3848 00002000:00100000:0.0:1746147172.586206:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x417:0x0] (0->1048575) req@ffff8800a5ba2680 x1830967463263744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:548/0 lens 488/440 e 0 to 0 dl 1746147183 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.586213:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2680 with x1830967463263744 ext(0->1048575) 00002000:00010000:0.0:1746147172.586217:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba2680 00000100:00100000:0.0:1746147172.592668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.599277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.599371:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967463264512:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 34923us (35851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147172.599384:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3850 00002000:00100000:0.0:1746147172.599400:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x417:0x0] (3145728->4194303) req@ffff880090743800 x1830967463264512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:548/0 lens 488/440 e 0 to 0 dl 1746147183 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.599408:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743800 with x1830967463264512 ext(3145728->4194303) 00002000:00010000:0.0:1746147172.599414:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090743800 00010000:00010000:0.0:1746147172.602494:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cf4 expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602504:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147172.602506:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147172.602509:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac3b03 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cfb expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602516:0:16361:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac3b03 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cfb expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602521:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac3b03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cfb expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602527:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac3b11 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d09 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602533:0:16361:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac3b11 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d09 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602538:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac3b11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d09 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.602565:0:16361:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac3b11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d09 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147172.602575:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217984:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147172.602629:0:16361:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac3b03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cfb expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147172.602636:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466218112:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147172.602651:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.602832:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466218240 00000100:00100000:0.0:1746147172.602836:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466218240 00000100:00100000:0.0:1746147172.602853:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466218752 00000100:00100000:0.0:1746147172.602855:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466218752 00000100:00100000:0.0:1746147172.602865:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10517 00000100:00100000:0.0:1746147172.602870:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1830967466218240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147172.603010:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147172.603013:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147172.603015:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147168 -> 1746147168 00002000:00010000:0.0:1746147172.603016:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147172.603018:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2041 -> 2041 00000100:00100000:0.0:1746147172.603039:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466218240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (227us total) trans 21474840389 rc 0/0 00000100:00100000:0.0:1746147172.603047:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10517 00000100:00100000:0.0:1746147172.603055:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10519 00000100:00100000:0.0:1746147172.603059:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466218368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147172.603080:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10520 00000100:00100000:0.0:1746147172.603083:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466218880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147172.603134:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147172.603135:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.603137:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.603139:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.603140:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147172.603153:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466218880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (270us total) trans 21474840391 rc 0/0 00000100:00100000:0.0:1746147172.603157:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10520 00000100:00100000:0.0:1746147172.603165:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10522 00000100:00100000:0.0:1746147172.603169:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466219008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147172.603188:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10523 00000100:00100000:0.0:1746147172.603192:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466218624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147172.603244:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147172.603246:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603248:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.603249:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603251:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147172.603265:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967466218624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (302us total) trans 21474840393 rc 0/0 00000100:00100000:0.0:1746147172.603269:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10523 00000100:00100000:0.0:1746147172.603275:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466219776 00000100:00100000:0.0:1746147172.603277:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466219776 00000100:00100000:0.0:1746147172.603287:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10525 00000100:00100000:0.0:1746147172.603291:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466219392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147172.603357:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147172.603359:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147172.603361:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147172.603362:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147172.603364:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147172.603381:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466219392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (194us total) trans 17179873005 rc 0/0 00000100:00100000:0.0:1746147172.603385:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10525 00000100:00100000:0.0:1746147172.603395:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10528 00000100:00100000:0.0:1746147172.603399:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466219776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147172.603449:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147172.603451:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603452:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.603454:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603455:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147172.603469:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466219776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (216us total) trans 17179873008 rc 0/0 00000100:00100000:0.0:1746147172.603474:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10528 00000100:00100000:0.0:1746147172.603479:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466220160 00000100:00100000:0.0:1746147172.603481:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466220160 00000100:00100000:0.0:1746147172.603487:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466220032 00000100:00100000:0.0:1746147172.603488:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466220032 00000100:00100000:0.0:1746147172.603494:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10530 00000100:00100000:0.0:1746147172.603497:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466220160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147172.603528:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10531 00000100:00100000:0.0:1746147172.603533:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466219520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147172.603604:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147172.603606:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147168 -> 1746147168 00002000:00010000:0.0:1746147172.603608:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147172.603609:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147168 -> 1746147168 00002000:00010000:0.0:1746147172.603611:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147172.603627:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466218368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 568us (762us total) trans 21474840395 rc 0/0 00000100:00100000:0.0:1746147172.603632:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10519 00002000:00010000:0.0:1746147172.603687:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147172.603689:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603691:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.603692:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147172.603694:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147172.603726:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967466219008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 556us (800us total) trans 21474840397 rc 0/0 00000100:00100000:0.0:1746147172.603730:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10522 00002000:00010000:0.0:1746147172.603774:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147172.603776:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.603778:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147172.603779:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147172.603781:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147172.603799:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466220160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (355us total) trans 17179873011 rc 0/0 00000100:00100000:0.0:1746147172.603803:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10530 00002000:00010000:0.0:1746147172.603919:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147172.603921:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147172.603923:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147172.603924:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147172.603926:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147172.603959:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466219520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 426us (494us total) trans 17179873012 rc 0/0 00000100:00100000:0.0:1746147172.603964:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10531 00000100:00100000:0.0:1746147172.605390:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466217984:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147172.605397:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466218112:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147172.605422:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095370800/0xb4b2209fbdac3af5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cf4 expref: 9 pid: 16361 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147172.605434:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac3afc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cf4 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.605453:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ece00, rc 0) 00000100:00100000:0.0:1746147172.605480:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28337:x1830967463263104:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 62229us (62973us total) trans 8589943944 rc 0/0 00000100:00100000:0.0:1746147172.605485:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10243 00000100:00100000:0.0:1746147172.605505:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3998 00000100:00100000:0.0:1746147172.605510:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28338:x1830967463265152:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:0.0:1746147172.605562:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28338:x1830967463265152:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.605568:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3998 00000100:00100000:0.0:1746147172.606549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.618333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.618375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.627449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.630725:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463266176 00000100:00100000:0.0:1746147172.630729:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463266176 00000100:00100000:0.0:1746147172.630749:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10537 00000100:00100000:0.0:1746147172.630754:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+13:28341:x1830967463266176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.630763:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.630772:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4d25 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.630785:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.630787:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.630793:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d25 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.630804:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d25 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.630812:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8d400, rc 0) 00000100:00100000:0.0:1746147172.630829:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:28341:x1830967463266176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.630834:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10537 00000100:00100000:0.0:1746147172.649128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.653371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.665271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.665317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.683755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.694684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.694741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.694769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.694786:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463268608 00000100:00100000:0.0:1746147172.694790:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463268608 00000100:00100000:0.0:1746147172.694818:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10540 00000100:00100000:0.0:1746147172.694825:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:28338:x1830967463268480:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147172.694839:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.694850:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3b49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4d3a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.694871:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.694878:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d25 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.694883:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.694884:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.694886:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3b49 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4583423] (req 4194304->4583423) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d3a expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.694909:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d25 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.694919:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d400/0xb4b2209fbdac3b2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d25 expref: 15 pid: 4445 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.694934:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466221056:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.695002:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.695010:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 14 pid: 6881 timeout: 659 lvb_type: 1 00000100:00100000:0.0:1746147172.695016:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466221184:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.695031:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.697394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.697616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.697673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.698507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.698731:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466221056:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.698742:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466221184:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.698762:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac3b49 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4583423] (req 4194304->4583423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d3a expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.698774:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8d200, rc 0) 00000100:00100000:0.0:1746147172.698807:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28338:x1830967463268480:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3983us (4131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.698813:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10540 00002000:00010000:0.0:1746147172.700316:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147169 -> 1746147172 00000100:00100000:0.0:1746147172.700333:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466221312:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147172.700353:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00be00/0xb4b2209fbdac3b5e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d56 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.700363:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00be00/0xb4b2209fbdac3b5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d56 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.700377:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00be00, rc 0) 00000100:00100000:0.0:1746147172.700406:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463268992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5131us (5245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147172.700412:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10544 00000100:00100000:0.0:1746147172.700436:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463269888 00000100:00100000:0.0:1746147172.700441:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463269888 00010000:00010000:0.0:1746147172.700459:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 15 pid: 6881 timeout: 659 lvb_type: 1 00000100:00100000:0.0:1746147172.700476:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5133 00000100:00100000:0.0:1746147172.700481:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463269888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147172.700495:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147172.700505:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 15 pid: 6881 timeout: 659 lvb_type: 1 00010000:00010000:0.0:1746147172.700513:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 15 pid: 6881 timeout: 659 lvb_type: 1 00010000:00010000:0.0:1746147172.700528:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa0dc00/0xb4b2209fbdac3920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c5a expref: 15 pid: 6881 timeout: 659 lvb_type: 1 00010000:00010000:0.0:1746147172.700538:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147172.700553:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463269888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.700558:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5133 00000100:00100000:0.0:1746147172.717905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.726870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.727396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.732866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.732912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.732989:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463271040 00000100:00100000:0.0:1746147172.732992:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463271040 00002000:00100000:0.0:1746147172.733010:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4579328->4583423) req@ffff88009e681180 x1830967463271040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:548/0 lens 488/0 e 0 to 0 dl 1746147183 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.733017:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681180 with x1830967463271040 ext(4579328->4583423) 00002000:00010000:0.0:1746147172.733021:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681180 00000100:00100000:0.0:1746147172.733336:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3858 00000100:00100000:0.0:1746147172.733343:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463271040:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147172.734135:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463271040:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 790us (1221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147172.734142:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3858 00002000:00100000:0.0:1746147172.734148:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4579328->4583423) req@ffff88009e681180 x1830967463271040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:548/0 lens 488/4536 e 0 to 0 dl 1746147183 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147172.734156:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681180 with x1830967463271040 ext(4579328->4583423) 00002000:00010000:0.0:1746147172.734160:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681180 00000100:00100000:0.0:1746147172.740301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.740771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.758018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.758043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.758067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.758088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.758103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.760587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.760734:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10550 00000100:00100000:0.0:1746147172.760741:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463272448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.760747:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.760756:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7547c00/0xb4b2209fbdac3b81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4d87 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.760767:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.760769:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.760773:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7547c00/0xb4b2209fbdac3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d87 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.760782:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7547c00/0xb4b2209fbdac3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d87 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.760789:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7547c00, rc 0) 00000100:00100000:0.0:1746147172.761182:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463272448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 441us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.761187:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10550 00000100:00100000:0.0:1746147172.761203:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10553 00000100:00100000:0.0:1746147172.761207:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463272576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.761213:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.761219:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7547800/0xb4b2209fbdac3b9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4d8e expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147172.761239:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466221696:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147172.761262:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.782101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.787289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.790892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.795000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.795413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.814852:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463274368 00000100:00100000:0.0:1746147172.814861:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463274368 00000100:00100000:0.0:1746147172.815280:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4002 00000100:00100000:0.0:1746147172.815288:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28341:x1830967463274368:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147172.815487:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28341:x1830967463274368:12345-192.168.203.36@tcp:35:cat.0 Request processed in 198us (723us total) trans 8589943947 rc 0/0 00000100:00100000:0.0:1746147172.815494:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4002 00000100:00100000:0.0:1746147172.819318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.830425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.838033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.863282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.905728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.945134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.945176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.945211:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463276288 00000100:00100000:0.0:1746147172.945220:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463276288 00000100:00100000:0.0:1746147172.945267:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10561 00000100:00100000:0.0:1746147172.945275:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28348:x1830967463276288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147172.945294:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.945900:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab2200/0xb4b2209fbdac3c30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4de2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945920:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0600/0xb4b2209fbdac3b65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d5d expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945927:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac3b6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d64 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945933:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdac3bce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4dc6 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945954:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147172.945955:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147172.945959:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab2200/0xb4b2209fbdac3c30 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2199552->2883583] (req 2199552->2883583) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4de2 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945984:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdac3bce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4dc6 expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.945994:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b485ac00/0xb4b2209fbdac3bce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4dc6 expref: 8 pid: 21080 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.946008:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466222848:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.946071:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac3b6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d64 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.946077:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac3b6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d64 expref: 19 pid: 4445 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.946084:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466222976:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.946103:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0600/0xb4b2209fbdac3b65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d5d expref: 8 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.946109:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0600/0xb4b2209fbdac3b65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d5d expref: 8 pid: 21080 timeout: 659 lvb_type: 0 00000100:00100000:0.0:1746147172.946115:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466223104:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.946126:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147172.949319:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466222848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.949331:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466222976:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147172.949338:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466223104:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147172.949362:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab2200/0xb4b2209fbdac3c30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2199552->2883583] (req 2199552->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4de2 expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.949382:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab2200, rc 0) 00000100:00100000:0.0:1746147172.949759:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28348:x1830967463276288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4483us (4580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147172.949767:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10561 00000100:00100000:0.0:1746147172.949791:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463276416 00000100:00100000:0.0:1746147172.949796:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463276416 00000100:00100000:0.0:1746147172.950047:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10562 00000100:00100000:0.0:1746147172.950055:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463276416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147172.950066:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147172.950076:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab3200/0xb4b2209fbdac3c37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4de9 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147172.950091:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147172.950098:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab3200/0xb4b2209fbdac3c37 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4de9 expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.950106:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab3200/0xb4b2209fbdac3c37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4de9 expref: 20 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147172.950117:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab3200, rc 0) 00000100:00100000:0.0:1746147172.950138:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463276416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 85us (528us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147172.950143:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10562 00000100:00100000:0.0:1746147172.953000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.957485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.962934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147172.964209:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3868 00000100:00100000:0.0:1746147172.964216:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463277824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.021448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.042078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.042251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147173.042293:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147173.054863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.054906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147173.055100:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147173.065930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.068782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.068824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.077691:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1956:x1830967463279232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22588us (22827us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147173.077769:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3871 00002000:00100000:0.0:1746147173.077781:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800929f7b80 x1830967463279232/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.077790:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7b80 with x1830967463279232 ext(0->1048575) 00002000:00010000:0.0:1746147173.077796:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7b80 00000100:00100000:0.0:1746147173.097492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.101950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.106654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.106712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.109042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.111201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.141951:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466224256 00000100:00100000:0.0:1746147173.141958:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466224256 00000100:00100000:0.0:1746147173.141990:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466224768 00000100:00100000:0.0:1746147173.141993:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466224768 00000100:00100000:0.0:1746147173.142003:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466225280 00000100:00100000:0.0:1746147173.142004:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466225280 00000100:00100000:0.0:1746147173.142017:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10564 00000100:00100000:0.0:1746147173.142023:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967466224256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.142175:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147173.142178:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.142180:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147168 -> 1746147168 00002000:00010000:0.0:1746147173.142182:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.142184:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2041 -> 2041 00000100:00100000:0.0:1746147173.142210:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1830967466224256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (615us total) trans 21474840399 rc 0/0 00000100:00100000:0.0:1746147173.142216:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10564 00000100:00100000:0.0:1746147173.142230:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10565 00000100:00100000:0.0:1746147173.142234:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1830967466224768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.142294:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147173.142296:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.142298:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.142299:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.142301:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147173.142318:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1830967466224768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (690us total) trans 21474840400 rc 0/0 00000100:00100000:0.0:1746147173.142323:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10565 00000100:00100000:0.0:1746147173.142331:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10566 00000100:00100000:0.0:1746147173.142336:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466225280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.142416:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147173.142418:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147173.142420:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147165 -> 1746147165 00002000:00010000:0.0:1746147173.142422:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147167 -> 1746147167 00002000:00010000:0.0:1746147173.142423:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147173.142441:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967466225280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (673us total) trans 17179873015 rc 0/0 00000100:00100000:0.0:1746147173.142445:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10566 00000100:00100000:0.0:1746147173.143635:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466224128 00000100:00100000:0.0:1746147173.143639:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466224128 00000100:00100000:0.0:1746147173.144723:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10580 00000100:00100000:0.0:1746147173.144729:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466224128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.144840:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147173.144843:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.144844:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.144846:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.144848:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147173.144872:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466224128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (1274us total) trans 17179873022 rc 0/0 00000100:00100000:0.0:1746147173.144877:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10580 00000100:00100000:0.0:1746147173.146051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.149899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.151363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.154642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.165765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.169323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.169368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.172078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.177239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.207074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.207093:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463283712 00000100:00100000:0.0:1746147173.207101:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463283712 00002000:00100000:0.0:1746147173.207138:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800929f5f80 x1830967463283712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 504/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.207147:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5f80 with x1830967463283712 ext(1048576->2097151) 00002000:00010000:0.0:1746147173.207151:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5f80 00000100:00100000:0.0:1746147173.207166:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3882 00000100:00100000:0.0:1746147173.207173:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463283712:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147173.261514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.261825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.266397:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463284352 00000100:00100000:0.0:1746147173.266403:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463284352 00000100:00100000:0.0:1746147173.266440:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4008 00000100:00100000:0.0:1746147173.266446:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28351:x1830967463284352:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147173.266673:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28351:x1830967463284352:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 227us (883us total) trans 8589943955 rc 0/0 00000100:00100000:0.0:1746147173.266679:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4008 00000100:00100000:0.0:1746147173.269436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.275574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.308657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.308715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.310473:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.318814:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466227584:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147173.318839:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f661c00/0xb4b2209fbdac3cd8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e44 expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.318849:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f661c00/0xb4b2209fbdac3cd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e44 expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.318858:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661c00, rc 0) 00000100:00100000:0.0:1746147173.318874:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463285760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9805us (10219us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147173.318879:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10586 00000100:00100000:0.0:1746147173.320343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.320366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.320386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.320417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.322528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.329228:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466227968:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147173.329246:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac3ce6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e59 expref: 8 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.329258:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1600, rc 0) 00000100:00100000:0.0:1746147173.329282:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28358:x1830967463286400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7424us (8940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.329288:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10588 00000100:00100000:0.0:1746147173.334217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.334292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.355502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.355532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.356272:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466228352:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147173.356286:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147173.356317:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463287552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 21731us (22025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.356326:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5148 00000100:00100000:0.0:1746147173.356348:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463287936 00000100:00100000:0.0:1746147173.356353:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463287936 00010000:00010000:0.0:1746147173.356374:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac3cca lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e36 expref: 9 pid: 14125 timeout: 660 lvb_type: 0 00000100:00100000:0.0:1746147173.358923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.358983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.359232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.359263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.359288:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463288576 00000100:00100000:0.0:1746147173.359291:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463288576 00002000:00100000:0.0:1746147173.359312:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a4fad880 x1830967463288576/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.359320:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad880 with x1830967463288576 ext(2097152->3145727) 00002000:00010000:0.0:1746147173.359324:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad880 00000100:00100000:0.0:1746147173.359346:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3887 00000100:00100000:0.0:1746147173.359350:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463288704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.375581:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463288704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16222us (16342us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147173.375595:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3887 00002000:00100000:0.0:1746147173.375605:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a4fadc00 x1830967463288704/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.375613:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967463288704 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.375617:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:0.0:1746147173.386480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.386566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.386607:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463289216 00000100:00100000:0.0:1746147173.386616:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463289216 00000100:00100000:0.0:1746147173.386661:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463289344 00000100:00100000:0.0:1746147173.386664:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463289344 00000100:00100000:0.0:1746147173.386680:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10592 00000100:00100000:0.0:1746147173.386687:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463289216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147173.386713:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.386727:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f661800/0xb4b2209fbdac3d25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4e7c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.386773:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466228864:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147173.386843:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.386861:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10593 00000100:00100000:0.0:1746147173.386867:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463289344:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147173.386874:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.386882:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4e83 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.386897:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.386899:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.386906:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e83 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.386919:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e83 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.386927:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661000, rc 0) 00000100:00100000:0.0:1746147173.386969:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463289344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 102us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.386975:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10593 00000100:00100000:0.0:1746147173.389325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.391870:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466228992:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147173.391886:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4aee00/0xb4b2209fbdac3d33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e8a expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.391896:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4aee00/0xb4b2209fbdac3d33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e8a expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.391907:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4aee00, rc 0) 00000100:00100000:0.0:1746147173.391927:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463289472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2506us (2607us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147173.391932:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10594 00000100:00100000:0.0:1746147173.397797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.400358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402105:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.402201:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463290496 00000100:00100000:0.0:1746147173.402205:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463290496 00000100:00100000:0.0:1746147173.402223:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10596 00000100:00100000:0.0:1746147173.402929:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463289984:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147173.402959:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdac3d72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.402969:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c3e expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.402976:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac3b96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d72 expref: 18 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.402981:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360800/0xb4b2209fbdac3b42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d41 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.402985:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.402986:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.402988:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f660e00/0xb4b2209fbdac3d72 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.403000:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360800/0xb4b2209fbdac3b42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d41 expref: 7 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.403008:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f360800/0xb4b2209fbdac3b42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d41 expref: 7 pid: 8481 timeout: 660 lvb_type: 1 00000100:00100000:0.0:1746147173.403015:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466230400:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147173.403036:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac3b96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d72 expref: 18 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.403042:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac3b96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4d72 expref: 18 pid: 11147 timeout: 660 lvb_type: 1 00000100:00100000:0.0:1746147173.403049:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466230528:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147173.403065:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c3e expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.403071:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab3000/0xb4b2209fbdac390b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c3e expref: 17 pid: 8480 timeout: 660 lvb_type: 1 00000100:00100000:0.0:1746147173.403076:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466230656:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147173.403085:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.403106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.408793:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466229120:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147173.408815:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac3d4f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e98 expref: 13 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.408830:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e2a00, rc 0) 00000100:00100000:0.0:1746147173.408864:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28358:x1830967463289856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8151us (8509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.408871:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10595 00000100:00100000:0.0:1746147173.409362:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466229632:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147173.409375:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.409514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.409547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.411042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.411075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.413606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.414292:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5160 00000100:00100000:0.0:1746147173.414299:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463291264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147173.414307:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147173.414317:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e83 expref: 16 pid: 8481 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.414330:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e83 expref: 16 pid: 8481 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.414340:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e83 expref: 16 pid: 8481 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.414351:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147173.414366:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463291264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.414370:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5160 00010000:00010000:0.0:1746147173.414617:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414624:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414636:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414641:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414646:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414651:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136760c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147173.414654:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414659:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414667:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.414671:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136760c00/0xb4b2209fbdac3d5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.414708:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463290112:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 12325us (12538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.414713:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10598 00000100:00100000:0.0:1746147173.417531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.418345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.418362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.425863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.443485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.461591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.461625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.461655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.461667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.461685:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293184 00000100:00100000:0.0:1746147173.461701:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293184 00000100:00100000:0.0:1746147173.461750:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293312 00000100:00100000:0.0:1746147173.461753:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293312 00000100:00100000:0.0:1746147173.461765:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293440 00000100:00100000:0.0:1746147173.461767:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293440 00000100:00100000:0.0:1746147173.461774:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293568 00000100:00100000:0.0:1746147173.461775:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293568 00000100:00100000:0.0:1746147173.461786:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10602 00000100:00100000:0.0:1746147173.461792:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1957:x1830967463293184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.461807:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.461823:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f661600/0xb4b2209fbdac3d80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4e9f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147173.461842:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141761, atime: 0x68141760, ctime: 0x68141761, blocks: 0x7f9 00010000:00010000:0.0:1746147173.461858:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.461860:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.461866:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661600/0xb4b2209fbdac3d80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e9f expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.461879:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f661600/0xb4b2209fbdac3d80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e9f expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.461888:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661600, rc 0) 00000100:00100000:0.0:1746147173.461925:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463293184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.461931:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10602 00000100:00100000:0.0:1746147173.461968:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10603 00000100:00100000:0.0:1746147173.461973:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463293312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.461979:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.461988:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f660e00/0xb4b2209fbdac3d87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ea6 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147173.461999:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x68141761, atime: 0x68141761, ctime: 0x68141761, blocks: 0x81d 00010000:00010000:0.0:1746147173.462007:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462009:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462013:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f660e00/0xb4b2209fbdac3d87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ea6 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462020:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f660e00/0xb4b2209fbdac3d87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ea6 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462026:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f660e00, rc 0) 00000100:00100000:0.0:1746147173.462040:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463293312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 67us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.462045:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10603 00000100:00100000:0.0:1746147173.462054:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10604 00000100:00100000:0.0:1746147173.462058:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463293440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.462063:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.462069:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ead expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147173.462078:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141765, atime: 0x68141765, ctime: 0x68141765, blocks: 0x821 00010000:00010000:0.0:1746147173.462085:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462086:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462089:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ead expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462100:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ead expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462105:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f660800, rc 0) 00000100:00100000:0.0:1746147173.462121:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463293440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.462125:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10604 00000100:00100000:0.0:1746147173.462134:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10605 00000100:00100000:0.0:1746147173.462137:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1957:x1830967463293568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.462142:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.462148:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4eb4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147173.462157:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141760, atime: 0x6814175f, ctime: 0x68141760, blocks: 0x81f 00010000:00010000:0.0:1746147173.462163:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462164:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462167:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462173:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 7 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462178:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661e00, rc 0) 00000100:00100000:0.0:1746147173.462191:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463293568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.462197:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10605 00000100:00100000:0.0:1746147173.462223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.462236:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293696 00000100:00100000:0.0:1746147173.462238:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293696 00000100:00100000:0.0:1746147173.462250:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10606 00000100:00100000:0.0:1746147173.462254:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463293696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.462259:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.462265:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ebb expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147173.462275:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4870144, mtime: 0x68141764, atime: 0x68141764, ctime: 0x68141764, blocks: 0x156b 00010000:00010000:0.0:1746147173.462282:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462283:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462287:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ebb expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462294:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f661000/0xb4b2209fbdac3d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ebb expref: 8 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462300:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661000, rc 0) 00000100:00100000:0.0:1746147173.462312:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463293696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.462316:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10606 00000100:00100000:0.0:1746147173.462359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.462368:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293824 00000100:00100000:0.0:1746147173.462370:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293824 00000100:00100000:0.0:1746147173.462381:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10607 00000100:00100000:0.0:1746147173.462385:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463293824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.462390:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.462395:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f661800/0xb4b2209fbdac3da3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ec2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.462403:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462410:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f661800/0xb4b2209fbdac3da3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ec2 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462417:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f661800/0xb4b2209fbdac3da3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ec2 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.462428:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661800, rc 0) 00000100:00100000:0.0:1746147173.462439:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463293824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (81us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147173.462444:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10607 00000100:00100000:0.0:1746147173.462531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.462545:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463293952 00000100:00100000:0.0:1746147173.462547:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463293952 00010000:00010000:0.0:1746147173.462560:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac3d4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e98 expref: 14 pid: 21080 timeout: 660 lvb_type: 0 00000100:00100000:0.0:1746147173.462574:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5167 00000100:00100000:0.0:1746147173.462578:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463293952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147173.462585:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147173.462595:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac3d4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e98 expref: 14 pid: 21080 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.462603:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac3d4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e98 expref: 14 pid: 21080 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.462614:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e2a00/0xb4b2209fbdac3d4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e98 expref: 14 pid: 21080 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.462622:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462623:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.462626:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.462632:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.462648:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147173.462662:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463293952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.462667:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5167 00010000:00010000:0.0:1746147173.462745:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.462753:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.462770:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464164:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464172:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464177:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b077400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147173.464180:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464187:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464197:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.464201:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b077400/0xb4b2209fbdac3d79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.466306:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463290624:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 63112us (63191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.466315:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10601 00000100:00100000:0.0:1746147173.468491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.474467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.476663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.476730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.488509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.488534:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463294976 00000100:00100000:0.0:1746147173.488542:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463294976 00000100:00100000:0.0:1746147173.488577:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10259 00000100:00100000:0.0:1746147173.488584:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28358:x1830967463294976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.488602:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.488616:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3db1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ec9 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.488657:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac3daa lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.488663:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3db1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ec9 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.488675:0:14048:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac3daa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.488683:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3db1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ec9 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.488691:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.488703:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147173.488706:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3db1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ec9 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.488711:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540800, rc 0) 00000100:00100000:0.0:1746147173.488744:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28358:x1830967463294976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 160us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.488749:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10259 00000100:00100000:0.0:1746147173.498781:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463295232 00000100:00100000:0.0:1746147173.498790:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463295232 00000100:00100000:0.0:1746147173.499236:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10260 00000100:00100000:0.0:1746147173.499244:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28367:x1830967463295232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147173.499260:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.499273:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660200/0xb4b2209fbdac3db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ed0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.499346:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661800/0xb4b2209fbdac3dbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.499357:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661800/0xb4b2209fbdac3dbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.499365:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661800/0xb4b2209fbdac3dbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.499375:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660000/0xb4b2209fbdac3dc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.499380:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660000/0xb4b2209fbdac3dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.499385:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f660000/0xb4b2209fbdac3dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147173.511119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.514274:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466232960 00000100:00100000:0.0:1746147173.514278:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466232960 00000100:00100000:0.0:1746147173.514299:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466233472 00000100:00100000:0.0:1746147173.514300:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466233472 00000100:00100000:0.0:1746147173.514308:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10623 00000100:00100000:0.0:1746147173.514311:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466232960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.514387:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147173.514389:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.514391:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147168 -> 1746147168 00002000:00010000:0.0:1746147173.514392:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147169 -> 1746147169 00002000:00010000:0.0:1746147173.514394:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2041 -> 2041 00000100:00100000:0.0:1746147173.514417:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967466232960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (771us total) trans 21474840416 rc 0/0 00000100:00100000:0.0:1746147173.514421:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10623 00000100:00100000:0.0:1746147173.514512:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10624 00000100:00100000:0.0:1746147173.514516:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466233472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.514579:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147173.514581:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.514583:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.514584:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.514586:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147173.514603:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3295:x1830967466233472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (923us total) trans 21474840417 rc 0/0 00000100:00100000:0.0:1746147173.514607:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10624 00000100:00100000:0.0:1746147173.514723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.514781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.514795:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463295616 00000100:00100000:0.0:1746147173.514798:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463295616 00000100:00100000:0.0:1746147173.514815:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4011 00000100:00100000:0.0:1746147173.514819:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28358:x1830967463295616:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147173.514867:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28358:x1830967463295616:12345-192.168.203.36@tcp:49:cat.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.514873:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4011 00000100:00100000:0.0:1746147173.514905:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830967466232832:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147173.514916:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac3daa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.514923:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac3daa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147173.518648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.531016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.531048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.531771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.540653:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463296896 00000100:00100000:0.0:1746147173.540665:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463296896 00000100:00100000:0.0:1746147173.540734:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4014 00000100:00100000:0.0:1746147173.540742:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28358:x1830967463296896:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147173.541014:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28358:x1830967463296896:12345-192.168.203.36@tcp:35:cat.0 Request processed in 271us (640us total) trans 8589943965 rc 0/0 00000100:00100000:0.0:1746147173.541022:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4014 00000100:00100000:0.0:1746147173.571266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147173.572038:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572046:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572053:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147173.572093:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147173.572181:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572187:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572192:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572197:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b385800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147173.572200:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572204:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572212:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.572215:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147173.572218:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572222:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac3e0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572231:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572236:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572240:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572247:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e99f800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147173.572249:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572253:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572258:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147173.572260:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147173.572261:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572266:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f800/0xb4b2209fbdac3dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572272:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572276:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572280:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572284:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e99f000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147173.572286:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572290:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572295:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f5da700) 00010000:00010000:0.0:1746147173.572296:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147173.572299:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572303:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f000/0xb4b2209fbdac3e05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.572330:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac3df7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eec expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.572336:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac3df7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eec expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.572343:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99fa00, rc 0) 00000100:00100000:0.0:1746147173.572381:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28372:x1830967463297152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 699us (1121us total) trans 8589943967 rc 301/301 00000100:00100000:0.0:1746147173.572387:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10263 00000100:00100000:0.0:1746147173.576093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.576131:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463297280 00000100:00100000:0.0:1746147173.576138:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463297280 00000100:00100000:0.0:1746147173.576845:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10264 00000100:00100000:0.0:1746147173.576855:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28372:x1830967463297280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.576985:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.577004:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3e1a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ef3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.577083:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.577094:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac3df0 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.577104:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.577121:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac3df0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.577133:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.583663:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.583671:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147173.583716:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147173.583720:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147173.583732:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.583758:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac3e1a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ef3 expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.583771:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ef3 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.583777:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.583779:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147173.583782:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541800, rc 0) 00000100:00100000:0.0:1746147173.583814:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28372:x1830967463297280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6962us (7730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.583822:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10264 00000100:00100000:0.0:1746147173.585372:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466235136 00000100:00100000:0.0:1746147173.585375:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466235136 00000100:00100000:0.0:1746147173.585386:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466235648 00000100:00100000:0.0:1746147173.585388:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466235648 00000100:00100000:0.0:1746147173.585393:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466236160 00000100:00100000:0.0:1746147173.585395:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466236160 00000100:00100000:0.0:1746147173.585400:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466234752 00000100:00100000:0.0:1746147173.585401:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466234752 00000100:00100000:0.0:1746147173.585408:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10632 00000100:00100000:0.0:1746147173.585418:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3293:x1830967466235008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147173.585478:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466235776 00000100:00100000:0.0:1746147173.585481:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466235776 00000100:00100000:0.0:1746147173.585492:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10633 00000100:00100000:0.0:1746147173.585495:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3293:x1830967466235520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.585808:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147173.585810:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.585812:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.585813:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.585815:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147173.585834:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3293:x1830967466235520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 338us (843us total) trans 17179873038 rc 0/0 00000100:00100000:0.0:1746147173.585839:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10633 00000100:00100000:0.0:1746147173.585849:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10637 00000100:00100000:0.0:1746147173.585853:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830967466236160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.585914:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147173.585917:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.585919:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.585920:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.585922:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8261 -> 8261 00000100:00100000:0.0:1746147173.585954:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967466236160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (598us total) trans 21474840422 rc 0/0 00000100:00100000:0.0:1746147173.585959:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10637 00000100:00100000:0.0:1746147173.585969:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10638 00000100:00100000:0.0:1746147173.585973:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830967466234752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.586033:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147173.586035:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.586037:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.586038:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.586040:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147173.586057:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967466234752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (677us total) trans 21474840423 rc 0/0 00000100:00100000:0.0:1746147173.586062:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10638 00000100:00100000:0.0:1746147173.586070:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10639 00000100:00100000:0.0:1746147173.586074:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3295:x1830967466235264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.586134:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147173.586137:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.586138:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.586139:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.586141:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147173.586158:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3295:x1830967466235264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (747us total) trans 17179873039 rc 0/0 00000100:00100000:0.0:1746147173.586163:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10639 00000100:00100000:0.0:1746147173.586172:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10641 00000100:00100000:0.0:1746147173.586176:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830967466236288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.586238:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147173.586240:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.586242:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.586244:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.586245:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147173.586262:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3295:x1830967466236288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (812us total) trans 21474840425 rc 0/0 00000100:00100000:0.0:1746147173.586266:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10641 00002000:00010000:0.0:1746147173.586301:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147173.586302:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147173 -> 1746147173 00002000:00010000:0.0:1746147173.586304:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147173 -> 1746147173 00002000:00010000:0.0:1746147173.586306:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147173 -> 1746147173 00002000:00010000:0.0:1746147173.586307:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147173.586321:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830967466235008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 904us (2187us total) trans 17179873040 rc 0/0 00000100:00100000:0.0:1746147173.586325:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10632 00000100:00100000:0.0:1746147173.587254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.587322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.587353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.587369:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463297408 00000100:00100000:0.0:1746147173.587372:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463297408 00000100:00100000:0.0:1746147173.587389:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463297664 00000100:00100000:0.0:1746147173.587390:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463297664 00000100:00100000:0.0:1746147173.587400:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10265 00000100:00100000:0.0:1746147173.587404:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28372:x1830967463297408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.587415:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.587427:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136760c00/0xb4b2209fbdac3e28 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4efa expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.587460:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136760c00/0xb4b2209fbdac3e28 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4efa expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.587471:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136760c00/0xb4b2209fbdac3e28 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4efa expref: 304 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.587485:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.587488:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147173.587490:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136760c00, rc 0) 00000100:00100000:0.0:1746147173.587515:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28372:x1830967463297408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.587520:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10265 00000100:00100000:0.0:1746147173.587530:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10266 00000100:00100000:0.0:1746147173.587533:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28374:x1830967463297664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147173.587539:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.587545:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136760a00/0xb4b2209fbdac3e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f01 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.587599:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587605:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587611:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587620:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587624:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587628:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587691:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5349000/0xb4b2209fbdac3e4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587705:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5349000/0xb4b2209fbdac3e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.587710:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5349000/0xb4b2209fbdac3e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147173.587717:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147173.588505:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588514:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588519:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588523:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136760800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147173.588526:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588531:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588540:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147173.588543:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147173.588545:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588550:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136760800/0xb4b2209fbdac3e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588558:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588562:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588566:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588569:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f541e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147173.588571:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588576:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588581:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137700) 00010000:00010000:0.0:1746147173.588583:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147173.588585:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588589:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541e00/0xb4b2209fbdac3e44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.588619:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136760a00/0xb4b2209fbdac3e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f01 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.588629:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5349000/0xb4b2209fbdac3e4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f01 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.588634:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.588636:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147173.588638:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5349000, rc 0) 00000100:00100000:0.0:1746147173.589210:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28374:x1830967463297664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1673us (1885us total) trans 8589943968 rc 0/0 00000100:00100000:0.0:1746147173.589217:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10266 00000100:00100000:0.0:1746147173.593769:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463297920 00000100:00100000:0.0:1746147173.593775:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463297920 00010000:00010000:0.0:1746147173.593801:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31dc00/0xb4b2209fbdac3de2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ede expref: 16 pid: 8478 timeout: 660 lvb_type: 1 00000100:00100000:0.0:1746147173.593825:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5173 00000100:00100000:0.0:1746147173.593831:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463297920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147173.593843:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147173.593859:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31dc00/0xb4b2209fbdac3de2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ede expref: 16 pid: 8478 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.593869:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31dc00/0xb4b2209fbdac3de2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ede expref: 16 pid: 8478 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.593886:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31dc00/0xb4b2209fbdac3de2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ede expref: 16 pid: 8478 timeout: 660 lvb_type: 1 00010000:00010000:0.0:1746147173.593909:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.593910:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.593915:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.593922:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.593962:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.593972:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466236544:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147173.594740:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.594766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.594802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.594848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.594862:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463298688 00000100:00100000:0.0:1746147173.594865:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463298688 00000100:00100000:0.0:1746147173.594879:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10648 00000100:00100000:0.0:1746147173.594884:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463298560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.594892:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.594899:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c7d400/0xb4b2209fbdac3e75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f2b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.594909:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.594910:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.594915:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c7d400/0xb4b2209fbdac3e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f2b expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.594923:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c7d400/0xb4b2209fbdac3e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f2b expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147173.594929:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c7d400, rc 0) 00000100:00100000:0.0:1746147173.594960:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463298560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.594965:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10648 00000100:00100000:0.0:1746147173.597393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.613469:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463299200 00000100:00100000:0.0:1746147173.613477:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463299200 00002000:00100000:0.0:1746147173.613515:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (4071424->4075519) req@ffff8800936ded80 x1830967463299200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.613523:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830967463299200 ext(4071424->4075519) 00002000:00010000:0.0:1746147173.613528:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:0.0:1746147173.613542:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463299456 00000100:00100000:0.0:1746147173.613544:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463299456 00002000:00100000:0.0:1746147173.613561:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800936ddc00 x1830967463299456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.613567:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830967463299456 ext(0->1048575) 00002000:00010000:0.0:1746147173.613570:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936ddc00 00000100:00100000:0.0:1746147173.613578:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463299712 00000100:00100000:0.0:1746147173.615128:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463299712 00002000:00100000:0.0:1746147173.615152:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800936dfb80 x1830967463299712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.615160:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967463299712 ext(1048576->2097151) 00002000:00010000:0.0:1746147173.615164:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746147173.615181:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3894 00000100:00100000:0.0:1746147173.615187:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463299968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.617586:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3895 00000100:00100000:0.0:1746147173.617598:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463300224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.629863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.663831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.674744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.674783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.674823:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463300864 00000100:00100000:0.0:1746147173.674830:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463300864 00010000:00010000:0.0:1746147173.674865:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ef3 expref: 305 pid: 14125 timeout: 660 lvb_type: 0 00000100:00100000:0.0:1746147173.674886:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463300992 00000100:00100000:0.0:1746147173.674888:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463300992 00010000:00010000:0.0:1746147173.674897:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac3df0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ee5 expref: 8 pid: 16361 timeout: 660 lvb_type: 0 00000100:00100000:0.0:1746147173.674910:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5174 00000100:00100000:0.0:1746147173.674917:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1959:x1830967463300864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147173.674930:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147173.674973:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ef3 expref: 305 pid: 14125 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.674984:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541800/0xb4b2209fbdac3e21 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ef3 expref: 305 pid: 14125 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.675010:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.675015:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.675022:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.675027:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147173.675092:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1959:x1830967463300864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 158us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.675100:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5174 00000100:00100000:0.0:1746147173.678262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.679636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147173.686122:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.686135:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.686149:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147173.686158:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.686169:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.686172:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147173.686174:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.686179:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408a00, rc 0) 00000100:00100000:0.0:1746147173.686225:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28372:x1830967463301120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5645us (8155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.686232:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10268 00000100:00100000:0.0:1746147173.693082:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463301504 00000100:00100000:0.0:1746147173.693092:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463301504 00002000:00100000:0.0:1746147173.693128:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3870720->4075519) req@ffff880134d01f80 x1830967463301504/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.693136:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01f80 with x1830967463301504 ext(3870720->4075519) 00002000:00010000:0.0:1746147173.693141:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d01f80 00000100:00100000:0.0:1746147173.693161:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3897 00000100:00100000:0.0:1746147173.693168:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463301504:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147173.706306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.706330:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463301632 00000100:00100000:0.0:1746147173.706338:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463301632 00000100:00100000:0.0:1746147173.706373:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10270 00000100:00100000:0.0:1746147173.706380:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28378:x1830967463301632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.706398:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.706412:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4000/0xb4b2209fbdac3ebb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f4e expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.706472:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.706481:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.706488:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147173.734722:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10655 00000100:00100000:0.0:1746147173.734728:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3295:x1830967466237952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.734801:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147173.734803:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.734805:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.734807:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.734808:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147173.734832:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967466237952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (476us total) trans 17179873045 rc 0/0 00000100:00100000:0.0:1746147173.734837:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10655 00000100:00100000:0.0:1746147173.734846:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10656 00000100:00100000:0.0:1746147173.734850:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3295:x1830967466237568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.734911:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147173.734913:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.734915:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.734916:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.734918:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1746147173.734956:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967466237568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (553us total) trans 17179873046 rc 0/0 00000100:00100000:0.0:1746147173.734961:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10656 00000100:00100000:0.0:1746147173.734969:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10657 00000100:00100000:0.0:1746147173.734973:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3295:x1830967466238080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147173.735435:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147173.735438:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.735439:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.735441:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.735442:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147173.735461:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967466238080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 487us (1059us total) trans 17179873047 rc 0/0 00000100:00100000:0.0:1746147173.735465:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10657 00010000:00010000:0.0:1746147173.735484:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.735490:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147173.735518:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147173.735521:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147173.735532:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147173.735559:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4000/0xb4b2209fbdac3ebb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f4e expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.735572:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f4e expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.735583:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.735585:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147173.735587:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f5a00, rc 0) 00000100:00100000:0.0:1746147173.735615:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28378:x1830967463301632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 29235us (29315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.735620:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10270 00000100:00100000:0.0:1746147173.735734:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a46f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147173.735757:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147173.735770:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a46f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466239104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147173.735783:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147173.735794:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147173.735798:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a46f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147173.735809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147173.735815:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a46f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147173.735827:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147173.735839:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466238592 00000100:00100000:0.0:1746147173.735844:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466238592 00000100:00100000:0.0:1746147173.735857:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466239104 00000100:00100000:0.0:1746147173.735859:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466239104 00000100:00100000:0.0:1746147173.735864:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466238464 00000100:00100000:0.0:1746147173.735866:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466238464 00000100:00100000:0.0:1746147173.735870:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466238976 00000100:00100000:0.0:1746147173.735871:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466238976 00000100:00100000:0.0:1746147173.735877:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10658 00000100:00100000:0.0:1746147173.735880:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967466238592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.735981:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147173.735984:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.735986:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.735988:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.735989:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147173.736011:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3296:x1830967466238592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (253us total) trans 21474840427 rc 0/0 00000100:00100000:0.0:1746147173.736016:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10658 00000100:00100000:0.0:1746147173.736026:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10659 00000100:00100000:0.0:1746147173.736030:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967466239104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.736092:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147173.736094:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.736096:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.736097:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.736099:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8261 -> 8261 00000100:00100000:0.0:1746147173.736116:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3296:x1830967466239104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (332us total) trans 21474840428 rc 0/0 00000100:00100000:0.0:1746147173.736121:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10659 00000100:00100000:0.0:1746147173.736130:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746147173.736134:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967466238464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.736195:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147173.736197:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.736199:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.736200:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.736201:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5483 -> 5483 00000100:00100000:0.0:1746147173.736218:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3296:x1830967466238464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (407us total) trans 21474840429 rc 0/0 00000100:00100000:0.0:1746147173.736226:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746147173.736234:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10661 00000100:00100000:0.0:1746147173.736238:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830967466238976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.736298:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147173.736300:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.736302:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.736303:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147173.736305:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147173.736321:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3296:x1830967466238976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (493us total) trans 21474840430 rc 0/0 00000100:00100000:0.0:1746147173.736325:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10661 00000004:00080000:0.0:1746147173.736351:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a46f1c00/2, rc 0, transno 21474840429 00000100:00100000:0.0:1746147173.736358:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147173.741889:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a46f1880/2, rc 0, transno 21474840430 00000100:00100000:0.0:1746147173.741901:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147173.741922:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a46f1f80/2, rc 0, transno 21474840427 00000100:00100000:0.0:1746147173.741924:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466238592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147173.741932:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a46f0380/2, rc 0, transno 21474840428 00000100:00100000:0.0:1746147173.741934:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a46f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466239104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147173.743339:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463301888 00000100:00100000:0.0:1746147173.743343:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463301888 00000100:00100000:0.0:1746147173.743364:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10271 00000100:00100000:0.0:1746147173.743369:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28378:x1830967463301888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.743377:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.743391:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f55 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.743422:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.743433:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.743445:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147173.743447:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147173.743450:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41800, rc 0) 00000100:00100000:0.0:1746147173.743469:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28378:x1830967463301888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 100us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147173.743474:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10271 00000100:00100000:0.0:1746147173.743488:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466239232 00000100:00100000:0.0:1746147173.743490:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466239232 00000100:00100000:0.0:1746147173.743505:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10666 00000100:00100000:0.0:1746147173.743509:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3294:x1830967466239232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147173.743648:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147173.743651:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.743653:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147173.743655:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147173.743656:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147173.743681:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3294:x1830967466239232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (773us total) trans 21474840435 rc 0/0 00000100:00100000:0.0:1746147173.743687:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10666 00000100:00100000:0.0:1746147173.756339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.756426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.758574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.758600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.758614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.758650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.758916:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3901 00000100:00100000:0.0:1746147173.758923:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463303168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.763466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.765619:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463302272:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8896us (9185us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147173.765630:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3898 00002000:00100000:0.0:1746147173.765639:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a46f3b80 x1830967463302272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.765649:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f3b80 with x1830967463302272 ext(1048576->2097151) 00002000:00010000:0.0:1746147173.765654:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a46f3b80 00002000:00100000:1.0:1746147173.787384:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e135c00 x1830967463302912/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.787392:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135c00 with x1830967463302912 ext(1048576->2097151) 00002000:00010000:1.0:1746147173.787395:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135c00 00000100:00100000:1.0:1746147173.798215:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1958:x1830967463302528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 39394us (39643us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147173.798226:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1378 00002000:00100000:1.0:1746147173.798238:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800a46f3480 x1830967463302528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.798247:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f3480 with x1830967463302528 ext(0->1048575) 00010000:00010000:1.0:1746147173.798256:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f661600/0xb4b2209fbdac3d80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e9f expref: 8 pid: 11147 timeout: 660 lvb_type: 1 00010000:00010000:1.0:1746147173.798269:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f661600/0xb4b2209fbdac3d80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4e9f expref: 8 pid: 11147 timeout: 660 lvb_type: 1 00002000:00010000:1.0:1746147173.798276:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a46f3480 00000100:00100000:0.0:1746147173.810672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.814500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.816118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.823018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.826750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.826778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.827101:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463304704 00000100:00100000:0.0:1746147173.827108:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463304704 00002000:00100000:0.0:1746147173.827141:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e136680 x1830967463304704/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.827151:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136680 with x1830967463304704 ext(2097152->3145727) 00002000:00010000:0.0:1746147173.827156:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e136680 00000100:00100000:0.0:1746147173.827698:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463304960 00000100:00100000:0.0:1746147173.827701:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463304960 00000100:00100000:1.0:1746147173.827705:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3905 00000100:00100000:1.0:1746147173.827715:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463304704:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147173.827715:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137b80 x1830967463304960/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.827722:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137b80 with x1830967463304960 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.827724:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137b80 00000100:00100000:0.0:1746147173.827738:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3906 00000100:00100000:0.0:1746147173.827744:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463304960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147173.829071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.829147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.829163:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463305344 00000100:00100000:1.0:1746147173.829167:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463305344 00002000:00100000:1.0:1746147173.829190:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d37100 x1830967463305344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.829199:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37100 with x1830967463305344 ext(3145728->4194303) 00002000:00010000:1.0:1746147173.829203:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37100 00000100:00100000:1.0:1746147173.829220:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3907 00000100:00100000:1.0:1746147173.829226:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463305344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.852236:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463305344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23000us (23158us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147173.852247:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3907 00002000:00100000:0.0:1746147173.852257:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d37100 x1830967463305344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.852267:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37100 with x1830967463305344 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.852271:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37100 00000100:00100000:0.0:1746147173.867138:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.867168:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463306368 00000100:00100000:0.0:1746147173.867176:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463306368 00000100:00100000:0.0:1746147173.867212:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4017 00000100:00100000:0.0:1746147173.867219:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28374:x1830967463306368:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147173.867369:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28374:x1830967463306368:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 150us (237us total) trans 8589943972 rc 0/0 00000100:00100000:0.0:1746147173.867375:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4017 00000100:00100000:1.0:1746147173.867959:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1956:x1830967463304960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 40191us (41156us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147173.867971:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3906 00002000:00100000:1.0:1746147173.867982:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137b80 x1830967463304960/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.867991:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137b80 with x1830967463304960 ext(3145728->4194303) 00002000:00010000:1.0:1746147173.867998:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137b80 00000100:00100000:0.0:1746147173.872330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.872400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.873285:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463306624 00000100:00100000:1.0:1746147173.873289:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463306624 00002000:00100000:1.0:1746147173.873317:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e135880 x1830967463306624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.873326:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135880 with x1830967463306624 ext(2097152->3145727) 00002000:00010000:1.0:1746147173.873330:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135880 00000100:00100000:1.0:1746147173.873357:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3910 00000100:00100000:1.0:1746147173.873363:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463306624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.877657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.878317:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463307008 00000100:00100000:1.0:1746147173.878321:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463307008 00000100:00100000:1.0:1746147173.878346:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10671 00000100:00100000:1.0:1746147173.878352:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463307008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147173.878360:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147173.878370:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdac3f0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f78 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147173.878396:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466240384:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147173.878440:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f9c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746147173.886060:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147169 -> 1746147173 00002000:00010000:1.0:1746147173.886067:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147168 -> 1746147173 00002000:00010000:1.0:1746147173.886069:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147169 -> 1746147173 00000100:00100000:1.0:1746147173.886089:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466240384:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147173.886115:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdac3f0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f78 expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147173.886128:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5c200/0xb4b2209fbdac3f0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f78 expref: 8 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147173.886146:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c200, rc 0) 00000100:00100000:1.0:1746147173.886206:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463307008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7853us (8160us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147173.886214:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10671 00000100:00100000:1.0:1746147173.889644:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463306624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16274us (17313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147173.889654:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3910 00002000:00100000:1.0:1746147173.889664:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e135880 x1830967463306624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.889672:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135880 with x1830967463306624 ext(2097152->3145727) 00002000:00010000:1.0:1746147173.889678:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135880 00000100:00100000:0.0:1746147173.891526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.891632:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463307392 00000100:00100000:1.0:1746147173.891644:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463307392 00002000:00100000:1.0:1746147173.892142:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e134a80 x1830967463307392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.892151:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463307392 ext(4194304->4870143) 00002000:00010000:1.0:1746147173.892156:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134a80 00000100:00100000:1.0:1746147173.892186:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3911 00000100:00100000:1.0:1746147173.892193:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463307392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147173.898086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.906836:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463307392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14633us (15308us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147173.906847:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3911 00002000:00100000:1.0:1746147173.906857:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e134a80 x1830967463307392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147173.906866:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463307392 ext(4194304->4870143) 00002000:00010000:1.0:1746147173.906872:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134a80 00000100:00100000:0.0:1746147173.915866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.915900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.915970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.916010:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463307776 00000100:00100000:0.0:1746147173.916018:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463307776 00000100:00100000:0.0:1746147173.916052:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463307648 00000100:00100000:0.0:1746147173.916054:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463307648 00000100:00100000:0.0:1746147173.916067:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463307904 00000100:00100000:0.0:1746147173.916069:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463307904 00000100:00100000:0.0:1746147173.917597:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10674 00000100:00100000:0.0:1746147173.917605:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463307648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.917617:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147173.917628:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5290800/0xb4b2209fbdac3f24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4f8d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.917657:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466240768:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147173.917708:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.917745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.918388:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463308032 00000100:00100000:0.0:1746147173.918393:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463308032 00010000:00010000:0.0:1746147173.918413:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 19 pid: 17548 timeout: 660 lvb_type: 0 00000100:00100000:0.0:1746147173.918439:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5180 00000100:00100000:0.0:1746147173.918446:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463308032:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147173.918455:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147173.918478:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 19 pid: 17548 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.918489:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac3e2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3870720->4075519) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f08 expref: 19 pid: 17548 timeout: 660 lvb_type: 0 00010000:00010000:0.0:1746147173.918508:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.918510:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147173.918518:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.918526:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147173.918547:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147173.918555:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466241024:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147173.918603:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147173.931733:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463308416 00000100:00100000:0.0:1746147173.931737:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463308416 00000100:00100000:0.0:1746147173.931859:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10676 00000100:00100000:0.0:1746147173.931867:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463308416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147173.931980:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147173.932022:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdac3f39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4fb0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147173.932035:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147173.932037:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147173.932045:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdac3f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb0 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147173.932059:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5da00/0xb4b2209fbdac3f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb0 expref: 17 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147173.932073:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5da00, rc 0) 00000100:00100000:1.0:1746147173.932094:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463308416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 229us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147173.932101:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10676 00000100:00100000:1.0:1746147173.939236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.939254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.939599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.939794:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463308800 00000100:00100000:0.0:1746147173.939801:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463308800 00000100:00100000:0.0:1746147173.939814:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463308672 00000100:00100000:0.0:1746147173.939816:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463308672 00002000:00100000:0.0:1746147173.939845:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e1880 x1830967463308672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.939854:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967463308672 ext(2097152->3145727) 00002000:00010000:0.0:1746147173.939858:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:0.0:1746147173.939871:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463309184 00000100:00100000:0.0:1746147173.939873:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463309184 00002000:00100000:0.0:1746147173.939887:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e1f80 x1830967463309184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.939893:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967463309184 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.939896:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:0.0:1746147173.939906:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3912 00000100:00100000:0.0:1746147173.939912:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463308672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147173.940344:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3913 00000100:00100000:1.0:1746147173.940351:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967463309184:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147173.944712:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800b52e0a80 x1830967463308800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/0 e 0 to 0 dl 1746147184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.944725:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0a80 with x1830967463308800 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.944732:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0a80 00000100:00100000:0.0:1746147173.944765:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3914 00000100:00100000:0.0:1746147173.944773:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463308800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147173.954104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.954934:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967463309184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14583us (15334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147173.954969:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3913 00002000:00100000:0.0:1746147173.954978:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e1f80 x1830967463309184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:549/0 lens 488/440 e 0 to 0 dl 1746147184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147173.954986:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967463309184 ext(3145728->4194303) 00002000:00010000:0.0:1746147173.954991:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:0.0:1746147173.988759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147173.989128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147173.997895:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463310080 00000100:00100000:1.0:1746147173.997904:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463310080 00000100:00100000:1.0:1746147173.998131:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10273 00000100:00100000:1.0:1746147173.998139:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28385:x1830967463310080:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147173.998317:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147173.998336:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac3f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4fbe expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147173.998447:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998460:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998471:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998486:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998492:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998496:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998596:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998618:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998624:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147173.998632:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147173.998729:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998735:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998741:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998746:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d7600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147173.998749:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998755:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998765:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147173.998768:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147173.998771:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998776:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7600/0xb4b2209fbdac3f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998790:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998794:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998799:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998802:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d7e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147173.998804:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998808:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998813:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98fe00) 00010000:00010000:1.0:1746147173.998815:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147173.998816:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.998820:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7e00/0xb4b2209fbdac3f5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147173.999188:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6600/0xb4b2209fbdac3f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147173.999199:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147173.999205:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147173.999207:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147173.999209:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d6e00, rc 0) 00000100:00100000:1.0:1746147173.999787:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28385:x1830967463310080:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1647us (2034us total) trans 8589943975 rc 0/0 00000100:00100000:1.0:1746147173.999793:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10273 00000100:00100000:0.0:1746147174.013423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.013512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:1.0:1746147174.015192:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147174.017384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.017579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.025368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.027495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.029390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.039288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.039377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.039437:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463311488 00000100:00100000:1.0:1746147174.039446:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463311488 00010000:00010000:1.0:1746147174.039490:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 26 pid: 17530 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.039526:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463311616 00000100:00100000:1.0:1746147174.039529:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463311616 00010000:00010000:1.0:1746147174.039544:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac3f47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb7 expref: 9 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.039560:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5184 00000100:00100000:1.0:1746147174.039567:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463311488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.039579:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147174.039595:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5185 00010000:00010000:1.0:1746147174.039602:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 26 pid: 17530 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.039603:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463311616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.039611:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.039616:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 26 pid: 17530 timeout: 661 lvb_type: 0 00002000:00010000:0.0:1746147174.039625:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147172 -> 1746147173 00002000:00010000:0.0:1746147174.039628:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147172 -> 1746147173 00010000:00010000:0.0:1746147174.039632:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac3f47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb7 expref: 9 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.039639:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f5600/0xb4b2209fbdac3f16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f86 expref: 26 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.039643:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac3f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb7 expref: 9 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.039655:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac3f47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fb7 expref: 9 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.039658:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.039660:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.039668:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136967800/0xb4b2209fbdac3f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fd3 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.039671:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.039673:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.039676:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136967800/0xb4b2209fbdac3f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fd3 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.039678:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 19 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.039684:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 19 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.039719:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136967800/0xb4b2209fbdac3f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fd3 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.039731:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466242176:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147174.039731:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 19 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147174.039739:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466242304:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147174.039802:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00080000:0.0:1746147174.039820:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147174.040406:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.042000:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466242176:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147174.042014:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.042033:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463311488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2467us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.042039:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5184 00000100:00100000:0.0:1746147174.042836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.044647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.047470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147174.047971:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147174.059354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147174.061369:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147174.093307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.094723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.094778:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463312896 00000100:00100000:1.0:1746147174.094782:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463312896 00000100:00100000:1.0:1746147174.094810:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10274 00000100:00100000:1.0:1746147174.094816:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28390:x1830967463312896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.094832:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.094844:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac3f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4fe8 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.094930:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7000/0xb4b2209fbdac3f9b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.094961:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7000/0xb4b2209fbdac3f9b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.094973:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7000/0xb4b2209fbdac3f9b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147174.094983:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147174.095098:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6400/0xb4b2209fbdac3f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fe8 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.095129:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d7000/0xb4b2209fbdac3f9b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fe8 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.095136:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.095139:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147174.095141:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d7000, rc 0) 00000100:00100000:1.0:1746147174.095621:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28390:x1830967463312896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 803us (898us total) trans 8589943978 rc 0/0 00000100:00100000:1.0:1746147174.095628:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10274 00000100:00100000:0.0:1746147174.096265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.096317:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463313024 00000100:00100000:0.0:1746147174.096321:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463313024 00010000:00010000:0.0:1746147174.096340:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 21 pid: 11147 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.096362:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5186 00000100:00100000:0.0:1746147174.096367:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463313024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.096377:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.096395:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 21 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.096405:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 21 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.096433:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3f78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fcc expref: 21 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.096447:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.096448:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.096455:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac3f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fe1 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.096463:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac3f8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fe1 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.096487:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac3f8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fe1 expref: 20 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147174.096497:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466242688:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147174.096543:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.097633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.098099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.099155:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.099514:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466242688:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147174.099533:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.099570:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463313024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3201us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.099579:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5186 00000100:00100000:1.0:1746147174.099804:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463313152 00000100:00100000:1.0:1746147174.099810:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463313152 00000100:00100000:1.0:1746147174.099858:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10685 00000100:00100000:1.0:1746147174.099864:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463313280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.099878:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.099894:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7c00/0xb4b2209fbdac3fb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e4ff6 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.099934:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466242944:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147174.100005:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.101955:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466242944:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147174.101977:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7c00/0xb4b2209fbdac3fb0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ff6 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.101987:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7c00/0xb4b2209fbdac3fb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ff6 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.102009:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d7c00, rc 0) 00000100:00100000:0.0:1746147174.102234:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463313280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2370us (4602us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147174.102239:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10685 00000100:00100000:0.0:1746147174.104388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.107336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.110114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.118466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.119779:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463314304 00000100:00100000:1.0:1746147174.119787:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463314304 00010000:00010000:1.0:1746147174.119810:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efdde00/0xb4b2209fbdac3ed0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f5c expref: 22 pid: 17530 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.119829:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5187 00000100:00100000:1.0:1746147174.119834:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463314304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.119845:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.119861:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efdde00/0xb4b2209fbdac3ed0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f5c expref: 22 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.119870:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efdde00/0xb4b2209fbdac3ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f5c expref: 22 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.119890:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efdde00/0xb4b2209fbdac3ed0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f5c expref: 22 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.119921:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.119923:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.119930:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.120450:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.120484:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 8 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.120494:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466243456:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147174.120776:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.122466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.134604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.134920:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466243456:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147174.134932:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.134971:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463314304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 15136us (16513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.134976:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5187 00000100:00100000:0.0:1746147174.135455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.143488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.155067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.159063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.176756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.177260:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463315712 00000100:00100000:1.0:1746147174.177269:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463315712 00000100:00100000:1.0:1746147174.177321:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10275 00000100:00100000:1.0:1746147174.177328:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28393:x1830967463315712:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147174.177350:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.177368:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a000/0xb4b2209fbdac3fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5019 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177455:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.177468:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f4e expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177474:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac3efa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f71 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177479:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177485:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 6/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.177514:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177524:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 306 pid: 14049 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.177534:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466243840:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.177621:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac3efa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f71 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177628:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac3efa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f71 expref: 16 pid: 14125 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.177640:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466243968:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.177659:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f4e expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.177665:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac3ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f4e expref: 16 pid: 16361 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.177671:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466244096:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.177682:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.180185:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466243840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.180194:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466243968:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.180199:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466244096:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.180223:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147174.182881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.182924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.182976:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463315840 00000100:00100000:1.0:1746147174.182984:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463315840 00000100:00100000:0.0:1746147174.182987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147174.183113:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 307 pid: 14049 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.183144:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5191 00000100:00100000:1.0:1746147174.183153:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1959:x1830967463315840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.183160:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.183163:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 307 pid: 14049 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.183224:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 307 pid: 14049 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.183236:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d6e00/0xb4b2209fbdac3f63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4fbe expref: 307 pid: 14049 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.183251:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.183255:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.183260:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.183265:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.183283:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1959:x1830967463315840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.183289:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5191 00010000:00010000:1.0:1746147174.183861:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.183869:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147174.183889:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000100:00100000:0.0:1746147174.184197:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463316224 00000100:00100000:0.0:1746147174.184201:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463316224 00010000:00010000:0.0:1746147174.184217:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac3ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f63 expref: 28 pid: 17530 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.184231:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5192 00000100:00100000:0.0:1746147174.184235:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463316224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.184243:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.184262:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac3ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f63 expref: 28 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.184270:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac3ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f63 expref: 28 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.184285:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac3ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f63 expref: 28 pid: 17530 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.184298:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.184301:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.184306:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.184317:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.184343:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147174.184354:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466244224:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147174.184414:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147174.184594:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a000/0xb4b2209fbdac3fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5019 expref: 16 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.184613:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5019 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.184623:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.184626:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147174.184628:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9a400, rc 0) 00000100:00100000:1.0:1746147174.184655:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28393:x1830967463315712:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7327us (7908us total) trans 8589943980 rc 0/0 00000100:00100000:1.0:1746147174.184662:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10275 00000100:00100000:0.0:1746147174.186228:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466244224:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147174.186246:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.186276:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463316224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2040us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.186283:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5192 00000100:00100000:0.0:1746147174.194391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.227475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.227741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.227812:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463316608 00000100:00100000:1.0:1746147174.227822:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463316608 00000100:00100000:1.0:1746147174.228437:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10692 00000100:00100000:1.0:1746147174.228444:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463316608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.228452:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.228463:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc9ae00/0xb4b2209fbdac3fef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5020 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.228488:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466244480:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147174.228514:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.240424:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466244480:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147174.240463:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9ae00/0xb4b2209fbdac3fef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5020 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.240478:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9ae00/0xb4b2209fbdac3fef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5020 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.240509:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9ae00, rc 0) 00000100:00100000:1.0:1746147174.240555:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463316608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12111us (13090us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147174.240562:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10692 00000100:00100000:0.0:1746147174.244444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.255111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.284127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.292020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.292113:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463317376 00000100:00100000:1.0:1746147174.292123:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463317376 00000100:00100000:1.0:1746147174.292424:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10276 00000100:00100000:1.0:1746147174.292432:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28397:x1830967463317376:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147174.292455:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.292476:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b200/0xb4b2209fbdac3ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5035 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.292589:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292601:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292611:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292624:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292629:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292634:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292748:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292755:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292761:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147174.292769:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147174.292859:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292866:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292871:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292876:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc9b000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.292879:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292885:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292894:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147174.292897:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.292901:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.292905:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293391:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293404:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293415:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293498:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc9be00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.293544:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293551:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293565:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f700) 00010000:00010000:1.0:1746147174.293568:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.293572:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293576:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9be00/0xb4b2209fbdac400b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147174.293636:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b200/0xb4b2209fbdac3ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 309 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.293647:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 308 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.293653:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.293655:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147174.293657:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9b800, rc 0) 00000100:00100000:1.0:1746147174.293733:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:28397:x1830967463317376:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1300us (1722us total) trans 8589943981 rc 0/0 00000100:00100000:1.0:1746147174.293741:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10276 00000100:00100000:0.0:1746147174.295934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.313595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.313624:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463317888 00000100:00100000:1.0:1746147174.313633:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463317888 00000100:00100000:0.0:1746147174.324473:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463318016 00000100:00100000:0.0:1746147174.324483:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463318016 00000100:00100000:0.0:1746147174.324539:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 570 00000100:00100000:0.0:1746147174.324547:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1957:x1830967463318016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.324562:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.324579:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac4035 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e503c expref: 310 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.324608:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147174.324612:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.324650:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1957:x1830967463318016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.324657:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 570 00000100:00100000:0.0:1746147174.325764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.327341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.329577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.340431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.344628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.346417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.346514:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463319168 00000100:00100000:1.0:1746147174.346523:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463319168 00002000:00100000:1.0:1746147174.346557:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d498700 x1830967463319168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.346565:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498700 with x1830967463319168 ext(0->1048575) 00002000:00010000:1.0:1746147174.346569:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498700 00000100:00100000:1.0:1746147174.346589:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3924 00000100:00100000:1.0:1746147174.346594:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967463319168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147174.356318:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463319040 00000100:00100000:0.0:1746147174.356327:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463319040 00002000:00100000:0.0:1746147174.356370:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2490367) req@ffff880134d01c00 x1830967463319040/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.356381:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01c00 with x1830967463319040 ext(2097152->2490367) 00010000:00010000:0.0:1746147174.356391:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136966c00/0xb4b2209fbdac3fc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e500b expref: 30 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.356404:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136966c00/0xb4b2209fbdac3fc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e500b expref: 30 pid: 8481 timeout: 661 lvb_type: 0 00002000:00010000:0.0:1746147174.356411:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d01c00 00000100:00100000:0.0:1746147174.356443:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1384 00000100:00100000:0.0:1746147174.356450:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463319040:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147174.366402:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967463319168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19799us (19982us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147174.366414:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3924 00002000:00100000:0.0:1746147174.366424:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d498700 x1830967463319168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/440 e 0 to 0 dl 1746147185 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.366432:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498700 with x1830967463319168 ext(0->1048575) 00002000:00010000:0.0:1746147174.366438:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d498700 00000100:00100000:0.0:1746147174.380360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.383533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.397143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.397193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.397231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.397312:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463319808 00000100:00100000:0.0:1746147174.397320:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463319808 00002000:00100000:0.0:1746147174.397360:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012d49b800 x1830967463319808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.397370:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b800 with x1830967463319808 ext(2097152->3145727) 00002000:00010000:0.0:1746147174.397375:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b800 00000100:00100000:0.0:1746147174.397389:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463319936 00000100:00100000:0.0:1746147174.397392:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463319936 00002000:00100000:0.0:1746147174.397401:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012d49ad80 x1830967463319936/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.397407:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967463319936 ext(3145728->4194303) 00002000:00010000:0.0:1746147174.397410:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:0.0:1746147174.397419:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463320320 00000100:00100000:0.0:1746147174.397420:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463320320 00002000:00100000:0.0:1746147174.397430:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012d49a300 x1830967463320320/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.397436:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49a300 with x1830967463320320 ext(3145728->4194303) 00002000:00010000:0.0:1746147174.397439:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49a300 00000100:00100000:0.0:1746147174.397449:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3926 00000100:00100000:0.0:1746147174.397455:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463319808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147174.398758:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463319552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12889us (15221us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147174.398767:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3925 00002000:00100000:1.0:1746147174.398773:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8801312a4000 x1830967463319552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/440 e 0 to 0 dl 1746147185 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.398781:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967463319552 ext(2097152->3145727) 00002000:00010000:1.0:1746147174.398785:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a4000 00000100:00100000:1.0:1746147174.398803:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3927 00000100:00100000:1.0:1746147174.398809:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463319936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147174.410897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.413718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.420570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.420602:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463320704 00000100:00100000:0.0:1746147174.420607:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463320704 00000100:00100000:0.0:1746147174.420638:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10700 00000100:00100000:0.0:1746147174.420645:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28390:x1830967463320704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.420660:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.420675:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e506d expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.421867:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.421872:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.421881:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e506d expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.421902:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e506d expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.421913:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d7800, rc 0) 00000100:00100000:1.0:1746147174.421988:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28390:x1830967463320704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1341us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.421995:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10700 00000100:00100000:0.0:1746147174.425750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.427498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.438075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.438586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.440198:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463321472 00000100:00100000:0.0:1746147174.440201:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463321472 00000100:00100000:0.0:1746147174.440228:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10701 00000100:00100000:0.0:1746147174.440233:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28393:x1830967463321472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147174.440244:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.440259:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5074 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.440279:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147174.440283:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac4066 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5066 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.440289:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147174.440292:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.440318:0:8481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac4066 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5066 expref: 31 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.440328:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.440335:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344600, rc 0) 00000100:00100000:0.0:1746147174.440359:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28393:x1830967463321472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 125us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.440363:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10701 00000100:00100000:0.0:1746147174.446380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.446506:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463321600 00000100:00100000:1.0:1746147174.446515:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463321600 00000100:00100000:1.0:1746147174.446565:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10702 00000100:00100000:1.0:1746147174.446572:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463321600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.446589:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.446605:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac407b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e507b expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.446634:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac407b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e507b expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.446643:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33000/0xb4b2209fbdac407b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e507b expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.447946:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e33000, rc 0) 00000100:00100000:1.0:1746147174.448019:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463321600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1444us (1645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147174.448030:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10702 00000100:00100000:0.0:1746147174.449884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.450117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.450288:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463321984 00000100:00100000:1.0:1746147174.450293:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463321984 00000100:00100000:1.0:1746147174.450330:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10703 00000100:00100000:1.0:1746147174.450336:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:28397:x1830967463321984:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147174.450346:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.450362:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5082 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.450387:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac3ff6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e502e expref: 9 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.450394:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac4051 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5051 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.450399:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.450401:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.450404:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.450434:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac4051 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5051 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.450444:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac4051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5051 expref: 25 pid: 8481 timeout: 661 lvb_type: 1 00000100:00100000:1.0:1746147174.450455:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466245632:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.450561:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac3ff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e502e expref: 9 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.450569:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac3ff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e502e expref: 9 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.450577:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466245760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.450596:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.455094:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466245632:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.455109:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466245760:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.455141:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.455161:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e32800, rc 0) 00000100:00100000:1.0:1746147174.455218:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28397:x1830967463321984:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4881us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.455226:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10703 00000100:00100000:0.0:1746147174.457131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.457171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.461340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.466189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.470718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.471786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.471810:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463322880 00000100:00100000:0.0:1746147174.471817:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463322880 00000100:00100000:0.0:1746147174.471866:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463323008 00000100:00100000:0.0:1746147174.471868:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463323008 00000100:00100000:0.0:1746147174.471887:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10704 00000100:00100000:0.0:1746147174.471894:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463322880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.471914:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.471930:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5089 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.471949:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10705 00000100:00100000:1.0:1746147174.471957:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463323008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.471965:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.471966:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.471977:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e037e00/0xb4b2209fbdac4090 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5090 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.471977:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4089 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5089 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.471987:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5089 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.471990:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.471996:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e037e00/0xb4b2209fbdac4090 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5090 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.472005:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4800, rc 0) 00010000:00010000:1.0:1746147174.472007:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e037e00/0xb4b2209fbdac4090 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5090 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.472019:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037e00, rc 0) 00000100:00100000:0.0:1746147174.472046:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463322880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 152us (1338us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147174.472047:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463323008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 91us (264us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147174.472052:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10704 00000100:00100000:1.0:1746147174.472269:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10705 00000100:00100000:0.0:1746147174.476561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.476586:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463323264 00000100:00100000:0.0:1746147174.476591:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463323264 00000100:00100000:0.0:1746147174.476639:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10706 00000100:00100000:0.0:1746147174.476712:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28390:x1830967463323264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.476777:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.476793:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4097 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5097 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.476820:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.476828:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147174.476830:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147174.476834:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4097 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4870144->5242879] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5097 expref: 11 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.476858:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.476868:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 23 pid: 4444 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.476880:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466246144:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147174.476918:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.479604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.482822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.485863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.485903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.485910:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463323904 00000100:00100000:0.0:1746147174.485917:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463323904 00000100:00100000:1.0:1746147174.485928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:0.0:1746147174.485976:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3489791) req@ffff8801312a7100 x1830967463323904/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.485997:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a7100 with x1830967463323904 ext(3145728->3489791) 00010000:00010000:0.0:1746147174.486006:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 24 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.486021:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 24 pid: 4444 timeout: 661 lvb_type: 0 00002000:00010000:0.0:1746147174.486029:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a7100 00000100:00100000:1.0:1746147174.486184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.486332:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463324288 00000100:00100000:1.0:1746147174.486336:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463324288 00002000:00100000:1.0:1746147174.486351:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3489792->4194303) req@ffff8801312a6a00 x1830967463324288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.486358:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967463324288 ext(3489792->4194303) 00010000:00010000:1.0:1746147174.486362:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 26 pid: 4444 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.486539:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1391 00000100:00100000:0.0:1746147174.486545:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463324672:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147174.486783:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 27 pid: 4444 timeout: 661 lvb_type: 0 00002000:00010000:1.0:1746147174.486788:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6a00 00000100:00100000:1.0:1746147174.486799:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1392 00000100:00100000:1.0:1746147174.486804:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463324288:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147174.500845:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463324672:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14288us (14649us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147174.500860:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1391 00002000:00100000:1.0:1746147174.500870:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8801312a4700 x1830967463324672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/440 e 0 to 0 dl 1746147185 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.500881:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4700 with x1830967463324672 ext(3145728->4194303) 00010000:00010000:1.0:1746147174.500891:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac4066 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5066 expref: 32 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.500904:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac4066 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5066 expref: 32 pid: 8481 timeout: 661 lvb_type: 0 00002000:00010000:1.0:1746147174.500911:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312a4700 00000100:00100000:0.0:1746147174.504536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.505168:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463324288:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18361us (19235us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746147174.505180:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1392 00002000:00100000:1.0:1746147174.505190:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3489792->4194303) req@ffff8801312a6a00 x1830967463324288/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/440 e 0 to 0 dl 1746147185 ref 1 fl Complete:H/200/0 rc 704512/704512 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.505199:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967463324288 ext(3489792->4194303) 00010000:00010000:1.0:1746147174.505209:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 27 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.505221:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32800/0xb4b2209fbdac4082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5082 expref: 27 pid: 4444 timeout: 661 lvb_type: 0 00002000:00010000:1.0:1746147174.505232:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312a6a00 00000100:00100000:0.0:1746147174.508863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.509701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.512921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.514504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.515341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.518284:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466246912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147174.518320:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147174.519204:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147174.519289:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466246912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147174.519989:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147174.520022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147174.520299:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466247040 00000100:00100000:1.0:1746147174.520304:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466247040 00000100:00080000:0.0:1746147174.520895:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147174.520956:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1746147174.520963:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967466247040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147174.520979:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 309395456 pending 15335424 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746147174.521009:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3295:x1830967466247040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.521014:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1746147174.521065:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147174.523733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.528813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.532113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.533466:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466247168:0@lo:400:kworker.0 00000100:00100000:0.0:1746147174.533496:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147174.533819:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147174.533824:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466247552:0@lo:400:kworker.0 00000100:00100000:0.0:1746147174.533843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147174.533881:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463326080 00000100:00100000:1.0:1746147174.533885:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463326080 00010000:00010000:1.0:1746147174.533908:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdac409e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e509e expref: 26 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.533930:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5202 00000100:00100000:1.0:1746147174.533934:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463326080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.533958:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.533980:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdac409e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e509e expref: 26 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.533991:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdac409e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e509e expref: 26 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.534013:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85c3800/0xb4b2209fbdac409e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e509e expref: 26 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.534231:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466247168:0@lo:400:kworker.0 00000100:00100000:0.0:1746147174.534254:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466247552 00000100:00100000:0.0:1746147174.534256:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466247552 00000100:00100000:0.0:1746147174.534275:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1746147174.534280:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466247552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147174.534305:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466247552:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.534309:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1746147174.534331:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466247552:0@lo:400:kworker.0 00010000:00010000:1.0:1746147174.534370:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.534373:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.534380:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f800/0xb4b2209fbdac40a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50a5 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.534388:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f800/0xb4b2209fbdac40a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50a5 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.534416:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f800/0xb4b2209fbdac40a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50a5 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.534424:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466247680:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147174.534468:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.539209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.548772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.548975:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463326592 00000100:00100000:1.0:1746147174.548983:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463326592 00002000:00100000:1.0:1746147174.549024:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3977216->3981311) req@ffff88009f76ca80 x1830967463326592/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.549034:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76ca80 with x1830967463326592 ext(3977216->3981311) 00002000:00010000:1.0:1746147174.549040:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76ca80 00000100:00100000:1.0:1746147174.549075:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3932 00000100:00100000:1.0:1746147174.549082:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463326592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147174.549266:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463326592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 183us (800us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147174.549272:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3932 00002000:00100000:1.0:1746147174.549278:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3977216->3981311) req@ffff88009f76ca80 x1830967463326592/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/4536 e 0 to 0 dl 1746147185 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.549285:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76ca80 with x1830967463326592 ext(3977216->3981311) 00002000:00010000:1.0:1746147174.549287:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76ca80 00000100:00100000:0.0:1746147174.560604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.560655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.563570:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10712 00000100:00100000:0.0:1746147174.563587:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463326848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.563605:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.563623:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdac40c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e50c1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.563654:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdac40c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c1 expref: 33 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.563670:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00a000/0xb4b2209fbdac40c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c1 expref: 33 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147174.563705:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f00a000, rc 0) 00000100:00100000:0.0:1746147174.563754:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463326848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 174us (3098us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147174.563759:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10712 00000100:00100000:0.0:1746147174.568737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.575036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.600242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.606604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.610531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.614501:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463327872 00000100:00100000:0.0:1746147174.614512:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463327872 00000100:00100000:0.0:1746147174.614566:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 571 00000100:00100000:0.0:1746147174.614573:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1958:x1830967463327872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.614585:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.614607:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa8dc00/0xb4b2209fbdac40e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50cf expref: 312 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.614627:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147174.614631:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.614671:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1958:x1830967463327872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.614677:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 571 00000100:00100000:0.0:1746147174.623362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.636179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.648609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.651929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.652022:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463328640 00000100:00100000:1.0:1746147174.652026:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463328640 00000100:00100000:1.0:1746147174.652234:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10279 00000100:00100000:1.0:1746147174.652240:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28408:x1830967463328640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.652252:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.652270:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e50e4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.652356:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652368:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652379:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652433:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652439:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652448:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652542:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652550:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652560:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147174.652569:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147174.652615:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652621:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652627:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652631:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f5600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.652635:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652640:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652650:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147174.652652:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.652655:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652663:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac4107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652697:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652703:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652707:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652711:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.652713:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652718:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652724:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98fc00) 00010000:00010000:1.0:1746147174.652726:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.652728:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652732:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac410e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.652759:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.652769:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.652780:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.652782:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147174.652784:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4600, rc 0) 00000100:00100000:1.0:1746147174.652818:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28408:x1830967463328640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 578us (890us total) trans 8589943986 rc 0/0 00000100:00100000:1.0:1746147174.652824:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10279 00000100:00100000:0.0:1746147174.653900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.656296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.656433:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463329024 00000100:00100000:1.0:1746147174.656439:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463329024 00000100:00100000:1.0:1746147174.656733:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10716 00000100:00100000:1.0:1746147174.656741:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463329024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.656755:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.656772:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e50eb expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.656792:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.656794:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.656802:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50eb expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.656816:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50eb expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.656827:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1a00, rc 0) 00000100:00100000:0.0:1746147174.656869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.656872:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463329024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 133us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.656878:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10716 00000100:00100000:1.0:1746147174.656894:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463329152 00000100:00100000:1.0:1746147174.656897:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463329152 00000100:00100000:1.0:1746147174.656916:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10717 00000100:00100000:1.0:1746147174.656920:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463329152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.656928:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.657496:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac412a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e50f2 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.657518:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac412a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50f2 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.657526:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99ec00/0xb4b2209fbdac412a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50f2 expref: 20 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.657535:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99ec00, rc 0) 00000100:00100000:1.0:1746147174.657568:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463329152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 646us (700us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147174.657574:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10717 00000100:00100000:0.0:1746147174.665816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.667972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.668133:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463329664 00000100:00100000:1.0:1746147174.668139:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463329664 00000100:00100000:1.0:1746147174.668183:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10280 00000100:00100000:1.0:1746147174.668189:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28411:x1830967463329664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147174.668206:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.668224:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e50f9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.668318:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668331:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668340:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668350:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668355:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668359:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668716:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4146 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668725:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4146 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668730:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4146 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147174.668738:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147174.668823:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668830:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668835:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668845:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.668849:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668856:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668866:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147174.668869:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.668873:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668878:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5c00/0xb4b2209fbdac4138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668905:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668911:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668915:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668920:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3f5600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147174.668922:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668926:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668933:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f500) 00010000:00010000:1.0:1746147174.668952:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147174.668955:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668960:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5600/0xb4b2209fbdac413f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147174.668996:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f5a00/0xb4b2209fbdac4131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50f9 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.669007:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4146 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50f9 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.669014:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.669016:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147174.669019:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4800, rc 0) 00000100:00100000:1.0:1746147174.669043:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28411:x1830967463329664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 854us (1074us total) trans 8589943988 rc 0/0 00000100:00100000:1.0:1746147174.669050:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10280 00000100:00100000:0.0:1746147174.675489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.675541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.675828:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463330048 00000100:00100000:1.0:1746147174.675833:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463330048 00000100:00100000:1.0:1746147174.675876:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 572 00000100:00100000:1.0:1746147174.675883:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463330048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.675896:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.675920:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4146 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50f9 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.675934:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147174.675950:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.675997:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463330048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 114us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.676003:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 572 00000100:00100000:0.0:1746147174.688795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.688907:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463330176 00000100:00100000:1.0:1746147174.688915:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463330176 00000100:00100000:1.0:1746147174.688981:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10718 00000100:00100000:1.0:1746147174.688989:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28408:x1830967463330176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147174.689008:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.689026:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5100 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.689053:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.689060:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147174.689062:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147174.689066:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.689095:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.689107:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 20 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.689119:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466248192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.689208:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.691437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.691575:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466248192:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.691611:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.691630:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3f4800, rc 0) 00000100:00100000:1.0:1746147174.691696:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28408:x1830967463330176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2694us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.691706:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10718 00000100:00100000:0.0:1746147174.709716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.710027:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463330432 00000100:00100000:1.0:1746147174.710037:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463330432 00010000:00010000:1.0:1746147174.710079:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 22 pid: 8481 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.710137:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5204 00000100:00100000:1.0:1746147174.710148:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463330432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.710165:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.710192:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 22 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.710205:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 22 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.710233:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344600/0xb4b2209fbdac4074 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5074 expref: 22 pid: 8481 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.711783:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.711787:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.711799:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.711811:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.711851:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147174.711864:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466248320:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147174.713471:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.717974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.718040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.722555:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466248320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147174.722574:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.722624:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463330432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12479us (12922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.722633:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5204 00000100:00100000:0.0:1746147174.757164:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.764319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.764464:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463331328 00000100:00100000:1.0:1746147174.764473:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463331328 00000100:00100000:1.0:1746147174.764527:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10719 00000100:00100000:1.0:1746147174.764535:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28411:x1830967463331328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147174.764554:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147174.764572:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b000/0xb4b2209fbdac415b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5107 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.764601:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.764614:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50eb expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.764620:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.764623:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147174.764626:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b000/0xb4b2209fbdac415b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3207168->3780607] (req 3207168->3780607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5107 expref: 15 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.764656:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50eb expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147174.764667:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac4123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50eb expref: 15 pid: 4444 timeout: 661 lvb_type: 1 00000100:00100000:1.0:1746147174.764678:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466248448:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147174.764780:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147174.764788:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 25 pid: 11147 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.764796:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466248576:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147174.764821:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147174.775460:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463331584 00000100:00100000:1.0:1746147174.775471:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463331584 00010000:00010000:1.0:1746147174.775514:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 26 pid: 11147 timeout: 661 lvb_type: 0 00000100:00100000:1.0:1746147174.775572:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5205 00000100:00100000:1.0:1746147174.775582:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463331584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147174.775598:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147174.775625:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 26 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.775637:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 26 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.775662:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0xb4b2209fbdac40c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50c8 expref: 26 pid: 11147 timeout: 661 lvb_type: 0 00010000:00010000:1.0:1746147174.775703:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147174.775756:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463331584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 176us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147174.775763:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5205 00000100:00100000:0.0:1746147174.776465:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463331456 00000100:00100000:0.0:1746147174.776471:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463331456 00000100:00100000:0.0:1746147174.776509:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10720 00000100:00100000:0.0:1746147174.776515:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28408:x1830967463331456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.776529:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.776541:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e037400/0xb4b2209fbdac4162 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e510e expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.776560:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.776562:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.776569:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037400/0xb4b2209fbdac4162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3780608->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e510e expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.776581:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e037400/0xb4b2209fbdac4162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3780608->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e510e expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.776589:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037400, rc 0) 00000100:00100000:0.0:1746147174.776623:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28408:x1830967463331456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 108us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.776628:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10720 00000100:00100000:0.0:1746147174.778170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.780927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.790297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.790343:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463332352 00000100:00100000:0.0:1746147174.790352:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463332352 00000100:00100000:1.0:1746147174.791203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.791233:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463332480 00000100:00100000:1.0:1746147174.791238:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463332480 00002000:00100000:1.0:1746147174.791276:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3207168->3211263) req@ffff88009ee5f100 x1830967463332480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/0 e 0 to 0 dl 1746147185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.791286:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967463332480 ext(3207168->3211263) 00002000:00010000:1.0:1746147174.791292:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:1.0:1746147174.791323:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3939 00000100:00100000:1.0:1746147174.791335:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463332480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147174.791535:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463332480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 200us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147174.791542:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3939 00002000:00100000:1.0:1746147174.791548:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3207168->3211263) req@ffff88009ee5f100 x1830967463332480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:550/0 lens 488/4536 e 0 to 0 dl 1746147185 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147174.791555:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967463332480 ext(3207168->3211263) 00002000:00010000:1.0:1746147174.791558:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:0.0:1746147174.792790:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10281 00000100:00100000:0.0:1746147174.792801:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28415:x1830967463332352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147174.792821:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147174.792840:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdac4169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5115 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.792954:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.792966:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.792977:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.792991:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.792996:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793001:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793097:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdac417e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793105:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdac417e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793110:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdac417e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147174.793117:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147174.793192:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793198:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793204:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793209:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e037e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147174.793213:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793219:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793230:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147174.793232:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147174.793236:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793240:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037e00/0xb4b2209fbdac4170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793257:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793261:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793265:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793269:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e036200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147174.793271:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793276:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793281:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880132f77a00) 00010000:00010000:0.0:1746147174.793283:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147174.793284:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793288:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036200/0xb4b2209fbdac4177 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147174.793321:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e036400/0xb4b2209fbdac4169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5115 expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.793332:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdac417e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5115 expref: 314 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.793337:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147174.793339:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147174.793341:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e037600, rc 0) 00000100:00100000:0.0:1746147174.793378:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:28415:x1830967463332352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 581us (3094us total) trans 8589943990 rc 0/0 00000100:00100000:0.0:1746147174.793384:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10281 00000100:00100000:0.0:1746147174.803089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.803373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.803405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.803807:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463332864 00000100:00100000:0.0:1746147174.803813:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463332864 00000100:00100000:0.0:1746147174.803844:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 573 00000100:00100000:0.0:1746147174.803850:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463332864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.803859:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.803876:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037600/0xb4b2209fbdac417e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5115 expref: 314 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.803889:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147174.803893:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.803913:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1957:x1830967463332864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.803919:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 573 00000100:00100000:0.0:1746147174.813624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.816801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.822205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.832175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.832278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.832315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.832752:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3942 00000100:00100000:0.0:1746147174.832760:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463334016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147174.848410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.864009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.864046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.864065:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463334272 00000100:00100000:0.0:1746147174.864073:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463334272 00010000:00010000:0.0:1746147174.864103:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac40b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50b3 expref: 35 pid: 6881 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.864124:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463334400 00000100:00100000:0.0:1746147174.864126:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463334400 00010000:00010000:0.0:1746147174.864135:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e506d expref: 21 pid: 4444 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.864162:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5207 00000100:00100000:0.0:1746147174.864169:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463334272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.864182:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.864200:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac40b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50b3 expref: 35 pid: 6881 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.864210:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac40b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50b3 expref: 35 pid: 6881 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.864230:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.864264:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463334272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.864271:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5207 00000100:00100000:0.0:1746147174.864286:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5208 00000100:00100000:0.0:1746147174.864291:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463334400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.864298:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.864305:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e506d expref: 21 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.864313:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5d7800/0xb4b2209fbdac406d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e506d expref: 21 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.864323:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147174.864336:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463334400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147174.864341:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5208 00000100:00100000:0.0:1746147174.868078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147174.869786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.870778:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463334528 00000100:00100000:0.0:1746147174.870782:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463334528 00010000:00010000:0.0:1746147174.870796:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 661 lvb_type: 0 00000100:00100000:0.0:1746147174.870811:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5210 00000100:00100000:0.0:1746147174.870816:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463334528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147174.870822:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147174.870831:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.870845:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.870857:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3f4800/0xb4b2209fbdac4154 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5100 expref: 20 pid: 4444 timeout: 661 lvb_type: 0 00010000:00010000:0.0:1746147174.870876:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.870878:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147174.870884:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac41af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e513f expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.870890:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac41af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e513f expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147174.870917:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac41af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e513f expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147174.870927:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466249344:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147174.870980:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147174.874283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.885346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.903853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.910658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.915135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.918200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.928396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.944663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.955362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.955642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.969778:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463336832:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11981us (14128us total) trans 0 rc 192512/192512 00000100:00100000:0.0:1746147174.969789:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3947 00002000:00100000:0.0:1746147174.969799:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3338239) req@ffff88009f732680 x1830967463336832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:550/0 lens 488/440 e 0 to 0 dl 1746147185 ref 1 fl Complete:/200/0 rc 192512/192512 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147174.969808:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830967463336832 ext(3145728->3338239) 00002000:00010000:0.0:1746147174.969813:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f732680 00000100:00100000:0.0:1746147174.980449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147174.989199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.001976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.011164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.025891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.035595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.035634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.038094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.038136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.038190:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463338112 00000100:00100000:0.0:1746147175.038193:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463338112 00000100:00100000:0.0:1746147175.038215:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463338240 00000100:00100000:0.0:1746147175.038216:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463338240 00000100:00100000:0.0:1746147175.038229:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1746147175.038233:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463338112:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147175.038251:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463338112:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 18us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.038256:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1746147175.038266:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:0.0:1746147175.038270:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463338240:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1746147175.038284:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463338240:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 14us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.038288:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:0.0:1746147175.047539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.050497:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463338368 00000100:00100000:1.0:1746147175.050510:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463338368 00000100:00100000:1.0:1746147175.050566:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10282 00000100:00100000:1.0:1746147175.050575:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+6:28421:x1830967463338368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147175.050591:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147175.050607:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ae00/0xb4b2209fbdac41d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5169 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.050658:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050670:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050680:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050703:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050709:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050714:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050802:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050812:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5019 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.050818:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.050846:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5019 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.050856:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac3fda lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5019 expref: 19 pid: 14049 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.050866:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466250368:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147175.050970:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147175.054772:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466250368:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147175.054799:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147175.055435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.063041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147175.063527:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063534:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147175.063565:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147175.063568:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147175.063865:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063873:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063880:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063885:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063889:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063893:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef4ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147175.063896:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063900:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063907:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147175.063910:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147175.063912:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063916:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ba00/0xb4b2209fbdac41e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063926:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063930:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.063934:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.064042:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef4bc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147175.064044:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.064049:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.064055:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f000) 00010000:00010000:1.0:1746147175.064056:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147175.064058:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.064062:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4bc00/0xb4b2209fbdac41e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147175.064087:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4ae00/0xb4b2209fbdac41d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5169 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.064099:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef4be00/0xb4b2209fbdac41ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5169 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.064104:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147175.064105:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147175.064107:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef4be00, rc 0) 00000100:00100000:1.0:1746147175.064127:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28421:x1830967463338368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 13555us (16596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.064133:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10282 00000100:00100000:0.0:1746147175.066199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.066318:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463338880 00000100:00100000:0.0:1746147175.066325:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463338880 00000100:00100000:0.0:1746147175.066350:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463339008 00000100:00100000:0.0:1746147175.066352:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463339008 00000100:00100000:0.0:1746147175.066360:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463339264 00000100:00100000:0.0:1746147175.066362:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463339264 00000100:00100000:0.0:1746147175.066368:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463339136 00000100:00100000:0.0:1746147175.066369:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463339136 00000100:00100000:0.0:1746147175.066375:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463339392 00000100:00100000:0.0:1746147175.066376:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463339392 00000100:00100000:0.0:1746147175.066381:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463339520 00000100:00100000:0.0:1746147175.066382:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463339520 00000100:00100000:0.0:1746147175.066388:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10732 00000100:00100000:0.0:1746147175.066393:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463338880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.066407:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.066419:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5170 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.066435:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066437:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066444:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066455:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066463:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92f200, rc 0) 00000100:00100000:0.0:1746147175.066493:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463338880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.066498:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10732 00000100:00100000:0.0:1746147175.066508:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10733 00000100:00100000:0.0:1746147175.066512:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463339008:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.066518:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.066525:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5177 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.066533:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066536:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066540:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5177 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066549:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5177 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066755:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92fc00, rc 0) 00000100:00100000:0.0:1746147175.066770:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463339008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 257us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.066774:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10733 00000100:00100000:0.0:1746147175.066783:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10734 00000100:00100000:0.0:1746147175.066787:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463339264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.066792:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.066798:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5185 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.066806:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066807:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066812:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5185 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066819:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5185 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066825:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92fe00, rc 0) 00000100:00100000:0.0:1746147175.066851:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463339264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 64us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.066856:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10734 00000100:00100000:0.0:1746147175.066864:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10735 00000100:00100000:0.0:1746147175.066868:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463339136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.066875:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.066880:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e517e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.066887:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066888:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.066892:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e517e expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066899:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e517e expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.066905:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92fa00, rc 0) 00000100:00100000:0.0:1746147175.066916:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463339136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 48us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.066921:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10735 00000100:00100000:0.0:1746147175.066929:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10736 00000100:00100000:0.0:1746147175.066933:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463339392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.066971:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.066977:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac4211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e518c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.067006:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466250496:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147175.067051:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147175.067069:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10737 00000100:00100000:0.0:1746147175.067073:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463339520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147175.067078:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147175.067082:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f92ec00/0xb4b2209fbdac4218 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5193 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.067100:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466250624:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147175.067115:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130b4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147175.073304:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466250496:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147175.073328:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac4211 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e518c expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.073341:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac4211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e518c expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147175.073364:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92f800, rc 0) 00000100:00100000:0.0:1746147175.073402:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463339392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6467us (7124us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147175.073409:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10736 00000100:00100000:1.0:1746147175.079419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.084337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.087104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.091903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.095881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.098007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.104402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.107400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.108246:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10743 00000100:00100000:1.0:1746147175.108253:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463340800:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147175.108269:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.108278:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.108284:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.108290:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 27 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.108294:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.108296:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.108298:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.108310:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 27 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.108316:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 27 pid: 6881 timeout: 662 lvb_type: 1 00000100:00100000:1.0:1746147175.108323:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466252160:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147175.108346:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.108352:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:1.0:1746147175.108359:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466252288:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147175.108374:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.108381:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.108388:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466252416:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147175.108397:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147175.122221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.122236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.122251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.122281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.122302:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463341696 00000100:00100000:0.0:1746147175.122310:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463341696 00010000:00010000:0.0:1746147175.122338:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5177 expref: 15 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.122358:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463341568 00000100:00100000:0.0:1746147175.122360:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463341568 00010000:00010000:0.0:1746147175.122368:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdac404a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e504a expref: 32 pid: 8481 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.122376:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463341824 00000100:00100000:0.0:1746147175.122377:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463341824 00010000:00010000:0.0:1746147175.122390:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 19 pid: 8481 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.122397:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463341952 00000100:00100000:0.0:1746147175.122398:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463341952 00010000:00010000:0.0:1746147175.122405:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5185 expref: 17 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.122413:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5216 00000100:00100000:0.0:1746147175.122419:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463341696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.122431:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.122446:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5177 expref: 15 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122454:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f92fc00/0xb4b2209fbdac41fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5177 expref: 15 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122472:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.122501:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463341696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.122506:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5216 00000100:00100000:0.0:1746147175.122517:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5217 00000100:00100000:0.0:1746147175.122520:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463341568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.122525:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.122529:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdac404a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e504a expref: 32 pid: 8481 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122538:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a537e000/0xb4b2209fbdac404a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e504a expref: 32 pid: 8481 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122546:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.122554:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463341568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.122558:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5217 00000100:00100000:0.0:1746147175.122563:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5218 00000100:00100000:0.0:1746147175.122566:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463341824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.122571:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.122575:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 19 pid: 8481 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.122581:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1e00/0xb4b2209fbdac3fcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5012 expref: 19 pid: 8481 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.122588:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.122590:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.122593:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab5f600/0xb4b2209fbdac4265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.122600:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab5f600/0xb4b2209fbdac4265 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.122612:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.122620:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463341824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.122624:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5218 00000100:00100000:0.0:1746147175.122653:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5219 00000100:00100000:0.0:1746147175.122657:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463341952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.122661:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.122670:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5185 expref: 17 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122677:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f92fe00/0xb4b2209fbdac4203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5185 expref: 17 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.122700:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.122710:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463341952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.122714:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5219 00000100:00080000:0.0:1746147175.122726:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147175.123617:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466252160:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147175.123626:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466252288:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147175.124632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.124653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.124664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.124673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.124690:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342592 00000100:00100000:1.0:1746147175.124696:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342592 00000100:00100000:0.0:1746147175.124704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147175.124719:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e45c000/0xb4b2209fbdac3e67 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f1d expref: 31 pid: 17548 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.124730:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342464 00000100:00100000:0.0:1746147175.124733:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342464 00000100:00100000:1.0:1746147175.124735:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5220 00000100:00100000:1.0:1746147175.124740:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463342592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.124745:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:1.0:1746147175.124750:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147175.124759:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342080 00000100:00100000:0.0:1746147175.124760:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342080 00010000:00010000:1.0:1746147175.124763:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e45c000/0xb4b2209fbdac3e67 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f1d expref: 31 pid: 17548 timeout: 662 lvb_type: 1 00010000:00010000:1.0:1746147175.124771:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e45c000/0xb4b2209fbdac3e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f1d expref: 31 pid: 17548 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.124771:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 13 pid: 11147 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.124778:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342336 00000100:00100000:0.0:1746147175.124780:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342336 00010000:00010000:0.0:1746147175.124785:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 28 pid: 6881 timeout: 662 lvb_type: 1 00010000:00010000:1.0:1746147175.124786:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.124793:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5221 00000100:00100000:0.0:1746147175.124797:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463342464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.124804:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147175.124810:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463342592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147175.124814:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:1.0:1746147175.124815:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5220 00010000:00010000:0.0:1746147175.124821:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:1.0:1746147175.124826:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5222 00000100:00100000:1.0:1746147175.124829:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463342080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.124830:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f92f200/0xb4b2209fbdac41f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5170 expref: 16 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:1.0:1746147175.124834:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.124840:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147175.124841:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 13 pid: 11147 timeout: 662 lvb_type: 1 00010000:00010000:1.0:1746147175.124852:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 13 pid: 11147 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.124853:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463342464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.124858:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5221 00000100:00100000:0.0:1746147175.124866:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5223 00010000:00010000:1.0:1746147175.124867:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac3d95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4eb4 expref: 13 pid: 11147 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.124869:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463342336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.124874:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147175.124877:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147175.124878:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 28 pid: 6881 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.124885:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 28 pid: 6881 timeout: 662 lvb_type: 1 00000100:00100000:1.0:1746147175.124888:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463342080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.124893:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5222 00010000:00010000:0.0:1746147175.124893:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013673f000/0xb4b2209fbdac4043 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5043 expref: 28 pid: 6881 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.124903:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.124912:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463342336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.124916:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5223 00000100:00080000:0.0:1746147175.124929:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147175.128894:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e45c000/0xb4b2209fbdac3e67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f1d expref: 31 pid: 17548 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.128909:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466252544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147175.146008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146044:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343360 00000100:00100000:0.0:1746147175.146051:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343360 00010000:00010000:0.0:1746147175.146079:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.146097:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342720 00000100:00100000:0.0:1746147175.146099:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342720 00010000:00010000:0.0:1746147175.146106:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e517e expref: 13 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.146118:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5224 00000100:00100000:0.0:1746147175.146123:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463343360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146135:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146150:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146160:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146177:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136966400/0xb4b2209fbdac3fbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5004 expref: 12 pid: 6881 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146191:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146192:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146196:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146203:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146217:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146246:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463343360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146251:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5224 00000100:00100000:0.0:1746147175.146261:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5225 00000100:00100000:0.0:1746147175.146265:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463342720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146271:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146280:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e517e expref: 13 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146286:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f92fa00/0xb4b2209fbdac420a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e517e expref: 13 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146301:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146309:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463342720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146313:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5225 00000100:00100000:0.0:1746147175.146353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146362:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342976 00000100:00100000:0.0:1746147175.146365:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342976 00010000:00010000:0.0:1746147175.146373:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f400/0xb4b2209fbdac41bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e514d expref: 27 pid: 4444 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.146382:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5226 00000100:00100000:0.0:1746147175.146386:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463342976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146390:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146396:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f400/0xb4b2209fbdac41bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e514d expref: 27 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146403:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f400/0xb4b2209fbdac41bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e514d expref: 27 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146411:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146420:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463342976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 33us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146423:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5226 00000100:00100000:0.0:1746147175.146457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146479:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463342848 00000100:00100000:0.0:1746147175.146482:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463342848 00010000:00010000:0.0:1746147175.146490:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ead expref: 18 pid: 11147 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.146501:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5227 00000100:00100000:0.0:1746147175.146504:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463342848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146509:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146514:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ead expref: 18 pid: 11147 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146521:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f660800/0xb4b2209fbdac3d8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ead expref: 18 pid: 11147 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146528:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146529:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146531:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a474000/0xb4b2209fbdac4281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146537:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a474000/0xb4b2209fbdac4281 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146544:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146553:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463342848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146557:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5227 00000100:00100000:0.0:1746147175.146580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146587:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343104 00000100:00100000:0.0:1746147175.146589:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343104 00010000:00010000:0.0:1746147175.146596:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdac3e6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f24 expref: 27 pid: 8478 timeout: 662 lvb_type: 1 00000100:00100000:0.0:1746147175.146605:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5228 00000100:00100000:0.0:1746147175.146608:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463343104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146613:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146620:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdac3e6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f24 expref: 27 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146626:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdac3e6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f24 expref: 27 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146634:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99ea00/0xb4b2209fbdac3e6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f24 expref: 27 pid: 8478 timeout: 662 lvb_type: 1 00010000:00010000:0.0:1746147175.146640:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146641:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.146643:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146649:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.146657:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146665:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463343104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146669:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5228 00000100:00100000:0.0:1746147175.146711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.146720:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343488 00000100:00100000:0.0:1746147175.146722:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343488 00010000:00010000:0.0:1746147175.146729:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a475600/0xb4b2209fbdac41a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5131 expref: 26 pid: 6881 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.146739:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5229 00000100:00100000:0.0:1746147175.146742:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463343488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.146747:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.146752:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a475600/0xb4b2209fbdac41a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5131 expref: 26 pid: 6881 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146759:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a475600/0xb4b2209fbdac41a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5131 expref: 26 pid: 6881 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146766:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.146775:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463343488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 33us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.146779:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5229 00000100:00100000:0.0:1746147175.146837:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343232 00000100:00100000:0.0:1746147175.146840:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343232 00002000:00100000:0.0:1746147175.146856:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4390911) req@ffff88008d5dea00 x1830967463343232/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:551/0 lens 488/0 e 0 to 0 dl 1746147186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147175.146864:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463343232 ext(4194304->4390911) 00010000:00010000:0.0:1746147175.146868:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.146876:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00002000:00010000:0.0:1746147175.146881:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dea00 00000100:00100000:0.0:1746147175.146890:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1398 00000100:00100000:0.0:1746147175.146894:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463343232:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147175.147139:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147146:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147161:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147166:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147172:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147177:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef4b400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147175.147180:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147185:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147197:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147202:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef4b400/0xb4b2209fbdac427a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.147233:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463340800:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 38981us (39868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.147238:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10743 00010000:00010000:0.0:1746147175.147282:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147288:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147298:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147303:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147308:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147312:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4ae000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147175.147314:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147320:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147327:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.147331:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae000/0xb4b2209fbdac426c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.147352:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463341184:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 39498us (40033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.147356:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10741 00000100:00100000:0.0:1746147175.155807:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463343232:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8903us (9339us total) trans 21474840442 rc 0/0 00000100:00100000:0.0:1746147175.155818:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1398 00002000:00100000:0.0:1746147175.155829:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4390911) req@ffff88008d5dea00 x1830967463343232/t21474840442(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:551/0 lens 488/448 e 0 to 0 dl 1746147186 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147175.155837:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463343232 ext(4194304->4390911) 00010000:00010000:0.0:1746147175.155846:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.155858:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00002000:00010000:0.0:1746147175.155864:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dea00 00000100:00100000:0.0:1746147175.163170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.163259:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343616 00000100:00100000:0.0:1746147175.163266:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343616 00010000:00010000:0.0:1746147175.163294:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.163319:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5230 00000100:00100000:0.0:1746147175.163325:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463343616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.163337:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.163352:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.163361:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.163378:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a474e00/0xb4b2209fbdac41b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5146 expref: 26 pid: 4444 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.163390:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.163392:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.163396:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a475400/0xb4b2209fbdac4288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.163403:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a475400/0xb4b2209fbdac4288 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.164440:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147175.164846:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463343616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1518us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.164853:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5230 00000100:00100000:0.0:1746147175.168760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.168848:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463343744 00000100:00100000:1.0:1746147175.168857:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463343744 00010000:00010000:1.0:1746147175.168886:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0xb4b2209fbdac41af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e513f expref: 32 pid: 4444 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.171709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.176437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.176453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.176770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.176864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.176889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.176984:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463344768 00000100:00100000:0.0:1746147175.176990:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463344768 00000100:00100000:0.0:1746147175.177001:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463344512 00000100:00100000:0.0:1746147175.177003:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463344512 00010000:00010000:0.0:1746147175.177027:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 20 pid: 16361 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.177045:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463344896 00000100:00100000:0.0:1746147175.177046:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463344896 00010000:00010000:0.0:1746147175.177053:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f39 expref: 316 pid: 14125 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.177071:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5232 00000100:00100000:0.0:1746147175.177077:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463344512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.177090:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.177095:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 20 pid: 16361 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177103:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 20 pid: 16361 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177120:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41800/0xb4b2209fbdac3ec9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f55 expref: 20 pid: 16361 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177130:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147175.177134:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d679e00/0xb4b2209fbdac428f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147175.177142:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.177174:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463344512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.177179:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5232 00000100:00100000:0.0:1746147175.177193:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5233 00000100:00100000:0.0:1746147175.177198:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1959:x1830967463344896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.177204:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.177208:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f39 expref: 316 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177215:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f39 expref: 316 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177225:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac3e8a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f39 expref: 316 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177232:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147175.177235:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d679e00/0xb4b2209fbdac428f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147175.177240:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.177253:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1959:x1830967463344896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.177258:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5233 00010000:00010000:0.0:1746147175.177277:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 314 pid: 14049 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.177292:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5234 00000100:00100000:0.0:1746147175.177296:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1959:x1830967463344768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.177302:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.177306:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 314 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177312:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 314 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177320:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac3e91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4f40 expref: 314 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.177328:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147175.177330:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d679e00/0xb4b2209fbdac428f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147175.177334:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147175.177344:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1959:x1830967463344768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.177348:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5234 00000100:00100000:1.0:1746147175.177798:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463344128 00000100:00100000:1.0:1746147175.177802:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463344128 00010000:00010000:1.0:1746147175.177815:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 20 pid: 14125 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.177828:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5235 00000100:00100000:1.0:1746147175.177833:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463344128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147175.177839:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147175.177842:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 20 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.177850:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 20 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.177860:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4600/0xb4b2209fbdac4115 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e50e4 expref: 20 pid: 14125 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.177871:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147175.177874:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d679e00/0xb4b2209fbdac428f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147175.177878:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147175.177898:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463344128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.177903:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5235 00000100:00100000:1.0:1746147175.177981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.177993:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463344256 00000100:00100000:1.0:1746147175.177995:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463344256 00010000:00010000:1.0:1746147175.178004:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 313 pid: 14049 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.178019:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5236 00000100:00100000:1.0:1746147175.178024:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1957:x1830967463344256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147175.178029:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147175.178032:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 313 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.178039:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 313 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.178049:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc9b800/0xb4b2209fbdac4012 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5035 expref: 313 pid: 14049 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.178056:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147175.178060:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d679e00/0xb4b2209fbdac428f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147175.178064:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147175.178077:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1957:x1830967463344256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.178082:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5236 00000100:00100000:0.0:1746147175.180349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.219455:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219486:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219520:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147175.219534:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219543:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219562:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147175.219575:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219582:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466256128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219593:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219604:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746147175.219608:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147175.219621:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219631:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219644:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219652:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219663:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219670:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466256000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147175.219690:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147175.219709:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466254080 00000100:00100000:0.0:1746147175.219715:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466254080 00000100:00100000:0.0:1746147175.219774:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466254592 00000100:00100000:0.0:1746147175.219776:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466254592 00000100:00100000:0.0:1746147175.219784:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466255104 00000100:00100000:0.0:1746147175.219786:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466255104 00000100:00100000:0.0:1746147175.219791:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466255616 00000100:00100000:0.0:1746147175.219793:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466255616 00000100:00100000:0.0:1746147175.219798:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466256128 00000100:00100000:0.0:1746147175.219799:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466256128 00000100:00100000:0.0:1746147175.219804:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466254464 00000100:00100000:0.0:1746147175.219806:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466254464 00000100:00100000:0.0:1746147175.219829:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466254976 00000100:00100000:0.0:1746147175.219831:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466254976 00000100:00100000:0.0:1746147175.219837:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466255488 00000100:00100000:0.0:1746147175.219838:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466255488 00000100:00100000:0.0:1746147175.219843:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466256000 00000100:00100000:0.0:1746147175.219845:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466256000 00000100:00100000:0.0:1746147175.219852:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10754 00000100:00100000:0.0:1746147175.219857:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830967466254080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.219984:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466254080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (497us total) trans 21474840447 rc 0/0 00000100:00100000:0.0:1746147175.219990:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10754 00000100:00100000:0.0:1746147175.220000:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10755 00000100:00100000:0.0:1746147175.220004:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830967466254592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147175.220071:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147175.220074:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220076:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147175.220078:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220080:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1746147175.220095:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830967466254592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (560us total) trans 17179873060 rc 0/0 00000100:00100000:0.0:1746147175.220100:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10755 00000100:00100000:0.0:1746147175.220108:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10756 00000100:00100000:0.0:1746147175.220112:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830967466255104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147175.220167:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147175.220170:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220171:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147175.220173:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220175:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147175.220190:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466255104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (634us total) trans 21474840448 rc 0/0 00000100:00100000:0.0:1746147175.220195:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10756 00000100:00100000:0.0:1746147175.220203:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10757 00000100:00100000:0.0:1746147175.220207:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830967466255616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147175.220266:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147175.220268:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220270:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147175.220271:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1746147171 -> 1746147171 00002000:00010000:0.0:1746147175.220273:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147175.220288:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830967466255616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (712us total) trans 17179873061 rc 0/0 00000100:00100000:0.0:1746147175.220293:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10757 00000100:00100000:0.0:1746147175.220302:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10758 00000100:00100000:0.0:1746147175.220306:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830967466256128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147175.220364:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147175.220366:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147175.220368:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147175.220370:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147172 -> 1746147172 00002000:00010000:0.0:1746147175.220372:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1349 -> 1349 00000100:00100000:0.0:1746147175.220394:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3296:x1830967466256128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (800us total) trans 21474840449 rc 0/0 00000100:00100000:0.0:1746147175.220399:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10758 00000100:00100000:0.0:1746147175.220407:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10759 00000100:00100000:0.0:1746147175.220411:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830967466254464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147175.221489:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830967466254464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1075us (1864us total) trans 17179873063 rc 0/0 00000100:00100000:0.0:1746147175.221495:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10759 00000100:00100000:0.0:1746147175.221816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:1.0:1746147175.222416:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02d80/2, rc 0, transno 17179873063 00000100:00100000:1.0:1746147175.222422:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147175.222432:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2d80/2, rc 0, transno 21474840450 00000100:00100000:1.0:1746147175.222435:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147175.222442:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3800/2, rc 0, transno 21474840451 00000100:00100000:1.0:1746147175.222444:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147175.222451:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509180/2, rc 0, transno 17179873062 00000100:00100000:1.0:1746147175.222453:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466256000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147175.222461:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f0700/2, rc 0, transno 21474840447 00000100:00100000:1.0:1746147175.222463:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147175.222469:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03800/2, rc 0, transno 17179873060 00000100:00100000:1.0:1746147175.222471:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466254592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147175.222477:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2a00/2, rc 0, transno 21474840448 00000100:00100000:1.0:1746147175.222480:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147175.222486:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02680/2, rc 0, transno 17179873061 00000100:00100000:1.0:1746147175.222488:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466255616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147175.222494:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2680/2, rc 0, transno 21474840449 00000100:00100000:1.0:1746147175.222496:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466256128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147175.240539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.248006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.248077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.251390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.251422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.251628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.252081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.252243:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463345536 00000100:00100000:1.0:1746147175.252247:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463345536 00000100:00100000:1.0:1746147175.252263:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463345792 00000100:00100000:1.0:1746147175.252265:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463345792 00000100:00100000:1.0:1746147175.252273:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463346048 00000100:00100000:1.0:1746147175.252274:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463346048 00000100:00100000:1.0:1746147175.252285:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10765 00000100:00100000:1.0:1746147175.252291:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463345920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147175.252305:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147175.252319:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a200/0xb4b2209fbdac42b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51e7 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147175.252337:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4870144, mtime: 0x68141766, atime: 0x68141766, ctime: 0x68141766, blocks: 0x156b 00010000:00010000:1.0:1746147175.252351:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252353:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252360:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a200/0xb4b2209fbdac42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51e7 expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252372:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a200/0xb4b2209fbdac42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51e7 expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252381:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef4a200, rc 0) 00000100:00100000:1.0:1746147175.252416:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463345920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 124us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.252422:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10765 00000100:00100000:1.0:1746147175.252435:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10766 00000100:00100000:1.0:1746147175.252439:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463345536:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147175.252446:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147175.252455:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef4aa00/0xb4b2209fbdac42c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51d2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147175.252466:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x68141765, atime: 0x68141761, ctime: 0x68141765, blocks: 0x81d 00010000:00010000:1.0:1746147175.252473:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252475:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252478:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef4aa00/0xb4b2209fbdac42c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51d2 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252486:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef4aa00/0xb4b2209fbdac42c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51d2 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252492:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef4aa00, rc 0) 00000100:00100000:1.0:1746147175.252504:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463345536:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 65us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.252510:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10766 00000100:00100000:1.0:1746147175.252520:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10767 00000100:00100000:1.0:1746147175.252524:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463345792:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147175.252529:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147175.252535:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a600/0xb4b2209fbdac42c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51e0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147175.252543:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141760, atime: 0x6814175f, ctime: 0x68141760, blocks: 0x81f 00010000:00010000:1.0:1746147175.252549:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252550:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252554:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a600/0xb4b2209fbdac42c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51e0 expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252561:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef4a600/0xb4b2209fbdac42c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51e0 expref: 15 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.252567:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef4a600, rc 0) 00000100:00100000:1.0:1746147175.252579:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463345792:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 55us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.252583:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10767 00000100:00100000:1.0:1746147175.252593:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10768 00000100:00100000:1.0:1746147175.252597:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463346048:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147175.252601:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147175.252607:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51ee expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147175.252619:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141766, atime: 0x68141766, ctime: 0x68141766, blocks: 0x1029 00010000:00010000:1.0:1746147175.252625:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252626:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.252629:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.253718:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147175.253727:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef4a000, rc 0) 00000100:00100000:1.0:1746147175.253762:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463346048:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1158us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.253767:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10768 00000100:00100000:0.0:1746147175.269307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.269349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.272803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.272828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.272844:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463346944 00000100:00100000:0.0:1746147175.272852:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463346944 00000100:00100000:0.0:1746147175.272902:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463347072 00000100:00100000:0.0:1746147175.272905:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463347072 00000100:00100000:0.0:1746147175.272921:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3951 00000100:00100000:0.0:1746147175.272927:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463346944:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147175.272968:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac42e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.272978:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.272980:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.272983:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac42e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.272993:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92f800/0xb4b2209fbdac42e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.273381:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3952 00000100:00100000:1.0:1746147175.273388:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463347072:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147175.273405:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.273412:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.273414:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.273417:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.273425:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.276976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.277019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.281204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.282736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.282832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.283101:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463348352 00000100:00100000:1.0:1746147175.283104:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463348352 00000100:00100000:1.0:1746147175.283124:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3955 00000100:00100000:1.0:1746147175.283130:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+22:1957:x1830967463347840:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147175.283162:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.283173:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.283175:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.283180:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.283191:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.284144:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3956 00000100:00100000:1.0:1746147175.284151:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463348096:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147175.284168:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.284175:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.284176:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.284179:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.284187:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298408:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298421:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298427:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298433:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f408a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147175.298437:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298443:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298459:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.298464:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac42ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.298547:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463347072:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 25155us (25714us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147175.298556:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3952 00010000:00010000:0.0:1746147175.315743:0:8486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315757:0:8486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315764:0:8486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315769:0:8486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b8800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147175.315772:0:8486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315780:0:8486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315794:0:8486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.315799:0:8486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac42f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.316905:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463347584:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 38537us (39880us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147175.316914:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3954 00010000:00010000:1.0:1746147175.318692:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318707:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318714:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318719:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9f600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147175.318722:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318729:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318744:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.318750:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac42ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.318811:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463347840:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 35679us (37611us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147175.318818:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3955 00010000:00010000:1.0:1746147175.326397:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326410:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326421:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326427:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9f800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147175.326429:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326435:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326447:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.326451:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4306 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.326511:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463348096:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 42357us (43775us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147175.326520:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3956 00000100:00100000:0.0:1746147175.331279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.331325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.331737:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3959 00000100:00100000:1.0:1746147175.331743:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463348864:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:1.0:1746147175.331759:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.331766:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.331767:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.331770:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.331776:0:1351:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.334476:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463349120 00000100:00100000:1.0:1746147175.334482:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463349120 00010000:00010000:1.0:1746147175.334504:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4715a00/0xb4b2209fbdac3ac4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cc3 expref: 31 pid: 17530 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.334520:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463348992 00000100:00100000:1.0:1746147175.334522:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463348992 00010000:00010000:1.0:1746147175.334529:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 17 pid: 4445 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.334540:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5238 00000100:00100000:1.0:1746147175.334546:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463349120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147175.334555:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147175.334572:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4715a00/0xb4b2209fbdac3ac4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cc3 expref: 31 pid: 17530 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.334581:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4715a00/0xb4b2209fbdac3ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cc3 expref: 31 pid: 17530 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.334599:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147175.334627:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463349120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.334636:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5238 00000100:00100000:1.0:1746147175.334651:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5239 00000100:00100000:1.0:1746147175.334655:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463348992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147175.334661:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147175.334667:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 17 pid: 4445 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.334675:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 17 pid: 4445 timeout: 662 lvb_type: 0 00010000:00010000:1.0:1746147175.334694:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.334695:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.334699:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e037000/0xb4b2209fbdac4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.334706:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e037000/0xb4b2209fbdac4314 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.334712:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.334713:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147175.334715:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.334720:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.334734:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147175.334748:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463348992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147175.334753:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5239 00010000:00010000:1.0:1746147175.334794:0:1351:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.334800:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.335017:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095370600/0xb4b2209fbdac3aee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ced expref: 16 pid: 4445 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.335037:0:21473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f819180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21473:1830967466256256:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147175.335046:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4715a00/0xb4b2209fbdac3ac4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4cc3 expref: 30 pid: 17530 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.335053:0:21473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f818700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21473:1830967466256384:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147175.335067:0:21473:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e037000/0xb4b2209fbdac4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.335073:0:21473:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e037000/0xb4b2209fbdac4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.335078:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e037000/0xb4b2209fbdac4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147175.439146:0:1351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147171 -> 1746147175 00010000:00010000:1.0:1746147175.439158:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439169:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439178:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439184:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9fe00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147175.439187:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439194:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439209:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.439214:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac431b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.439282:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463348864:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 107535us (107953us total) trans 17179873064 rc 0/0 00000100:00100000:1.0:1746147175.439291:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3959 00000100:00100000:0.0:1746147175.485278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.485477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.485507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.485531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.485551:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463349632 00000100:00100000:0.0:1746147175.485559:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463349632 00000100:00100000:0.0:1746147175.485912:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463349888 00000100:00100000:0.0:1746147175.485915:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463349888 00000100:00100000:1.0:1746147175.485961:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463349376 00000100:00100000:1.0:1746147175.485964:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463349376 00000100:00100000:1.0:1746147175.486157:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463350016 00000100:00100000:1.0:1746147175.486160:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463350016 00000100:00100000:0.0:1746147175.486503:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3961 00000100:00100000:0.0:1746147175.486509:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463349888:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147175.486526:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdac4329 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486536:0:8486:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac3a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c76 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486541:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147175.486542:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147175.486544:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdac4329 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486558:0:8486:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac3a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c76 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486565:0:8486:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b94be00/0xb4b2209fbdac3a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c76 expref: 16 pid: 8480 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.486573:0:8486:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8486:1830967466256640:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147175.486598:0:8486:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147175.486611:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3962 00000100:00100000:0.0:1746147175.486615:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463349376:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147175.486626:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486632:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.486633:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.486635:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.486641:0:8484:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.487087:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3963 00000100:00100000:0.0:1746147175.487093:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463350016:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147175.487107:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008dac4e00/0xb4b2209fbdac4337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.487113:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147175.487114:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147175.487116:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dac4e00/0xb4b2209fbdac4337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.487121:0:11283:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008dac4e00/0xb4b2209fbdac4337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.489337:0:8486:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090743100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8486:1830967466256640:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147175.489355:0:8486:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d5c1600/0xb4b2209fbdac4329 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.489882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.489963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147175.490339:0:8484:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.490347:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.492097:0:11283:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008dac4e00/0xb4b2209fbdac4337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.492109:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dac4e00/0xb4b2209fbdac4337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667352:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667362:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667366:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667371:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d5c1e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147175.667375:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667381:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667396:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.667402:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5c1e00/0xb4b2209fbdac4330 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147175.667477:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463349376:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 180858us (181965us total) trans 17179873067 rc 0/0 00000100:00100000:1.0:1746147175.667484:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3962 00000100:00100000:1.0:1746147175.712731:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3965 00000100:00100000:1.0:1746147175.712738:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463350784:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:1.0:1746147175.712763:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.712774:0:8484:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.712778:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147175.712779:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147175.712781:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.712806:0:8484:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 12 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.712813:0:8484:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 12 pid: 8480 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.712821:0:8484:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:8484:1830967466256768:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147175.712873:0:8484:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c9da180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147175.718541:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463351168 00000100:00100000:0.0:1746147175.718552:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463351168 00010000:00010000:0.0:1746147175.718583:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 13 pid: 8480 timeout: 662 lvb_type: 0 00000100:00100000:0.0:1746147175.718618:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5242 00000100:00100000:0.0:1746147175.718627:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463351168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147175.718640:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147175.718746:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 13 pid: 8480 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.718757:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 13 pid: 8480 timeout: 662 lvb_type: 0 00010000:00010000:0.0:1746147175.718777:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.718779:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147175.718782:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.718790:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.718804:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147175.718961:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac3a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4c84 expref: 13 pid: 8480 timeout: 662 lvb_type: 0 00000100:00100000:1.0:1746147175.718977:0:8484:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:8484:1830967466256768:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147175.718990:0:8484:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.718997:0:8484:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147175.719003:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac433e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.719637:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463351168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1011us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147175.719643:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5242 00010000:00010000:0.0:1746147175.801095:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746147175.814401:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840454 is committed 00002000:00010000:0.0:1746147175.817229:0:11283:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147171 -> 1746147175 00002000:00010000:0.0:1746147175.817233:0:11283:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147171 -> 1746147175 00010000:00010000:0.0:1746147175.817242:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817251:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817257:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817263:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72e200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147175.817266:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817273:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817286:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147175.817291:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac4345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147175.817351:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463350912:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 104673us (104877us total) trans 17179873068 rc 0/0 00000100:00100000:0.0:1746147175.817359:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3964 00000100:00100000:0.0:1746147175.820660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.825497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.906624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.909556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.909578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147175.909609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147175.910433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:1.0:1746147175.964103:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840455 is committed 00010000:00010000:1.0:1746147176.008882:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008890:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008895:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008899:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab5e400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147176.008901:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008906:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008914:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.008918:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5e400/0xb4b2209fbdac4361 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.008979:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463352064:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 98982us (99429us total) trans 21474840456 rc 0/0 00000100:00100000:1.0:1746147176.008984:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3969 00000001:00080000:1.0:1746147176.009001:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840458 is committed 00000100:00100000:0.0:1746147176.017089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.022654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.022719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.022750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.022773:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463353216 00000100:00100000:0.0:1746147176.022780:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463353216 00010000:00010000:0.0:1746147176.022810:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33600/0xb4b2209fbdac3a3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ca0 expref: 12 pid: 8478 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.022833:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5246 00000100:00100000:0.0:1746147176.022840:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463353216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.022852:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.022870:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e33600/0xb4b2209fbdac3a3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ca0 expref: 12 pid: 8478 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.022880:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e33600/0xb4b2209fbdac3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e4ca0 expref: 12 pid: 8478 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.022901:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.022903:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.022907:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d607200/0xb4b2209fbdac436f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.022915:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d607200/0xb4b2209fbdac436f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.022930:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.023362:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463353216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 520us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.023368:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5246 00000100:00100000:0.0:1746147176.023416:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463352960 00000100:00100000:0.0:1746147176.023419:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463352960 00000100:00100000:0.0:1746147176.023439:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463353088 00000100:00100000:0.0:1746147176.023440:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463353088 00000100:00100000:0.0:1746147176.023453:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3972 00000100:00100000:0.0:1746147176.023457:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463352960:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147176.023477:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac4376 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.023484:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.023486:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.023488:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac4376 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.023496:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac4376 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.024893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147176.144652:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840459 is committed 00000001:00080000:0.0:1746147176.144665:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840461 is committed 00000100:00100000:0.0:1746147176.192159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.261497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.266302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.266352:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463354240 00000100:00100000:0.0:1746147176.266361:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463354240 00000100:00100000:0.0:1746147176.266412:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10769 00000100:00100000:0.0:1746147176.266419:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+9:28421:x1830967463354240:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.266433:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.266447:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51f5 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.266465:0:21080:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41b:0x0] initial LVB size: 2097152, mtime: 0x68141767, atime: 0x0, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1746147176.266483:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.266485:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.266491:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.266503:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.266511:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca200, rc 0) 00000100:00100000:0.0:1746147176.266557:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:28421:x1830967463354240:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 138us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.266563:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10769 00000100:00100000:0.0:1746147176.272631:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463354368 00000100:00100000:0.0:1746147176.272640:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463354368 00000100:00100000:0.0:1746147176.272696:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10770 00000100:00100000:0.0:1746147176.272702:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:28421:x1830967463354368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.272718:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.272735:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e51fc expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.272754:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41f:0x0] initial LVB size: 3145728, mtime: 0x68141767, atime: 0x0, ctime: 0x68141767, blocks: 0x1029 00010000:00010000:0.0:1746147176.272772:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.272774:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.272780:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51fc expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.272792:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51fc expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.272801:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca000, rc 0) 00000100:00100000:0.0:1746147176.272851:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:28421:x1830967463354368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.272857:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10770 00000100:00100000:1.0:1746147176.282177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.291697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.291770:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463354624 00000100:00100000:0.0:1746147176.291779:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463354624 00000100:00100000:0.0:1746147176.291832:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10772 00000100:00100000:0.0:1746147176.291840:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:28421:x1830967463354624:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.291856:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.291872:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0400/0xb4b2209fbdac43ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e520a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.291891:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x420:0x0] initial LVB size: 4194304, mtime: 0x68141767, atime: 0x0, ctime: 0x68141767, blocks: 0x81f 00010000:00010000:0.0:1746147176.291909:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.291910:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.291916:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0400/0xb4b2209fbdac43ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e520a expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.291929:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0400/0xb4b2209fbdac43ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e520a expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.291968:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e0400, rc 0) 00000100:00100000:0.0:1746147176.292010:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:28421:x1830967463354624:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 171us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.292015:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10772 00000100:00100000:1.0:1746147176.294885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.296320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.296360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.300194:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463355264 00000100:00100000:0.0:1746147176.300202:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463355264 00000100:00100000:0.0:1746147176.300249:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10290 00000100:00100000:0.0:1746147176.300256:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28421:x1830967463355264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.300276:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.300291:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e0600/0xb4b2209fbdac43c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e521f expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.300354:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e1600/0xb4b2209fbdac43ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.300365:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e1600/0xb4b2209fbdac43ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.300374:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e1600/0xb4b2209fbdac43ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147176.300393:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147176.300396:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147176.300407:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e1600/0xb4b2209fbdac43ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.300430:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e0600/0xb4b2209fbdac43c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e521f expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.300457:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e1600/0xb4b2209fbdac43ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e521f expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.300463:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:0.0:1746147176.300466:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147176.300468:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e1600, rc 0) 00000100:00100000:0.0:1746147176.300514:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:28421:x1830967463355264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 257us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.300521:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10290 00000100:00100000:1.0:1746147176.302850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.305159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.305344:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463355648 00000100:00100000:0.0:1746147176.305351:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463355648 00000100:00100000:0.0:1746147176.305390:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10775 00000100:00100000:0.0:1746147176.305397:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:28421:x1830967463355648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.305410:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.305423:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac43d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5226 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.305439:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x417:0x0] initial LVB size: 4194304, mtime: 0x68141767, atime: 0x0, ctime: 0x68141767, blocks: 0x2007 00010000:00010000:0.0:1746147176.305453:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.305455:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.305460:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac43d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5226 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.305471:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac43d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5226 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.305479:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e0800, rc 0) 00000100:00100000:0.0:1746147176.305518:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:28421:x1830967463355648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 121us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.305523:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10775 00000100:00100000:1.0:1746147176.312760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.312829:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463355904 00000100:00100000:0.0:1746147176.312839:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463355904 00000100:00100000:0.0:1746147176.312888:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10777 00000100:00100000:0.0:1746147176.312897:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:28421:x1830967463355904:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.312912:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.312928:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0e00/0xb4b2209fbdac43e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5234 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.312974:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x41e:0x0] initial LVB size: 4870144, mtime: 0x68141767, atime: 0x0, ctime: 0x68141767, blocks: 0x541 00010000:00010000:0.0:1746147176.312996:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.312997:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.313004:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0e00/0xb4b2209fbdac43e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5234 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.313017:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0e00/0xb4b2209fbdac43e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5234 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.313026:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e0e00, rc 0) 00000100:00100000:0.0:1746147176.313079:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:28421:x1830967463355904:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 184us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.313085:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10777 00000100:00100000:1.0:1746147176.319630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.319672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.319701:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463356160 00000100:00100000:0.0:1746147176.319710:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463356160 00002000:00010000:0.0:1746147176.319741:0:21472:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1058 (4194304->18446744073709551615) 00002000:00100000:0.0:1746147176.319745:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967463356160 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1746147176.319754:0:21472:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480. 00000100:00100000:0.0:1746147176.320925:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3978 00000100:00100000:0.0:1746147176.320950:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463356160:12345-192.168.203.36@tcp:10:lfs.0 00002000:00010000:0.0:1746147176.321193:0:21472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147176.321196:0:21472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147172 -> 1746147176 00002000:00010000:0.0:1746147176.321198:0:21472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.321199:0:21472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147172 -> 1746147176 00002000:00010000:0.0:1746147176.321201:0:21472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147176.322191:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463356160:12345-192.168.203.36@tcp:10:lfs.0 Request processed in 1255us (2565us total) trans 17179873071 rc 0/0 00000100:00100000:0.0:1746147176.322197:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3978 00002000:00010000:0.0:1746147176.322200:0:21472:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1058 (4194304->18446744073709551615) 00002000:00100000:0.0:1746147176.322203:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967463356160 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1746147176.322207:0:21472:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480. 00000100:00100000:1.0:1746147176.324126:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463356416 00000100:00100000:1.0:1746147176.324133:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463356416 00000100:00100000:1.0:1746147176.324169:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10292 00000100:00100000:1.0:1746147176.324175:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:28421:x1830967463356416:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1746147176.324239:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac43ed lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.324251:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac43ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.324259:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac43ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00010000:1.0:1746147176.324344:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009edc9180 reply state ffff8800a6283000 transno 8589944002 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4800/0xb4b2209fbdac43ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147176.324350:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147176.324409:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:28421:x1830967463356416:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 233us (346us total) trans 8589944002 rc 0/0 00000100:00100000:1.0:1746147176.324414:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10292 00000100:00100000:1.0:1746147176.326641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.329586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.333381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.336762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.341466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.346029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.351206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.354283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.358225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.361655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.373756:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463357952 00000100:00100000:0.0:1746147176.373764:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463357952 00010000:00010000:0.0:1746147176.373789:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 17 pid: 21080 timeout: 663 lvb_type: 1 00000100:00100000:0.0:1746147176.373822:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5253 00000100:00100000:0.0:1746147176.373829:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463357952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.373842:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.373859:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 16 pid: 21080 timeout: 663 lvb_type: 1 00010000:00010000:0.0:1746147176.373869:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 16 pid: 21080 timeout: 663 lvb_type: 1 00010000:00010000:0.0:1746147176.373886:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef4a000/0xb4b2209fbdac42ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51ee expref: 16 pid: 21080 timeout: 663 lvb_type: 1 00010000:00010000:0.0:1746147176.373908:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.373910:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.373915:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdac4417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e525e expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.373922:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdac4417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e525e expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.373964:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a537ea00/0xb4b2209fbdac4417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e525e expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.373974:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466258944:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.374019:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.377165:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466258944:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147176.377184:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.377232:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463357952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3402us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.377241:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5253 00000100:00100000:1.0:1746147176.378406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.379593:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463358464 00000100:00100000:0.0:1746147176.379596:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463358464 00000100:00100000:0.0:1746147176.379607:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463358720 00000100:00100000:0.0:1746147176.379608:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463358720 00000100:00100000:0.0:1746147176.379630:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463358080 00000100:00100000:0.0:1746147176.379632:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463358080 00000100:00100000:0.0:1746147176.379646:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463358336 00000100:00100000:0.0:1746147176.379648:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463358336 00000100:00100000:0.0:1746147176.379658:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10785 00000100:00100000:0.0:1746147176.379662:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463358720:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147176.379764:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147176.379767:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.379769:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.379771:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147174 -> 1746147176 00002000:00010000:0.0:1746147176.379773:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147176.379795:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463358720:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 132us (645us total) trans 17179873073 rc 0/0 00000100:00100000:1.0:1746147176.380465:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10787 00000100:00100000:1.0:1746147176.380473:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463358336:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:1.0:1746147176.380546:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147176.380549:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147173 -> 1746147174 00002000:00010000:1.0:1746147176.380551:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147173 -> 1746147174 00002000:00010000:1.0:1746147176.380553:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147173 -> 1746147176 00002000:00010000:1.0:1746147176.380555:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147176.380572:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463358336:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 100us (1171us total) trans 17179873074 rc 0/0 00000100:00100000:1.0:1746147176.380578:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10787 00000100:00100000:0.0:1746147176.380987:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10785 00000100:00100000:0.0:1746147176.381019:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10789 00000100:00100000:0.0:1746147176.381023:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463358464:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147176.381094:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147176.381096:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147168 -> 1746147174 00002000:00010000:0.0:1746147176.381098:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147167 -> 1746147174 00002000:00010000:0.0:1746147176.381100:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147168 -> 1746147176 00002000:00010000:0.0:1746147176.381102:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147176.381128:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463358464:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 104us (1993us total) trans 21474840468 rc 0/0 00000100:00100000:0.0:1746147176.381134:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10789 00000100:00100000:0.0:1746147176.383206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.385598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147176.387588:0:14050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac441e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00010000:00010000:0.0:1746147176.387595:0:14050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac441e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00000040:00080000:0.0:1746147176.388272:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2806, 88 off232632 00000004:00080000:0.0:1746147176.388278:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375340725ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388348:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2770, 88 off229464 00000004:00080000:0.0:1746147176.388353:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375415649ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388393:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2771, 88 off229552 00000004:00080000:0.0:1746147176.388397:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375459302ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388404:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2807, 88 off232720 00000004:00080000:0.0:1746147176.388406:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375469227ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388425:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2808, 88 off232808 00000004:00080000:0.0:1746147176.388428:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375490548ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388435:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2772, 88 off229640 00000004:00080000:0.0:1746147176.388437:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375500238ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388444:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2773, 88 off229728 00000004:00080000:0.0:1746147176.388533:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375595419ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388555:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2774, 88 off229816 00000004:00080000:0.0:1746147176.388558:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375620464ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388565:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2809, 88 off232896 00000004:00080000:0.0:1746147176.388568:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375630908ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388587:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2775, 88 off229904 00000004:00080000:0.0:1746147176.388590:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375652745ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388597:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2810, 88 off232984 00000004:00080000:0.0:1746147176.388599:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375662189ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388610:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2776, 88 off229992 00000004:00080000:0.0:1746147176.388613:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375675909ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.388619:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2811, 88 off233072 00000004:00080000:0.0:1746147176.388622:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375684684ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388744:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2812, 88 off233160 00000004:00080000:0.0:1746147176.388748:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375811329ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388757:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2813, 88 off233248 00000004:00080000:0.0:1746147176.388760:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375822839ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388766:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2814, 88 off233336 00000004:00080000:0.0:1746147176.388768:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563375831324ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.388777:0:14050:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2777, 88 off230080 00000004:00080000:0.0:1746147176.388781:0:14050:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563375843517ns, next at 537465048041ns, rc = 0 00000004:00010000:1.0:1746147176.423454:0:14050:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fa95f80 reply state ffff880093b6a800 transno 8589944003 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a537ee00/0xb4b2209fbdac441e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14050 initiator: MDT0 00000100:00100000:1.0:1746147176.423467:0:14050:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147176.423477:0:14050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88012bf5d000) 00010000:00010000:1.0:1746147176.423479:0:14050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147176.423485:0:14050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0xb4b2209fbdac4257 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51b6 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.423576:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:28421:x1830967463358976:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 40283us (40373us total) trans 8589944003 rc 0/0 00000100:00100000:1.0:1746147176.423584:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4030 00000100:00100000:1.0:1746147176.426538:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466260224 00000100:00100000:1.0:1746147176.426543:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466260224 00000100:00100000:1.0:1746147176.426558:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466260736 00000100:00100000:1.0:1746147176.426559:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466260736 00000100:00100000:1.0:1746147176.426577:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10799 00000100:00100000:1.0:1746147176.426582:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967466260352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.426698:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147176.426701:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:1.0:1746147176.426703:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:1.0:1746147176.426704:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.426705:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147176.426731:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830967466260352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (238us total) trans 21474840469 rc 0/0 00000100:00100000:1.0:1746147176.426736:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10799 00000100:00100000:1.0:1746147176.426746:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10800 00000100:00100000:1.0:1746147176.426750:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830967466260864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.427820:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147176.427823:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.427825:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.427826:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.427828:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147176.427854:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967466260864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1104us (1344us total) trans 21474840470 rc 0/0 00000100:00100000:1.0:1746147176.427859:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10800 00000100:00100000:1.0:1746147176.427893:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840451 gen 2 00000004:00080000:1.0:1746147176.427896:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671500, transno 21474840380 00000004:00080000:1.0:1746147176.427902:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671880, transno 21474840381 00000004:00080000:1.0:1746147176.427904:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4670a80, transno 21474840382 00000004:00080000:1.0:1746147176.427906:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4672a00, transno 21474840383 00000004:00080000:1.0:1746147176.427908:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e682680, transno 21474840384 00000004:00080000:1.0:1746147176.427910:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4673800, transno 21474840385 00000004:00080000:1.0:1746147176.427912:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4671f80, transno 21474840386 00000004:00080000:1.0:1746147176.427914:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4670000, transno 21474840387 00000004:00080000:1.0:1746147176.427916:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4672680, transno 21474840388 00000004:00080000:1.0:1746147176.427918:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e586d80, transno 21474840389 00000004:00080000:1.0:1746147176.427920:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e586680, transno 21474840390 00000004:00080000:1.0:1746147176.427921:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f368e00, transno 21474840391 00000004:00080000:1.0:1746147176.427923:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e587800, transno 21474840392 00000004:00080000:1.0:1746147176.427925:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e584700, transno 21474840393 00000004:00080000:1.0:1746147176.427926:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6b9880, transno 21474840394 00000004:00080000:1.0:1746147176.427928:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e585880, transno 21474840395 00000004:00080000:1.0:1746147176.427930:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b209c00, transno 21474840396 00000004:00080000:1.0:1746147176.427931:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6b8a80, transno 21474840397 00000004:00080000:1.0:1746147176.427933:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc96680, transno 21474840399 00000004:00080000:1.0:1746147176.427946:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc94e00, transno 21474840400 00000004:00080000:1.0:1746147176.427948:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc96d80, transno 21474840401 00000004:00080000:1.0:1746147176.427950:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc96300, transno 21474840402 00000004:00080000:1.0:1746147176.427952:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc95880, transno 21474840403 00000004:00080000:1.0:1746147176.427954:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc97800, transno 21474840404 00000004:00080000:1.0:1746147176.427956:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc94000, transno 21474840405 00000004:00080000:1.0:1746147176.427958:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc94380, transno 21474840406 00000004:00080000:1.0:1746147176.427960:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc94700, transno 21474840407 00000004:00080000:1.0:1746147176.427963:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8380, transno 21474840409 00000004:00080000:1.0:1746147176.427964:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9180, transno 21474840410 00000004:00080000:1.0:1746147176.427966:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8700, transno 21474840411 00000004:00080000:1.0:1746147176.427968:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9f80, transno 21474840412 00000004:00080000:1.0:1746147176.427969:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cbb80, transno 21474840413 00000004:00080000:1.0:1746147176.427971:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5ca680, transno 21474840414 00000004:00080000:1.0:1746147176.427973:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d00700, transno 21474840415 00000004:00080000:1.0:1746147176.427975:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cb100, transno 21474840416 00000004:00080000:1.0:1746147176.427976:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c8e00, transno 21474840417 00000004:00080000:1.0:1746147176.427979:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9c00, transno 21474840418 00000004:00080000:1.0:1746147176.427981:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5cb480, transno 21474840419 00000004:00080000:1.0:1746147176.427983:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9500, transno 21474840420 00000004:00080000:1.0:1746147176.427985:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5f800, transno 21474840421 00000004:00080000:1.0:1746147176.427988:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5ce00, transno 21474840422 00000004:00080000:1.0:1746147176.427990:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5c9880, transno 21474840423 00000004:00080000:1.0:1746147176.427992:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e5caa00, transno 21474840424 00000004:00080000:1.0:1746147176.427994:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5f480, transno 21474840425 00000004:00080000:1.0:1746147176.427996:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5e300, transno 21474840426 00000004:00080000:1.0:1746147176.427998:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f1f80, transno 21474840427 00000004:00080000:1.0:1746147176.428000:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f0380, transno 21474840428 00000004:00080000:1.0:1746147176.428002:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f1c00, transno 21474840429 00000004:00080000:1.0:1746147176.428004:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f1880, transno 21474840430 00000004:00080000:1.0:1746147176.428005:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f2680, transno 21474840431 00000004:00080000:1.0:1746147176.428007:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f1180, transno 21474840432 00000004:00080000:1.0:1746147176.428009:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f2d80, transno 21474840433 00000004:00080000:1.0:1746147176.428011:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f3800, transno 21474840434 00000004:00080000:1.0:1746147176.428013:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a46f0e00, transno 21474840435 00000004:00080000:1.0:1746147176.428014:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2300, transno 21474840443 00000004:00080000:1.0:1746147176.428016:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3480, transno 21474840444 00000004:00080000:1.0:1746147176.428019:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f0e00, transno 21474840445 00000004:00080000:1.0:1746147176.428021:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f1500, transno 21474840446 00000004:00080000:1.0:1746147176.428023:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f0700, transno 21474840447 00000004:00080000:1.0:1746147176.428025:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2a00, transno 21474840448 00000004:00080000:1.0:1746147176.428027:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2680, transno 21474840449 00000004:00080000:1.0:1746147176.428029:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2d80, transno 21474840450 00000004:00080000:1.0:1746147176.428030:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3800, transno 21474840451 00000100:00100000:1.0:1746147176.428036:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880132e11880 x1830967466260352/t21474840469(21474840469) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147192 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147176.428044:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e11880/2, rc 0, transno 21474840469 00000100:00100000:1.0:1746147176.428047:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466260352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.428055:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260480:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.428056:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e11f80/2, rc 0, transno 21474840470 00000100:00100000:1.0:1746147176.428059:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466260864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.428064:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e10a80/2, rc 0, transno 21474840471 00000100:00100000:1.0:1746147176.428067:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466260736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.428080:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.428107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.428120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.428131:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147176.428135:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.428146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.428153:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466261120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.428163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.428178:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466260480 00000100:00100000:0.0:1746147176.428182:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466260480 00000100:00100000:0.0:1746147176.428257:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466260992 00000100:00100000:0.0:1746147176.428260:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466260992 00000100:00100000:0.0:1746147176.428267:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466260608 00000100:00100000:0.0:1746147176.428268:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466260608 00000100:00100000:0.0:1746147176.428273:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466261120 00000100:00100000:0.0:1746147176.428275:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466261120 00000100:00100000:0.0:1746147176.428281:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10802 00000100:00100000:0.0:1746147176.428285:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466260480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.428379:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147176.428381:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.428383:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.428385:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147176.428387:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:0.0:1746147176.428407:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466260480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (326us total) trans 21474840472 rc 0/0 00000100:00100000:0.0:1746147176.428412:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10802 00000100:00100000:0.0:1746147176.428422:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10803 00000100:00100000:0.0:1746147176.428425:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466260992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.428506:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147176.428508:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428510:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.428511:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428513:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147176.428530:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466260992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (409us total) trans 21474840473 rc 0/0 00000100:00100000:0.0:1746147176.428534:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10803 00000100:00100000:0.0:1746147176.428544:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10804 00000100:00100000:0.0:1746147176.428548:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466260608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.428624:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147176.428626:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428628:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.428630:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428631:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147176.428647:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466260608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (501us total) trans 21474840474 rc 0/0 00000100:00100000:0.0:1746147176.428651:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10804 00000100:00100000:0.0:1746147176.428660:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10805 00000100:00100000:0.0:1746147176.428663:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466261120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.428745:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147176.428747:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428749:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.428751:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.428753:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147176.428771:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466261120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (606us total) trans 21474840475 rc 0/0 00000100:00100000:0.0:1746147176.428776:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10805 00000100:00080000:0.0:1746147176.428790:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147176.428794:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147176.428883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:1.0:1746147176.428894:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 63 done 00000100:00100000:1.0:1746147176.428931:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463359232 00000100:00100000:1.0:1746147176.428934:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463359232 00000100:00100000:1.0:1746147176.428970:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10293 00000100:00100000:1.0:1746147176.428974:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+6:28421:x1830967463359232:12345-192.168.203.36@tcp:101:lfs.0 00000004:00080000:0.0:1746147176.428982:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e12d80/2, rc 0, transno 21474840474 00000100:00100000:0.0:1746147176.428985:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147176.428990:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e13800/2, rc 0, transno 21474840475 00000100:00100000:0.0:1746147176.428993:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466261120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147176.428998:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e10380/2, rc 0, transno 21474840472 00000100:00100000:0.0:1746147176.429001:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147176.429005:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e11500/2, rc 0, transno 21474840473 00000100:00100000:0.0:1746147176.429007:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466260992:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147176.429461:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.429476:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5265 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.429514:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.429529:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.429541:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466261248:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147176.429542:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.429544:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147176.429547:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b203c00, rc 0) 00000100:00100000:1.0:1746147176.429573:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28421:x1830967463359232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 597us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.429578:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10293 00000100:00100000:0.0:1746147176.429632:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.430158:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466261248 00000100:00100000:1.0:1746147176.430161:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466261248 00000100:00100000:1.0:1746147176.430185:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10806 00000100:00100000:1.0:1746147176.430190:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967466261248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.430255:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147176.430258:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.430259:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.430261:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.430262:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147176.430692:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1830967466261248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 501us (1059us total) trans 21474840477 rc 0/0 00000100:00100000:1.0:1746147176.430698:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10806 00000004:00080000:0.0:1746147176.432400:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e13100/2, rc 0, transno 21474840476 00000100:00100000:0.0:1746147176.432407:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466260224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147176.432427:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e12300/2, rc 0, transno 21474840477 00000100:00100000:0.0:1746147176.432430:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466261248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.436895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.453831:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463359744 00000100:00100000:1.0:1746147176.453841:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463359744 00000100:00100000:1.0:1746147176.453890:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10294 00000100:00100000:1.0:1746147176.453898:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28428:x1830967463359744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147176.453919:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.453933:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4a00/0xb4b2209fbdac442c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e526c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147176.453981:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147176.454138:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454149:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454157:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454167:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454172:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454176:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454413:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454420:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454426:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147176.454433:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147176.454498:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454508:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454513:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454518:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b0e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147176.454661:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454667:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454684:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147176.454686:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147176.454689:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454694:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac4433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454714:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454718:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454722:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454726:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147176.454728:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454734:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454739:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f100) 00010000:00010000:1.0:1746147176.454741:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147176.454742:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454746:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac443a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.454776:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3f4a00/0xb4b2209fbdac442c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e526c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.454786:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e526c expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.454791:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.454792:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147176.454794:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0200, rc 0) 00000100:00100000:1.0:1746147176.454841:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28428:x1830967463359744:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 944us (1077us total) trans 8589944005 rc 0/0 00000100:00100000:1.0:1746147176.454848:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10294 00000100:00100000:0.0:1746147176.461010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.461152:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463360000 00000100:00100000:1.0:1746147176.461163:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463360000 00000100:00100000:1.0:1746147176.461218:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10295 00000100:00100000:1.0:1746147176.461224:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463360000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147176.461246:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.461262:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdac444f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5273 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.461343:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.461354:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147176.461362:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147176.461370:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147176.461464:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdac444f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5273 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.461498:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5273 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.461505:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.461508:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147176.461511:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0a00, rc 0) 00000100:00100000:1.0:1746147176.462583:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28433:x1830967463360000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1358us (1583us total) trans 8589944006 rc 0/0 00000100:00100000:1.0:1746147176.462590:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10295 00000100:00080000:0.0:1746147176.462623:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147176.469389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.469440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.475097:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463360768 00000100:00100000:0.0:1746147176.475104:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463360768 00010000:00010000:0.0:1746147176.475257:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.475277:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5255 00000100:00100000:0.0:1746147176.475282:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463360768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.475293:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.475314:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.475325:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.475346:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4399 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51f5 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.475369:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.475371:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.475378:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4513a00/0xb4b2209fbdac4487 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5281 expref: 5 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.475386:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4513a00/0xb4b2209fbdac4487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5281 expref: 5 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.475416:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4513a00/0xb4b2209fbdac4487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5281 expref: 5 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.475427:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466261504:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.475510:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.479704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147176.479894:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147176.485478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.486962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.489438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.490707:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463361664 00000100:00100000:0.0:1746147176.490716:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463361664 00000100:00100000:1.0:1746147176.490731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:0.0:1746147176.490759:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41b:0x0] (0->1048575) req@ffff880132e12680 x1830967463361664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.490776:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463361664 ext(0->1048575) 00002000:00010000:0.0:1746147176.490782:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147176.490904:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463361792 00000100:00100000:0.0:1746147176.490907:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463361792 00002000:00100000:0.0:1746147176.490919:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41b:0x0] (1048576->2097151) req@ffff880132e12a00 x1830967463361792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.490926:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12a00 with x1830967463361792 ext(1048576->2097151) 00002000:00010000:0.0:1746147176.490929:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12a00 00000100:00100000:1.0:1746147176.491062:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3982 00000100:00100000:1.0:1746147176.491076:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463361664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147176.491081:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3983 00000100:00100000:0.0:1746147176.491087:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463361792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147176.513922:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463361664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22840us (24482us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.513962:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3982 00002000:00100000:1.0:1746147176.513976:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41b:0x0] (0->1048575) req@ffff880132e12680 x1830967463361664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.513984:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463361664 ext(0->1048575) 00002000:00010000:1.0:1746147176.513989:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147176.519927:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463361792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28831us (29189us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147176.519961:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3983 00002000:00100000:0.0:1746147176.519972:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41b:0x0] (1048576->2097151) req@ffff880132e12a00 x1830967463361792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.519980:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12a00 with x1830967463361792 ext(1048576->2097151) 00002000:00010000:0.0:1746147176.519985:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12a00 00000100:00100000:0.0:1746147176.528135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.528239:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463362048 00000100:00100000:1.0:1746147176.528252:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463362048 00000100:00100000:1.0:1746147176.528324:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10809 00000100:00100000:1.0:1746147176.528333:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28434:x1830967463362048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147176.528351:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.528370:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5296 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.528399:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51fc expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.528406:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147176.528407:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147176.528411:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5296 expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.528438:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51fc expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.528448:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53ca000/0xb4b2209fbdac43a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e51fc expref: 16 pid: 17548 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.528463:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466261632:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.528575:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.530528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.532084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.532155:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466261632:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.532176:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5296 expref: 20 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.532785:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd600, rc 0) 00000100:00100000:1.0:1746147176.532806:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28434:x1830967463362048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4475us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.532812:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10809 00000100:00100000:0.0:1746147176.533906:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463362560 00000100:00100000:0.0:1746147176.533910:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463362560 00000100:00100000:0.0:1746147176.534702:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10298 00000100:00100000:0.0:1746147176.534711:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28431:x1830967463362560:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147176.534735:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.534738:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746147176.534760:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63f800/0xb4b2209fbdac4495 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5288 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535082:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4513200/0xb4b2209fbdac4479 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e527a expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535093:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.535096:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147176.535108:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d600/0xb4b2209fbdac44b8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52a4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.535129:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463362688 00000100:00100000:1.0:1746147176.535133:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463362688 00000100:00100000:1.0:1746147176.535154:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10299 00010000:00010000:0.0:1746147176.535154:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147176.535158:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28434:x1830967463362688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.535164:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.535165:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.535170:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52ab expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535171:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5273 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535176:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e526c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535182:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.535396:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.535404:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.535432:0:23726:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.535442:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e526c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535456:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0200/0xb4b2209fbdac4441 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e526c expref: 9 pid: 14125 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.535464:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.535466:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466262016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.535475:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.535477:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147176.535479:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 5/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.535484:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dde00, rc 0) 00000100:00100000:1.0:1746147176.535500:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28434:x1830967463362688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 341us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.535505:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10299 00010000:00010000:0.0:1746147176.535807:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5273 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535815:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac4456 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5273 expref: 9 pid: 14125 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.535823:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466262144:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.535852:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.535859:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 7 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.535866:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466262272:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.535880:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.537006:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466262016:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.537251:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463362944 00000100:00100000:0.0:1746147176.537257:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463362944 00002000:00100000:0.0:1746147176.537292:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41f:0x0] (1048576->2097151) req@ffff88009edc9c00 x1830967463362944/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.537302:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967463362944 ext(1048576->2097151) 00002000:00010000:0.0:1746147176.537308:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:1.0:1746147176.537759:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3984 00000100:00100000:1.0:1746147176.537767:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463362944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147176.538698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.538720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.539001:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5258 00000100:00100000:0.0:1746147176.539007:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463363328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.539015:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.539020:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.539029:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.540211:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b203c00/0xb4b2209fbdac4425 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5265 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.540228:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.540233:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.540240:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.540245:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.540342:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+7:1957:x1830967463363328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1334us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.540350:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5258 00000100:00100000:0.0:1746147176.542757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.555426:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463362944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17651us (18282us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147176.555443:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3984 00002000:00100000:0.0:1746147176.555454:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41f:0x0] (1048576->2097151) req@ffff88009edc9c00 x1830967463362944/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.555464:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967463362944 ext(1048576->2097151) 00002000:00010000:0.0:1746147176.555470:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:0.0:1746147176.561574:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463363584 00000100:00100000:0.0:1746147176.561582:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463363584 00000100:00100000:0.0:1746147176.561622:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10811 00000100:00100000:0.0:1746147176.561630:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+5:28433:x1830967463363584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.561648:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.561687:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52b9 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.561718:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac43a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5203 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.561727:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.561729:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.561732:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b9 expref: 6 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.561779:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac43a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5203 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.561793:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac43a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5203 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.561811:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466262400:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.561882:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.564226:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466262400:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.564258:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b9 expref: 6 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.564274:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f661e00, rc 0) 00000100:00100000:0.0:1746147176.564602:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28433:x1830967463363584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2971us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.564609:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10811 00000100:00100000:0.0:1746147176.569440:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466262528:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147176.569459:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.569502:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463363712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4569us (4694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.569512:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5260 00000100:00100000:1.0:1746147176.572318:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466262784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.572379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.572409:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147176.572413:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466262912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.572801:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466263680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.572826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.572842:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466264192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.572857:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.572869:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466264704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.572870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.572882:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.572886:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466263552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.572900:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466263040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.572920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.572931:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466263808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.572972:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.572984:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466264320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.572999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573008:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466264832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.573020:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573032:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147176.573036:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466262656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.573052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573062:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466263424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.573076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573082:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466263936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.573093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573098:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466264448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147176.573110:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.573126:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573132:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466262784 00000100:00100000:1.0:1746147176.573134:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466264064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.573137:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466262784 00000100:00100000:1.0:1746147176.573149:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.573155:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466264576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.573166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.573166:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263680 00000100:00100000:0.0:1746147176.573168:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263680 00000100:00100000:0.0:1746147176.573176:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264192 00000100:00100000:0.0:1746147176.573177:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264192 00000100:00100000:0.0:1746147176.573182:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466262912 00000100:00100000:0.0:1746147176.573184:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466262912 00000100:00100000:0.0:1746147176.573189:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264704 00000100:00100000:0.0:1746147176.573191:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264704 00000100:00100000:0.0:1746147176.573195:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263040 00000100:00100000:0.0:1746147176.573197:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263040 00000100:00100000:0.0:1746147176.573204:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263808 00000100:00100000:0.0:1746147176.573205:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263808 00000100:00100000:0.0:1746147176.573211:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264320 00000100:00100000:0.0:1746147176.573212:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264320 00000100:00100000:0.0:1746147176.573217:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264832 00000100:00100000:0.0:1746147176.573219:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264832 00000100:00100000:0.0:1746147176.573223:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466262656 00000100:00100000:0.0:1746147176.573224:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466262656 00000100:00100000:0.0:1746147176.573229:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263424 00000100:00100000:0.0:1746147176.573231:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263424 00000100:00100000:0.0:1746147176.573235:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263936 00000100:00100000:0.0:1746147176.573236:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263936 00000100:00100000:0.0:1746147176.573241:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264448 00000100:00100000:0.0:1746147176.573242:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264448 00000100:00100000:0.0:1746147176.573882:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466263552 00000100:00100000:0.0:1746147176.573886:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466263552 00000004:00080000:1.0:1746147176.575148:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585880/2, rc 0, transno 21474840478 00000100:00100000:1.0:1746147176.575159:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466262912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.575209:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466264960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.575233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.575554:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466264960 00000100:00100000:0.0:1746147176.575559:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466264960 00000100:00100000:0.0:1746147176.575574:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10819 00000100:00100000:0.0:1746147176.575578:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466264320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.575651:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147176.575653:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.575655:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.575656:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.575658:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147176.575692:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466264320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (2691us total) trans 21474840481 rc 0/0 00000100:00100000:0.0:1746147176.575697:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10819 00000100:00100000:0.0:1746147176.575706:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10820 00000100:00100000:0.0:1746147176.575711:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466264832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147176.575779:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147176.575781:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.575782:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.575784:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.575785:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147176.575805:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466264832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (2783us total) trans 21474840482 rc 0/0 00000100:00100000:0.0:1746147176.575810:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10820 00000100:00100000:0.0:1746147176.575820:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10821 00000100:00100000:0.0:1746147176.575824:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466262656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.575839:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10822 00000100:00100000:0.0:1746147176.575843:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466263424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.575857:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10823 00000100:00100000:0.0:1746147176.575861:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466263936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.575980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.575996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.576032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.576050:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463363968 00000100:00100000:0.0:1746147176.576052:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463363968 00000100:00100000:0.0:1746147176.576071:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463363840 00000100:00100000:0.0:1746147176.576073:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463363840 00000100:00100000:0.0:1746147176.576085:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4032 00000100:00100000:0.0:1746147176.576089:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28434:x1830967463363968:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147176.576171:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28434:x1830967463363968:12345-192.168.203.36@tcp:49:cat.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.576178:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463364096 00000100:00100000:0.0:1746147176.576179:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4032 00000100:00100000:1.0:1746147176.576181:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463364096 00000100:00100000:0.0:1746147176.576186:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4033 00000100:00100000:0.0:1746147176.576190:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28428:x1830967463363840:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:1.0:1746147176.576203:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10301 00000100:00100000:1.0:1746147176.576207:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463364096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147176.576216:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147176.576219:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28428:x1830967463363840:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.576223:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4033 00010000:00010000:1.0:1746147176.576232:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xb4b2209fbdac44db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52c0 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.576250:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466263168:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.576258:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466263296:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147176.576267:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xb4b2209fbdac44db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c0 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.576282:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8d600/0xb4b2209fbdac44b8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52a4 expref: 303 pid: 14049 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746147176.576395:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xb4b2209fbdac44db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c0 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.576412:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.576415:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147176.576418:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd400, rc 0) 00000100:00100000:1.0:1746147176.576587:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463364096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 378us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.576594:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10301 00000004:00080000:1.0:1746147176.576713:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e586d80/2, rc 0, transno 21474840483 00000100:00100000:1.0:1746147176.576717:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466262784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.576725:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584e00/2, rc 0, transno 21474840485 00000100:00100000:1.0:1746147176.576727:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466264576:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147176.577375:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52a4 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.577389:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8ce00, rc 0) 00000100:00100000:0.0:1746147176.577420:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28431:x1830967463362560:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 42711us (43599us total) trans 8589944009 rc 0/0 00000100:00100000:0.0:1746147176.577425:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10298 00002000:00010000:0.0:1746147176.577514:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147176.577516:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.577518:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.577520:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147176.577521:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746147176.577540:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466262656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1716us (4488us total) trans 17179873086 rc 0/0 00000100:00100000:0.0:1746147176.577545:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10821 00002000:00010000:0.0:1746147176.577623:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147176.577626:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.577627:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:0.0:1746147176.577629:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147176.577630:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147176.577650:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466263424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1806us (4573us total) trans 17179873087 rc 0/0 00000100:00100000:0.0:1746147176.577655:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10822 00002000:00010000:0.0:1746147176.577751:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147176.577753:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.577755:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.577756:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.577758:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147176.577778:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466263936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1916us (4683us total) trans 17179873088 rc 0/0 00000100:00100000:0.0:1746147176.577783:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10823 00000004:00080000:1.0:1746147176.578102:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5cbb80/2, rc 0, transno 21474840486 00000100:00100000:1.0:1746147176.578106:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466264960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.579697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:0.0:1746147176.579732:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f368e00/2, rc 0, transno 17179873089 00000100:00100000:0.0:1746147176.579735:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466263552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147176.579743:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f369880/2, rc 0, transno 17179873090 00000100:00100000:0.0:1746147176.579745:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466264064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147176.585710:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463364352 00000100:00100000:0.0:1746147176.585719:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463364352 00000100:00100000:0.0:1746147176.585767:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463364480 00000100:00100000:0.0:1746147176.585769:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463364480 00000100:00100000:0.0:1746147176.585798:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10829 00000100:00100000:0.0:1746147176.585805:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28434:x1830967463364352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.585823:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.585841:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52c7 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.585873:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5249 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.585881:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.585882:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.585885:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.585913:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5249 expref: 15 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.585925:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4402 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5249 expref: 15 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.585963:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466265088:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.586035:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2900 going to sleep for 11 seconds 00000100:00080000:0.0:1746147176.586050:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147176.586063:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10830 00000100:00100000:0.0:1746147176.586069:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+12:28431:x1830967463364480:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147176.586077:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.586087:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52ce expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.586107:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.586112:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.586113:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.586116:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1961984->2097151] (req 1961984->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.586133:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.586140:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 17 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.586147:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466265216:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.586168:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.587172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.587614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.588766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.588884:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463364992 00000100:00100000:0.0:1746147176.588888:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463364992 00010000:00010000:0.0:1746147176.588909:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.588959:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5261 00000100:00100000:0.0:1746147176.588966:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463364992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.588975:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.588996:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.589005:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4513c00/0xb4b2209fbdac4409 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5250 expref: 18 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.589020:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.589021:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.589027:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60080000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.589033:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60080000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.589050:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.589058:0:11078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x70000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.589067:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466265600:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.589118:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.589146:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466265088:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.589164:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.589174:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540600, rc 0) 00000100:00100000:0.0:1746147176.589191:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28434:x1830967463364352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3387us (3785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.589198:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10829 00000100:00100000:1.0:1746147176.590773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.591420:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466265600:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147176.591432:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.591451:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463364992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2486us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.591457:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5261 00000100:00100000:0.0:1746147176.597156:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463365248 00000100:00100000:0.0:1746147176.597165:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463365248 00002000:00100000:0.0:1746147176.597206:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1961984->1966079) req@ffff88009edca300 x1830967463365248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.597216:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967463365248 ext(1961984->1966079) 00010000:00010000:0.0:1746147176.597225:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.597237:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.597248:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edca300 00000100:00100000:0.0:1746147176.597264:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463365504 00000100:00100000:0.0:1746147176.597266:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463365504 00002000:00100000:0.0:1746147176.597279:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009edc8700 x1830967463365504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.597286:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830967463365504 ext(1048576->2097151) 00010000:00010000:0.0:1746147176.597291:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.597302:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.597307:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc8700 00000100:00100000:0.0:1746147176.597319:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1399 00000100:00100000:0.0:1746147176.597325:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1957:x1830967463365248:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147176.597627:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1400 00000100:00100000:1.0:1746147176.597635:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463365504:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147176.599698:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1957:x1830967463365248:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 2366us (3120us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147176.599708:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1399 00002000:00100000:0.0:1746147176.599716:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1961984->1966079) req@ffff88009edca300 x1830967463365248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746147187 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.599725:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967463365248 ext(1961984->1966079) 00010000:00010000:0.0:1746147176.599733:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.599744:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 13 pid: 11147 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.599750:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edca300 00000100:00100000:0.0:1746147176.605045:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463365760 00000100:00100000:0.0:1746147176.605049:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463365760 00002000:00100000:0.0:1746147176.605076:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1961984->2097151) req@ffff88009edcbb80 x1830967463365760/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.605085:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967463365760 ext(1961984->2097151) 00010000:00010000:0.0:1746147176.605093:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 14 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.605103:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 14 pid: 11147 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.605109:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edcbb80 00000100:00100000:0.0:1746147176.605421:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1401 00000100:00100000:0.0:1746147176.605427:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967463365760:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147176.610043:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463365504:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12399us (12989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.610053:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1400 00002000:00100000:1.0:1746147176.610065:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009edc8700 x1830967463365504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.610073:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830967463365504 ext(1048576->2097151) 00010000:00010000:1.0:1746147176.610082:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.610092:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f540600/0xb4b2209fbdac44e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52c7 expref: 21 pid: 8481 timeout: 663 lvb_type: 0 00002000:00010000:1.0:1746147176.610102:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc8700 00000100:00100000:0.0:1746147176.611008:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5263 00000100:00100000:0.0:1746147176.611020:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463366016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.611036:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.611056:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4512000/0xb4b2209fbdac4410 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5257 expref: 17 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.611067:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4512000/0xb4b2209fbdac4410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5257 expref: 17 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.611088:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4512000/0xb4b2209fbdac4410 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5257 expref: 17 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.611104:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.611106:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.611111:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.611123:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.611152:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.611162:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466265984:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.611220:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.611408:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967463365760:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 5979us (6916us total) trans 21474840487 rc 0/0 00000100:00100000:1.0:1746147176.611414:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1401 00002000:00100000:1.0:1746147176.611420:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1961984->2097151) req@ffff88009edcbb80 x1830967463365760/t21474840487(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/448 e 0 to 0 dl 1746147187 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.611428:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967463365760 ext(1961984->2097151) 00010000:00010000:1.0:1746147176.611434:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.611443:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00002000:00010000:1.0:1746147176.611448:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edcbb80 00000100:00100000:0.0:1746147176.613552:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466265984:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147176.613576:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.613629:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463366016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2610us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.613638:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5263 00000100:00100000:0.0:1746147176.616876:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463366144 00000100:00100000:0.0:1746147176.616884:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463366144 00010000:00010000:0.0:1746147176.616916:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.616981:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5264 00000100:00100000:0.0:1746147176.616987:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463366144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.616999:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147176.617018:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147174 -> 1746147176 00010000:00010000:0.0:1746147176.617029:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.617044:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.617068:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541800/0xb4b2209fbdac44e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ce expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.617087:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.617089:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.617097:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 6 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.617104:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 6 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.617134:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 6 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.617144:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466266112:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147176.617231:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.617452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.617506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.617565:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463366400 00000100:00100000:1.0:1746147176.617569:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463366400 00002000:00100000:1.0:1746147176.617597:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2576384->2580479) req@ffff88009ef7f800 x1830967463366400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.617605:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f800 with x1830967463366400 ext(2576384->2580479) 00002000:00010000:1.0:1746147176.617609:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7f800 00000100:00100000:1.0:1746147176.617621:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3985 00000100:00100000:1.0:1746147176.617625:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463366400:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147176.618209:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967463366400:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 582us (755us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147176.618216:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3985 00002000:00100000:1.0:1746147176.618221:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2576384->2580479) req@ffff88009ef7f800 x1830967463366400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.618230:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f800 with x1830967463366400 ext(2576384->2580479) 00002000:00010000:1.0:1746147176.618233:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7f800 00000100:00100000:0.0:1746147176.618374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.623240:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463367040 00000100:00100000:0.0:1746147176.623247:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463367040 00000100:00100000:0.0:1746147176.623286:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4034 00000100:00100000:0.0:1746147176.623293:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28431:x1830967463367040:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147176.623555:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28431:x1830967463367040:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 262us (424us total) trans 8589944010 rc 0/0 00000100:00100000:0.0:1746147176.623562:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4034 00000100:00100000:1.0:1746147176.624735:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463367296 00000100:00100000:1.0:1746147176.624740:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463367296 00002000:00100000:1.0:1746147176.624767:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1548288->1552383) req@ffff88009f451500 x1830967463367296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.624776:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463367296 ext(1548288->1552383) 00002000:00010000:1.0:1746147176.624781:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451500 00000100:00100000:1.0:1746147176.624792:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463367552 00000100:00100000:1.0:1746147176.624794:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463367552 00002000:00100000:1.0:1746147176.624806:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f451c00 x1830967463367552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.624813:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451c00 with x1830967463367552 ext(1048576->2097151) 00002000:00010000:1.0:1746147176.624816:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f451c00 00000100:00100000:1.0:1746147176.624823:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463367680 00000100:00100000:1.0:1746147176.624825:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463367680 00002000:00100000:1.0:1746147176.624834:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009ef7ea00 x1830967463367680/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.624840:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ea00 with x1830967463367680 ext(1048576->2097151) 00002000:00010000:1.0:1746147176.624844:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7ea00 00000100:00100000:1.0:1746147176.624854:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3986 00000100:00100000:1.0:1746147176.624861:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463367296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147176.625015:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463367296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 153us (1835us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147176.625021:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3986 00002000:00100000:1.0:1746147176.625026:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1548288->1552383) req@ffff88009f451500 x1830967463367296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.625033:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463367296 ext(1548288->1552383) 00002000:00010000:1.0:1746147176.625036:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451500 00000100:00100000:1.0:1746147176.625049:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3987 00000100:00100000:1.0:1746147176.625054:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463367552:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147176.626353:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3988 00000100:00100000:0.0:1746147176.626360:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463367680:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147176.642619:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463367552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17554us (17975us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.642630:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3987 00002000:00100000:1.0:1746147176.642641:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f451c00 x1830967463367552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.642651:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451c00 with x1830967463367552 ext(1048576->2097151) 00002000:00010000:1.0:1746147176.642657:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f451c00 00000100:00100000:0.0:1746147176.655310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.657105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.657704:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463368064 00000100:00100000:1.0:1746147176.657709:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463368064 00000100:00100000:0.0:1746147176.657786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.658154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.658192:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463368192 00000100:00100000:1.0:1746147176.658195:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463368192 00000100:00100000:1.0:1746147176.658216:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10835 00000100:00100000:1.0:1746147176.658221:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28428:x1830967463368064:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147176.658230:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.658248:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52f1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658269:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658277:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f600/0xb4b2209fbdac4505 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ea expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658282:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.658283:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.658286:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 10 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658303:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f600/0xb4b2209fbdac4505 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ea expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658312:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f600/0xb4b2209fbdac4505 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ea expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.658319:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466266496:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.658384:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.658392:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e559200/0xb4b2209fbdac44f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52d5 expref: 10 pid: 17548 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.658399:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466266624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.658419:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.658571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.658584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.658626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.658648:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10838 00000100:00100000:0.0:1746147176.658656:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1958:x1830967463368320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.658664:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.658684:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f540400/0xb4b2209fbdac4521 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e52ff expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.658710:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466266880:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147176.658734:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.659032:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463368704 00000100:00100000:1.0:1746147176.659036:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463368704 00000100:00100000:1.0:1746147176.659062:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10302 00000100:00100000:1.0:1746147176.659067:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+6:28436:x1830967463368704:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.659081:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.659093:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac452f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5314 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.659142:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659153:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659163:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659174:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659179:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659184:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659343:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659349:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.659357:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147176.660623:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147176.660628:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1746147176.660643:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466266496:192.168.203.36@tcp:104: 00000004:00010000:1.0:1746147176.660646:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147176.660652:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466266624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.660658:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660666:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.660681:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 10 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.660685:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660691:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660695:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092904800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147176.660696:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a38a00, rc 0) 00010000:00010000:1.0:1746147176.660700:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660705:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147176.660714:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28428:x1830967463368064:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2492us (3616us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147176.660715:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147176.660718:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147176.660719:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10835 00010000:00010000:1.0:1746147176.660721:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660725:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac4536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660737:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660742:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660746:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660750:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092905400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147176.660752:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660756:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660761:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f200) 00010000:00010000:1.0:1746147176.660763:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147176.660765:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660770:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac453d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.660795:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac452f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5314 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.660804:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5314 expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.660811:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.660813:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147176.660815:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904000, rc 0) 00000100:00100000:1.0:1746147176.660850:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28436:x1830967463368704:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1782us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.660857:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10302 00002000:00010000:0.0:1746147176.665772:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147174 -> 1746147176 00002000:00010000:0.0:1746147176.665777:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147174 -> 1746147176 00000100:00100000:0.0:1746147176.666020:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466266752:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147176.666047:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094450800/0xb4b2209fbdac451a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5306 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.666058:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094450800/0xb4b2209fbdac451a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5306 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.666070:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094450800, rc 0) 00000100:00100000:0.0:1746147176.666091:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1958:x1830967463368448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7444us (7937us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147176.666098:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10837 00000100:00100000:0.0:1746147176.667699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.667730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.667753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.667776:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463368960 00000100:00100000:0.0:1746147176.667782:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463368960 00000100:00100000:0.0:1746147176.667813:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463369088 00000100:00100000:0.0:1746147176.667815:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463369088 00000100:00100000:0.0:1746147176.667825:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463369216 00000100:00100000:0.0:1746147176.667826:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463369216 00000100:00100000:0.0:1746147176.667838:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10840 00000100:00100000:0.0:1746147176.667844:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463368960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.667860:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.667876:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952c4600/0xb4b2209fbdac454b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e531b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.667918:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466267136:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147176.668004:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.668100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147176.669873:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147174 -> 1746147176 00002000:00010000:0.0:1746147176.669878:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147174 -> 1746147176 00000100:00100000:0.0:1746147176.669891:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466267136:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147176.669910:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952c4600/0xb4b2209fbdac454b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e531b expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.669920:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952c4600/0xb4b2209fbdac454b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e531b expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.669927:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c4600, rc 0) 00000100:00100000:0.0:1746147176.669964:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463368960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2120us (2274us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147176.669980:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10840 00000100:00100000:0.0:1746147176.671195:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463369472 00000100:00100000:0.0:1746147176.671200:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463369472 00000100:00100000:0.0:1746147176.671233:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10843 00000100:00100000:0.0:1746147176.671240:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463369472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.671254:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.671267:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5330 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.671288:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.671295:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.671296:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147176.671299:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 9 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.671321:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 14 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.671331:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 14 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.671342:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466267520:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.671399:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.673300:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463369984 00000100:00100000:0.0:1746147176.673304:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463369984 00000100:00100000:0.0:1746147176.673334:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10303 00000100:00100000:0.0:1746147176.673341:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28436:x1830967463369984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.673352:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.673367:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdac456e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5337 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.673459:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.673472:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5314 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.673478:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.673499:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5314 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.673507:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4544 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5314 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.673516:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466267776:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.674743:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466267520:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.674769:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 8 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.674782:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540600, rc 0) 00000100:00100000:1.0:1746147176.674833:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463369472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3592us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.674841:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10843 00000100:00100000:0.0:1746147176.675153:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.675815:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463370240 00000100:00100000:0.0:1746147176.675819:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463370240 00002000:00100000:0.0:1746147176.675846:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2580479) req@ffff88012ba5b100 x1830967463370240/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.675854:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b100 with x1830967463370240 ext(2097152->2580479) 00010000:00010000:0.0:1746147176.675860:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 15 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.675869:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 15 pid: 11147 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.675880:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba5b100 00000100:00100000:0.0:1746147176.675904:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1402 00000100:00100000:0.0:1746147176.675909:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463370240:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147176.676744:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463370624 00000100:00100000:1.0:1746147176.676748:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463370624 00000100:00100000:1.0:1746147176.676775:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4035 00000100:00100000:1.0:1746147176.676780:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28428:x1830967463370624:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147176.676957:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28428:x1830967463370624:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 176us (331us total) trans 8589944011 rc 0/0 00000100:00100000:1.0:1746147176.676963:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4035 00000100:00100000:0.0:1746147176.677228:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466267776:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.677250:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.677421:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.677427:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147176.677442:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147176.677513:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7546000/0xb4b2209fbdac456e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5337 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.677524:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5337 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.677530:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.677532:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147176.677534:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f8a00, rc 0) 00000100:00100000:0.0:1746147176.677639:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463369984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4298us (4566us total) trans 8589944012 rc 0/0 00000100:00100000:0.0:1746147176.677647:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10303 00000100:00100000:1.0:1746147176.682045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.682108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.682307:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463371136 00000100:00100000:0.0:1746147176.682315:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463371136 00000100:00100000:0.0:1746147176.682367:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10304 00000100:00100000:0.0:1746147176.682374:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463371136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.682398:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.682416:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9dc00/0xb4b2209fbdac4583 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5345 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.682495:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.682508:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5337 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.682514:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.682542:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5337 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.682551:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac4575 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5337 expref: 9 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.682562:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466268032:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.682639:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.682656:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463371008 00000100:00100000:0.0:1746147176.682659:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463371008 00002000:00100000:0.0:1746147176.682693:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008e5cb100 x1830967463371008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.682703:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967463371008 ext(2097152->3145727) 00002000:00010000:0.0:1746147176.682708:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cb100 00000100:00100000:0.0:1746147176.682728:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3991 00000100:00100000:0.0:1746147176.682733:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463371008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147176.684534:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466268032:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.684555:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.684819:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.684823:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147176.684856:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147176.684859:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147176.684871:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.684895:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9dc00/0xb4b2209fbdac4583 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5345 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.684903:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5345 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.684907:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.684909:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147176.684910:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee9d000, rc 0) 00000100:00100000:0.0:1746147176.684929:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463371136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2557us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.684957:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10304 00000100:00100000:1.0:1746147176.687265:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463371392 00000100:00100000:1.0:1746147176.687271:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463371392 00000100:00100000:1.0:1746147176.687302:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463371648 00000100:00100000:1.0:1746147176.687304:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463371648 00000100:00100000:1.0:1746147176.687327:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10846 00000100:00100000:1.0:1746147176.687334:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463371520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.687342:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.687353:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092904800/0xb4b2209fbdac4598 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5353 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.687395:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466268288:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147176.687482:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.687540:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463371904 00000100:00100000:1.0:1746147176.687543:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463371904 00010000:00010000:1.0:1746147176.687565:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.687598:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5271 00000100:00100000:1.0:1746147176.687604:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967463371904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.687615:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.687644:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.687659:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab5f200/0xb4b2209fbdac44fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52e3 expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.687684:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.687685:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.687691:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 7 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.687699:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 7 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.687729:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 7 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.687739:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466268544:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147176.688540:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1300 going to sleep for 11 seconds 00002000:00010000:1.0:1746147176.689211:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147174 -> 1746147176 00000100:00100000:1.0:1746147176.689233:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466268288:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147176.689257:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092904800/0xb4b2209fbdac4598 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5353 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.689270:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092904800/0xb4b2209fbdac4598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5353 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.689295:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904800, rc 0) 00000100:00100000:1.0:1746147176.689323:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463371520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1988us (2077us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147176.689330:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10846 00000100:00100000:0.0:1746147176.696649:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463371008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13909us (14608us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147176.696658:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3991 00002000:00100000:0.0:1746147176.696666:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008e5cb100 x1830967463371008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.696683:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967463371008 ext(2097152->3145727) 00002000:00010000:0.0:1746147176.696687:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5cb100 00000100:00100000:0.0:1746147176.703516:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463372416 00000100:00100000:0.0:1746147176.703528:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463372416 00000100:00100000:0.0:1746147176.703590:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10305 00000100:00100000:0.0:1746147176.703598:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463372416:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147176.703618:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.703636:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9600/0xb4b2209fbdac45ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5368 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.703742:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.703756:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.703767:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147176.703778:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147176.703896:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9600/0xb4b2209fbdac45ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5368 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.703928:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5368 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.703960:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.703963:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147176.703966:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8000, rc 0) 00000100:00100000:0.0:1746147176.704027:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28436:x1830967463372416:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 430us (2666us total) trans 8589944013 rc 0/0 00000100:00100000:0.0:1746147176.704033:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10305 00000100:00100000:0.0:1746147176.707333:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463372544 00000100:00100000:0.0:1746147176.707341:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463372544 00000100:00100000:0.0:1746147176.707389:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10849 00000100:00100000:0.0:1746147176.707396:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28434:x1830967463372544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.707418:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.707436:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e536f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.707460:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.707462:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.707469:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.707483:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.707493:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8800, rc 0) 00000100:00100000:0.0:1746147176.707535:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28434:x1830967463372544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 139us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.707540:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10849 00000100:00100000:1.0:1746147176.707853:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10851 00000100:00100000:1.0:1746147176.707868:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463372928:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147176.707904:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac45c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.707918:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.707929:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147176.707931:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147176.707933:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac45c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.707979:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.707990:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 7 pid: 17548 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.708001:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466268672:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.708071:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.708088:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10852 00000100:00100000:1.0:1746147176.708107:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463373184:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147176.708126:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708135:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 9 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708141:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708145:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.708147:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.708149:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708162:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708170:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 16 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.708178:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466268928:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.708221:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 9 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708229:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 9 pid: 8481 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.708236:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466269184:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.708252:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147176.708267:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10855 00000100:00100000:1.0:1746147176.708274:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463373312:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147176.708289:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708299:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708310:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.708314:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.708316:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.708317:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 5/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708332:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.708339:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 663 lvb_type: 1 00000100:00100000:1.0:1746147176.708347:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466269440:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.708374:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.708381:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 20 pid: 6881 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.708388:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466269568:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.708406:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.710141:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463372160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13479us (13966us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147176.710151:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3992 00002000:00100000:0.0:1746147176.710161:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a4673800 x1830967463372160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.710171:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967463372160 ext(2097152->3145727) 00010000:00010000:0.0:1746147176.710179:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 8 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.710189:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac4560 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5330 expref: 8 pid: 8481 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.710196:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673800 00000100:00100000:0.0:1746147176.712923:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466268928:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.712954:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466269184:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.712968:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.714480:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466269440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.714666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.714701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.714718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.714744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.714766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.714784:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463373568 00000100:00100000:1.0:1746147176.714789:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463373568 00010000:00010000:1.0:1746147176.714810:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a400/0xb4b2209fbdac43f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e523b expref: 19 pid: 21080 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.714832:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5272 00000100:00100000:1.0:1746147176.714840:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463373952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.714853:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.714872:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac43fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5242 expref: 19 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.714881:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac43fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5242 expref: 19 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.714900:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac43fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5242 expref: 19 pid: 21080 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.714915:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.714917:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.714921:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491fe00/0xb4b2209fbdac45de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.714928:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fe00/0xb4b2209fbdac45de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.714968:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.715000:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463373952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 161us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.715007:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5272 00000100:00100000:1.0:1746147176.715022:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5274 00000100:00100000:1.0:1746147176.715028:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463373824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.715036:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.715045:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 663 lvb_type: 1 00010000:00010000:1.0:1746147176.715052:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 663 lvb_type: 1 00010000:00010000:1.0:1746147176.715061:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9200/0xb4b2209fbdac45a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5361 expref: 17 pid: 6881 timeout: 663 lvb_type: 1 00010000:00010000:1.0:1746147176.715070:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.715086:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463373824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.715091:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5274 00000100:00100000:1.0:1746147176.715127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.715139:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463374208 00000100:00100000:1.0:1746147176.715142:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463374208 00010000:00010000:1.0:1746147176.715153:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 21 pid: 6881 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.715170:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5275 00000100:00100000:1.0:1746147176.715175:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463374208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.715181:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.715187:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 21 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.715195:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 21 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.715204:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.715205:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.715208:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.715215:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.715223:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.715238:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463374208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.715244:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5275 00000100:00100000:1.0:1746147176.715343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147176.715519:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9000/0xb4b2209fbdac4567 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e533e expref: 20 pid: 6881 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.715537:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466269568:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.715549:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715556:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715562:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715578:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715585:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715591:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715597:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee9c400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147176.715600:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715606:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715619:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.715625:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9c400/0xb4b2209fbdac45ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.715655:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463373312:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 7382us (7899us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.715661:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10855 00000100:00100000:1.0:1746147176.719322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.719425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.727631:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463374848 00000100:00100000:0.0:1746147176.727641:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463374848 00002000:00100000:0.0:1746147176.727690:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4673b80 x1830967463374848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.727700:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463374848 ext(2097152->3145727) 00002000:00010000:0.0:1746147176.727706:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:0.0:1746147176.727728:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3993 00000100:00100000:0.0:1746147176.727734:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463374848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147176.732425:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463374976 00000100:00100000:1.0:1746147176.732435:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463374976 00010000:00010000:1.0:1746147176.732463:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 9 pid: 8481 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.732496:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5277 00000100:00100000:1.0:1746147176.732503:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1958:x1830967463374976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.732515:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.732532:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 9 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.732541:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 9 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.732557:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac450c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52f1 expref: 9 pid: 8481 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.732582:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.732583:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.732587:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac45e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.732593:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac45e5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.732612:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.732649:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1958:x1830967463374976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.732654:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5277 00000100:00100000:0.0:1746147176.738062:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463373440:12345-192.168.203.36@tcp:4:cat.0 Request processed in 22315us (23384us total) trans 17179873091 rc 0/0 00000100:00100000:0.0:1746147176.738075:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1403 00002000:00100000:0.0:1746147176.738085:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1548288->2097151) req@ffff8800a0448e00 x1830967463373440/t17179873091(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/448 e 0 to 0 dl 1746147187 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147176.738095:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448e00 with x1830967463373440 ext(1548288->2097151) 00010000:00010000:0.0:1746147176.738107:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.738119:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00002000:00010000:0.0:1746147176.738127:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0448e00 00000100:00100000:1.0:1746147176.748199:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463375104 00000100:00100000:1.0:1746147176.748211:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463375104 00010000:00010000:1.0:1746147176.748241:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.748263:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5278 00000100:00100000:1.0:1746147176.748269:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463375104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.748281:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.748297:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.748305:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.748321:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e558800/0xb4b2209fbdac44f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52dc expref: 13 pid: 17548 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.748345:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.748347:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.748350:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac45c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.748357:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac45c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.748374:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.748411:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463375104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.748416:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5278 00000100:00100000:1.0:1746147176.749503:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463374848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21767us (21924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.749511:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3993 00002000:00100000:1.0:1746147176.749519:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4673b80 x1830967463374848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.749527:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463374848 ext(2097152->3145727) 00002000:00010000:1.0:1746147176.749531:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:0.0:1746147176.754048:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463375360 00000100:00100000:0.0:1746147176.754056:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463375360 00010000:00010000:0.0:1746147176.754087:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.754263:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5279 00000100:00100000:0.0:1746147176.754270:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463375360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.754282:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.754300:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.754310:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.754325:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac45c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e536f expref: 17 pid: 11147 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.754338:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.754340:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.754343:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754355:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754376:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.754416:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463375360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 146us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.754422:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5279 00010000:00010000:0.0:1746147176.754440:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754446:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754461:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754467:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754472:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754478:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092905800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147176.754481:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754491:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754499:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.754504:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac45d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.754536:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463373184:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 46442us (46822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.754541:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10852 00000100:00100000:0.0:1746147176.756205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.756272:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463375616 00000100:00100000:1.0:1746147176.756280:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463375616 00002000:00100000:1.0:1746147176.756310:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76e300 x1830967463375616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.756319:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76e300 with x1830967463375616 ext(3145728->4194303) 00002000:00010000:1.0:1746147176.756323:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76e300 00000100:00100000:1.0:1746147176.756350:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3994 00000100:00100000:1.0:1746147176.756357:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463375616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147176.758104:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463375744 00000100:00100000:0.0:1746147176.758111:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463375744 00000100:00100000:0.0:1746147176.758155:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10858 00000100:00100000:0.0:1746147176.758162:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463375744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.758175:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.758189:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f400/0xb4b2209fbdac4601 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5384 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147176.758208:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4870144, mtime: 0x68141768, atime: 0x68141768, ctime: 0x68141768, blocks: 0x1567 00010000:00010000:0.0:1746147176.758225:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.758227:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.758232:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f400/0xb4b2209fbdac4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5384 expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760098:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f400/0xb4b2209fbdac4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5384 expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760111:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0f400, rc 0) 00000100:00100000:0.0:1746147176.760150:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28433:x1830967463375744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1989us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.760157:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10858 00000100:00100000:0.0:1746147176.760187:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463376000 00000100:00100000:0.0:1746147176.760193:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463376000 00000100:00100000:0.0:1746147176.760224:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10306 00000100:00100000:0.0:1746147176.760229:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28436:x1830967463376000:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1746147176.760266:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.760283:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac458a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5345 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760293:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.760302:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147176.760323:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.760336:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52a4 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760344:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 302 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760353:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661600/0xb4b2209fbdac44cd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b2 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760359:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.760385:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661600/0xb4b2209fbdac44cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b2 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760395:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661600/0xb4b2209fbdac44cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b2 expref: 7 pid: 14125 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.760406:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269696:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.760479:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 302 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760487:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 302 pid: 23726 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.760493:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269824:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.760514:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52a4 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.760520:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb8ce00/0xb4b2209fbdac44bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52a4 expref: 302 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.760527:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269952:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.760542:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.763610:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269696:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.763621:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.763628:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466269952:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.763654:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147176.766223:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463376256 00000100:00100000:1.0:1746147176.766232:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463376256 00010000:00010000:1.0:1746147176.766260:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 303 pid: 23726 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.766291:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463376128 00000100:00100000:1.0:1746147176.766293:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463376128 00010000:00010000:1.0:1746147176.766301:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f661600/0xb4b2209fbdac44cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b2 expref: 8 pid: 14125 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.766314:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5280 00000100:00100000:1.0:1746147176.766320:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967463376256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.766333:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.766337:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 304 pid: 23726 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.766346:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 304 pid: 23726 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.766363:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dde00/0xb4b2209fbdac44c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52ab expref: 304 pid: 23726 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.766496:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.766504:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.766511:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.766543:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967463376256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 223us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.766549:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5280 00010000:00010000:1.0:1746147176.769928:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.769954:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:1.0:1746147176.770538:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2824, 88 off234216 00000004:00080000:1.0:1746147176.770543:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563757605434ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.770577:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off230872 00000004:00080000:1.0:1746147176.770580:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563757642977ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771143:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off230960 00000004:00080000:1.0:1746147176.771148:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758211056ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771156:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2825, 88 off234304 00000004:00080000:1.0:1746147176.771162:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563758221179ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.771170:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2826, 88 off234392 00000004:00080000:1.0:1746147176.771172:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563758235182ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.771179:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off231048 00000004:00080000:1.0:1746147176.771182:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758244541ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771188:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off231136 00000004:00080000:1.0:1746147176.771190:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758253096ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771196:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off231224 00000004:00080000:1.0:1746147176.771198:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758261114ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771204:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2827, 88 off234480 00000004:00080000:1.0:1746147176.771206:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563758268779ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.771213:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2791, 88 off231312 00000004:00080000:1.0:1746147176.771215:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758277452ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771220:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2828, 88 off234568 00000004:00080000:1.0:1746147176.771222:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563758284756ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.771228:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off231400 00000004:00080000:1.0:1746147176.771230:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563758293269ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147176.771236:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2829, 88 off234656 00000004:00080000:1.0:1746147176.771238:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563758301081ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.772819:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2830, 88 off234744 00000004:00080000:1.0:1746147176.772829:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563759891218ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.772852:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2831, 88 off234832 00000004:00080000:1.0:1746147176.772854:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563759917287ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.772861:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2832, 88 off234920 00000004:00080000:1.0:1746147176.772863:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563759925868ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147176.772876:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off231488 00000004:00080000:1.0:1746147176.772878:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563759940645ns, next at 537465048041ns, rc = 0 00000100:00100000:1.0:1746147176.773150:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463375616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16791us (16947us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.774077:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3994 00002000:00100000:1.0:1746147176.774089:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76e300 x1830967463375616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/440 e 0 to 0 dl 1746147187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.774097:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76e300 with x1830967463375616 ext(3145728->4194303) 00002000:00010000:1.0:1746147176.774102:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76e300 00000100:00100000:1.0:1746147176.789487:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463377024 00000100:00100000:1.0:1746147176.789495:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463377024 00000100:00100000:1.0:1746147176.789526:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10307 00000100:00100000:1.0:1746147176.789533:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28434:x1830967463377024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147176.789548:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.789562:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e538b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.789605:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.789617:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.789631:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.789640:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.789654:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.789657:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147176.789659:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.789664:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac5c00, rc 0) 00000100:00100000:1.0:1746147176.789696:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28434:x1830967463377024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 162us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.789700:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10307 00000100:00100000:0.0:1746147176.797461:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463377152 00000100:00100000:0.0:1746147176.797468:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463377152 00000100:00100000:0.0:1746147176.797504:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10308 00000100:00100000:0.0:1746147176.797510:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28433:x1830967463377152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147176.797532:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.797552:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4616 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5392 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.797614:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4616 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5392 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.797628:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904000/0xb4b2209fbdac4616 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5392 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.797641:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.797644:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147176.797648:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 301 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.797655:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904000, rc 0) 00000100:00100000:0.0:1746147176.797713:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463377152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 203us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.797720:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10308 00000004:00010000:1.0:1746147176.810028:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4672a00 reply state ffff880093b6bc00 transno 8589944014 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0e400/0xb4b2209fbdac4608 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147176.810041:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147176.810422:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.810467:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147176.810513:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466270592 00000100:00100000:0.0:1746147176.810519:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466270592 00000100:00100000:0.0:1746147176.810555:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10859 00000100:00100000:0.0:1746147176.810562:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967466270592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.810637:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.810659:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810684:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147176.810703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810715:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466272000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147176.810731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810746:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746147176.810751:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.810767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810778:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147176.810793:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810811:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147176.810824:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810836:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147176.810851:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147176.810870:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466271104 00000100:00100000:1.0:1746147176.810873:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466271104 00000100:00100000:1.0:1746147176.810889:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466271488 00000100:00100000:1.0:1746147176.810891:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466271488 00000100:00100000:1.0:1746147176.810899:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466272000 00000100:00100000:1.0:1746147176.810900:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466272000 00000100:00100000:1.0:1746147176.810905:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466270464 00000100:00100000:1.0:1746147176.810907:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466270464 00000100:00100000:1.0:1746147176.810913:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466270976 00000100:00100000:1.0:1746147176.810914:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466270976 00000100:00100000:1.0:1746147176.810920:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466271360 00000100:00100000:1.0:1746147176.810921:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466271360 00000100:00100000:1.0:1746147176.810928:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466271872 00000100:00100000:1.0:1746147176.810929:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466271872 00000100:00100000:1.0:1746147176.810952:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10860 00000100:00100000:1.0:1746147176.810957:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466271104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.811120:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1746147176.811123:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.811125:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811127:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.811129:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:1.0:1746147176.811153:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967466271104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (492us total) trans 21474840490 rc 0/0 00000100:00100000:1.0:1746147176.811159:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10860 00000100:00100000:1.0:1746147176.811175:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10861 00000100:00100000:1.0:1746147176.811180:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967466271488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147176.811283:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147176.811286:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.811288:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811290:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811291:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1746147176.811311:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466271488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (607us total) trans 17179873092 rc 0/0 00000100:00100000:1.0:1746147176.811317:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10861 00000100:00100000:1.0:1746147176.811327:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10862 00000100:00100000:1.0:1746147176.811331:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967466272000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147176.811405:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147176.811408:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811410:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811411:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811413:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147176.811432:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466272000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (700us total) trans 17179873093 rc 0/0 00000100:00100000:1.0:1746147176.811437:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10862 00000100:00100000:1.0:1746147176.811448:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10863 00000100:00100000:1.0:1746147176.811452:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466270464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.811521:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147176.811523:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811525:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811527:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811529:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:1.0:1746147176.811547:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967466270464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (779us total) trans 21474840491 rc 0/0 00000100:00100000:1.0:1746147176.811551:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10863 00000100:00100000:1.0:1746147176.811562:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10864 00000100:00100000:1.0:1746147176.811566:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466270976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.811633:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147176.811635:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.811637:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811638:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.811640:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1746147176.811657:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967466270976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (863us total) trans 21474840492 rc 0/0 00000100:00100000:1.0:1746147176.811661:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10864 00000100:00100000:1.0:1746147176.811683:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10865 00000100:00100000:1.0:1746147176.811687:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967466271360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147176.811759:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147176.811761:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147174 -> 1746147174 00002000:00010000:1.0:1746147176.811763:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147174 -> 1746147174 00002000:00010000:1.0:1746147176.811764:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811766:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147176.811786:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466271360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (961us total) trans 17179873094 rc 0/0 00000100:00100000:1.0:1746147176.811791:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10865 00000100:00100000:1.0:1746147176.811800:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466270080 00000100:00100000:1.0:1746147176.811803:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466270080 00000100:00100000:1.0:1746147176.811812:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10866 00000100:00100000:1.0:1746147176.811816:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967466271872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147176.811884:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147176.811887:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811888:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.811889:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147176.811891:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147176.811909:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3294:x1830967466271872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (1056us total) trans 17179873095 rc 0/0 00000100:00100000:1.0:1746147176.811914:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10866 00000100:00100000:1.0:1746147176.811924:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10868 00000100:00100000:1.0:1746147176.811929:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967466270720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147176.812013:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147176.812016:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.812017:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147176.812019:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147176.812020:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147176.812037:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830967466270720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (218us total) trans 21474840494 rc 0/0 00000100:00100000:1.0:1746147176.812041:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10868 00000100:00100000:1.0:1746147176.812051:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10870 00000100:00100000:1.0:1746147176.812055:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3295:x1830967466271616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147176.812875:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147176.812878:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.812880:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147176.812881:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147176.812883:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147176.812907:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967466270592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2346us (2441us total) trans 21474840498 rc 0/0 00000100:00100000:0.0:1746147176.812912:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10859 00000004:00080000:1.0:1746147176.813464:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ba2300/2, rc 0, transno 21474840491 00000100:00100000:1.0:1746147176.813469:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.813477:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2ba300/2, rc 0, transno 21474840492 00000100:00100000:1.0:1746147176.813479:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.813486:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba59500/2, rc 0, transno 17179873094 00000100:00100000:1.0:1746147176.813489:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147176.813496:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9880/2, rc 0, transno 17179873095 00000100:00100000:1.0:1746147176.813499:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147176.813506:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2bb480/2, rc 0, transno 21474840498 00000100:00100000:1.0:1746147176.813508:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466270592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.813514:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2bad80/2, rc 0, transno 21474840490 00000100:00100000:1.0:1746147176.813517:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147176.813523:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d499500/2, rc 0, transno 17179873092 00000100:00100000:1.0:1746147176.813525:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466271488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147176.813530:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e5c9500/2, rc 0, transno 17179873093 00000100:00100000:1.0:1746147176.813533:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466272000:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746147176.814257:0:14049:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147176.814279:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463376000:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 54045us (54385us total) trans 8589944014 rc 0/0 00000100:00100000:1.0:1746147176.814286:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10306 00000100:00100000:0.0:1746147176.818378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.818411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.818445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.818604:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463377408 00000100:00100000:1.0:1746147176.818612:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463377408 00000100:00100000:1.0:1746147176.818666:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4036 00000100:00100000:1.0:1746147176.818819:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28434:x1830967463377408:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147176.818961:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28434:x1830967463377408:12345-192.168.203.36@tcp:49:cat.0 Request processed in 288us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.818968:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4036 00000100:00100000:1.0:1746147176.819237:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463377280 00000100:00100000:1.0:1746147176.819241:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463377280 00000100:00100000:1.0:1746147176.819272:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10309 00000100:00100000:1.0:1746147176.819278:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28436:x1830967463377280:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.819295:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.819310:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5399 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.819347:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.819359:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.819374:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.819377:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147176.819380:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8800, rc 0) 00000100:00100000:1.0:1746147176.819411:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463377280:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 133us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.819417:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10309 00000100:00100000:0.0:1746147176.824894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.824971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.825025:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463377664 00000100:00100000:1.0:1746147176.825034:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463377664 00000100:00100000:1.0:1746147176.825078:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10310 00000100:00100000:1.0:1746147176.825086:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463377664:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.825103:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.825119:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2d400/0xb4b2209fbdac4624 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53a0 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.825179:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.825189:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.825197:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147176.825218:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147176.825221:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147176.825232:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.825255:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2d400/0xb4b2209fbdac4624 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.825271:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.825278:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147176.825280:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147176.825283:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e2c400, rc 0) 00000100:00100000:1.0:1746147176.825331:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28436:x1830967463377664:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 244us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.825337:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10310 00000100:00100000:0.0:1746147176.826894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.826929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.827008:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10877 00000100:00100000:1.0:1746147176.827021:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463377920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.827033:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.827044:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac4639 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53ae expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147176.827059:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141766, atime: 0x68141766, ctime: 0x68141768, blocks: 0x7f9 00010000:00010000:1.0:1746147176.827072:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.827073:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.827080:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac4639 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ae expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.827090:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac4639 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ae expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.827097:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8a00, rc 0) 00000100:00100000:1.0:1746147176.827134:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463377920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 115us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.827139:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10877 00000100:00100000:0.0:1746147176.827495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.827514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.827533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.827549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.827560:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378432 00000100:00100000:0.0:1746147176.827565:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378432 00000100:00100000:0.0:1746147176.827580:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378048 00000100:00100000:0.0:1746147176.827581:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378048 00000100:00100000:1.0:1746147176.827587:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378304 00000100:00100000:1.0:1746147176.827590:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378304 00000100:00100000:0.0:1746147176.827596:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378560 00000100:00100000:0.0:1746147176.827598:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378560 00000100:00100000:1.0:1746147176.827610:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10879 00000100:00100000:1.0:1746147176.827615:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463378432:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:0.0:1746147176.827615:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10880 00000100:00100000:0.0:1746147176.827620:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463378048:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147176.827622:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147176.827627:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.827628:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f198a00/0xb4b2209fbdac4647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53ca expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.827635:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f800/0xb4b2209fbdac464e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53b5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.827639:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.827640:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.827645:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198a00/0xb4b2209fbdac4647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ca expref: 18 pid: 11147 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746147176.827647:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x68141766, atime: 0x68141766, ctime: 0x68141768, blocks: 0x81d 00010000:00010000:0.0:1746147176.827654:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.827655:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f198a00/0xb4b2209fbdac4647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ca expref: 18 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.827655:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.827659:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f800/0xb4b2209fbdac464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53b5 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.827662:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f198a00, rc 0) 00010000:00010000:0.0:1746147176.827668:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f800/0xb4b2209fbdac464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53b5 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147176.827686:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0f800, rc 0) 00000100:00100000:1.0:1746147176.827696:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463378432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.827702:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10879 00000100:00100000:0.0:1746147176.827702:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463378048:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.827707:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10880 00000100:00100000:0.0:1746147176.828851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.829078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.829104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.829125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.829175:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378816 00000100:00100000:1.0:1746147176.829181:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378816 00000100:00100000:1.0:1746147176.829207:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463378944 00000100:00100000:1.0:1746147176.829209:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463378944 00000100:00100000:1.0:1746147176.829319:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10884 00000100:00100000:1.0:1746147176.829325:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463379072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147176.829331:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.829338:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53ed expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.829348:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.829349:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.829353:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ed expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.829361:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ed expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147176.829372:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a99400, rc 0) 00000100:00100000:1.0:1746147176.829388:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463379072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.829393:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10884 00000100:00100000:0.0:1746147176.841885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.847437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.848248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.848418:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463379840 00000100:00100000:1.0:1746147176.848428:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463379840 00000100:00100000:1.0:1746147176.848478:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463380096 00000100:00100000:1.0:1746147176.848479:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463380096 00002000:00100000:1.0:1746147176.848495:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a5ba1500 x1830967463380096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:552/0 lens 488/0 e 0 to 0 dl 1746147187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147176.848506:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1500 with x1830967463380096 ext(4194304->4870143) 00002000:00010000:1.0:1746147176.848512:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba1500 00000100:00100000:1.0:1746147176.848523:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3999 00000100:00100000:1.0:1746147176.848528:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463379840:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147176.848561:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094e0c800/0xb4b2209fbdac4686 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.848576:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.848577:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.848582:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0c800/0xb4b2209fbdac4686 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.848594:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e0c800/0xb4b2209fbdac4686 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.849754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.849827:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463380352 00000100:00100000:0.0:1746147176.849832:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463380352 00000100:00100000:0.0:1746147176.849855:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4001 00000100:00100000:0.0:1746147176.849860:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463380352:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147176.849875:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.849884:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.849885:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.849888:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.849897:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.852316:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463380608 00000100:00100000:1.0:1746147176.852324:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463380608 00000100:00100000:1.0:1746147176.852369:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4002 00000100:00100000:1.0:1746147176.852376:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:1956:x1830967463380608:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147176.852408:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdac4694 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.852421:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.852423:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.852428:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdac4694 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.852440:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0cc00/0xb4b2209fbdac4694 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.852513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.852529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.852542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.852567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.852590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.852606:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463380864 00000100:00100000:0.0:1746147176.852609:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463380864 00000100:00100000:0.0:1746147176.852627:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463381376 00000100:00100000:0.0:1746147176.852629:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463381376 00000100:00100000:0.0:1746147176.852640:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4003 00000100:00100000:0.0:1746147176.852645:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60817ea3-97af-43a7-ab2a-b628d12800db+22:1956:x1830967463380864:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147176.852660:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac469b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.852667:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.852668:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.852684:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac469b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.852692:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac469b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.856766:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4007 00000100:00100000:1.0:1746147176.856776:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+20:1957:x1830967463381760:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147176.856794:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.856802:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.856803:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.856806:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.856815:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.862604:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463382144 00000100:00100000:1.0:1746147176.862612:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463382144 00000100:00100000:1.0:1746147176.862748:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10311 00000100:00100000:1.0:1746147176.862763:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28441:x1830967463382144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147176.862781:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147176.862796:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0xb4b2209fbdac46be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e53f4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.862877:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0da00/0xb4b2209fbdac46c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.862885:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0da00/0xb4b2209fbdac46c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.862893:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0da00/0xb4b2209fbdac46c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.862905:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac46cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.862910:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac46cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.862916:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac46cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.863035:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3b400/0xb4b2209fbdac46d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.863043:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5368 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.863049:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3b400/0xb4b2209fbdac46d3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147176.863074:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5368 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.863084:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac45b4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5368 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.863094:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466272512:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147176.863194:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.866922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.867008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.867030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.867052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.868537:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466272512:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.868561:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d3b400/0xb4b2209fbdac46d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147176.873319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147176.874398:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874408:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874414:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874420:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009491fc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147176.874423:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874430:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874443:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.874451:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac468d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.874501:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+22:1957:x1830967463380352:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 24640us (24748us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.874508:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4001 00000100:00100000:0.0:1746147176.878231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.908702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.908747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147176.912833:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912846:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912854:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912860:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf0a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147176.912864:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912871:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912886:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.912893:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac46a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.913068:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463381632:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 57635us (60520us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147176.913078:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4005 00010000:00010000:1.0:1746147176.913711:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.913721:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.913727:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.913732:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0d400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147176.913735:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.914617:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.914632:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.914641:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e0d400/0xb4b2209fbdac46b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.914704:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463381760:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 57927us (62109us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147176.914713:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4007 00000100:00100000:0.0:1746147176.920762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.929864:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463385088 00000100:00100000:0.0:1746147176.929872:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463385088 00000100:00100000:0.0:1746147176.929909:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4039 00000100:00100000:0.0:1746147176.929916:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28433:x1830967463385088:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147176.930111:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28433:x1830967463385088:12345-192.168.203.36@tcp:35:cat.0 Request processed in 194us (271us total) trans 8589944018 rc 0/0 00000100:00100000:0.0:1746147176.930117:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4039 00000100:00100000:0.0:1746147176.930159:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463384064 00000100:00100000:0.0:1746147176.930161:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463384064 00000100:00100000:0.0:1746147176.930188:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463384320 00000100:00100000:0.0:1746147176.930190:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463384320 00000100:00100000:0.0:1746147176.930202:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463384576 00000100:00100000:0.0:1746147176.930204:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463384576 00000100:00100000:0.0:1746147176.930213:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463384832 00000100:00100000:0.0:1746147176.930215:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463384832 00000100:00100000:0.0:1746147176.930228:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4010 00000100:00100000:0.0:1746147176.930233:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463384064:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147176.930255:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdac4720 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930270:0:21473:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5296 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930277:0:21473:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930282:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930284:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930286:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdac4720 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.930301:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4011 00000100:00100000:1.0:1746147176.930310:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463384320:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147176.930311:0:21473:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930321:0:21473:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 11 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.930327:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094d3bc00/0xb4b2209fbdac4727 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.930336:0:21473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21473:1830967466272640:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147176.930338:0:1351:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b9 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.930343:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.930344:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.930346:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3bc00/0xb4b2209fbdac4727 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.930363:0:1351:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b9 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.930371:0:1351:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f661e00/0xb4b2209fbdac44d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e52b9 expref: 10 pid: 8480 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.930381:0:1351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:1351:1830967466272768:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.930395:0:21473:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5296 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930402:0:21473:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac44aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5296 expref: 22 pid: 8480 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.930406:0:1351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.930409:0:21473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21473:1830967466272896:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.930426:0:21473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147176.930442:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4012 00000100:00100000:0.0:1746147176.930447:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+17:1959:x1830967463384576:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147176.930460:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930467:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930468:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930471:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930476:0:11283:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.930488:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4013 00000100:00100000:0.0:1746147176.930492:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:60817ea3-97af-43a7-ab2a-b628d12800db+19:1959:x1830967463384832:12345-192.168.203.36@tcp:4:lfs.0 00010000:00010000:0.0:1746147176.930505:0:26114:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930510:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930512:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147176.930514:0:26114:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.930519:0:26114:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147176.937503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.937524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.937994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147176.938249:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463385216 00000100:00100000:1.0:1746147176.938256:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463385216 00010000:00010000:1.0:1746147176.938408:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 12 pid: 6881 timeout: 663 lvb_type: 0 00000100:00100000:1.0:1746147176.938895:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5286 00000100:00100000:1.0:1746147176.938902:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463385216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147176.938910:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147176.938919:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 12 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.938928:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 12 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.938958:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cb400/0xb4b2209fbdac44b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e529d expref: 12 pid: 6881 timeout: 663 lvb_type: 0 00010000:00010000:1.0:1746147176.938981:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.938983:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.938986:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdac4720 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.938993:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c434400/0xb4b2209fbdac4720 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.938999:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.939000:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147176.939004:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.939009:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147176.939851:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147176.939876:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463385216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 973us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147176.939883:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5286 00010000:00010000:0.0:1746147176.940012:0:11283:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147176.940020:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac472e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147176.960358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.966465:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466273024:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.966477:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466273152:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147176.966486:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466273280:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147176.966511:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147176.973892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.973919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.973966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147176.974055:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463385856 00000100:00100000:0.0:1746147176.974063:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463385856 00010000:00010000:0.0:1746147176.974093:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 8 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.974114:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463386112 00000100:00100000:0.0:1746147176.974116:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463386112 00010000:00010000:0.0:1746147176.974125:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 303 pid: 14125 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.974135:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463385984 00000100:00100000:0.0:1746147176.974137:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463385984 00010000:00010000:0.0:1746147176.974143:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 9 pid: 14049 timeout: 663 lvb_type: 0 00000100:00100000:0.0:1746147176.974153:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5287 00000100:00100000:0.0:1746147176.974159:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463385856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.974172:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.974177:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 9 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974186:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 9 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974205:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8800/0xb4b2209fbdac461d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5399 expref: 9 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974219:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.974224:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974231:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974236:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.974270:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463385856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.974275:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5287 00000100:00100000:0.0:1746147176.974314:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5288 00000100:00100000:0.0:1746147176.974318:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967463386112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.974324:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.974328:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 303 pid: 14125 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974335:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 303 pid: 14125 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974345:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac460f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e538b expref: 303 pid: 14125 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974352:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.974355:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974360:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974388:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.974399:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1957:x1830967463386112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.974404:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5288 00000100:00100000:0.0:1746147176.974412:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5289 00000100:00100000:0.0:1746147176.974416:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+7:1957:x1830967463385984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147176.974421:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147176.974424:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 7 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974432:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 7 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974441:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e2c400/0xb4b2209fbdac462b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a0 expref: 7 pid: 14049 timeout: 663 lvb_type: 0 00010000:00010000:0.0:1746147176.974448:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147176.974450:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974457:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974463:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974479:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147176.974487:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+6:1957:x1830967463385984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147176.974491:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5289 00010000:00010000:0.0:1746147176.974564:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147176.974572:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:0.0:1746147176.977347:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2833, 88 off235008 00000004:00080000:0.0:1746147176.977355:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964417599ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977400:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off231576 00000004:00080000:0.0:1746147176.977404:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964466249ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977425:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off231664 00000004:00080000:0.0:1746147176.977428:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964490849ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977438:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2834, 88 off235096 00000004:00080000:0.0:1746147176.977440:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964503113ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977449:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2835, 88 off235184 00000004:00080000:0.0:1746147176.977452:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964515164ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977464:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off231752 00000004:00080000:0.0:1746147176.977467:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964529442ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977476:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off231840 00000004:00080000:0.0:1746147176.977479:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964541480ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977487:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off231928 00000004:00080000:0.0:1746147176.977489:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964552022ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977498:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2836, 88 off235272 00000004:00080000:0.0:1746147176.977500:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964562678ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977509:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off232016 00000004:00080000:0.0:1746147176.977511:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964573867ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977520:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2837, 88 off235360 00000004:00080000:0.0:1746147176.977522:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964584978ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977542:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off232104 00000004:00080000:0.0:1746147176.977546:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964608333ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147176.977555:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2838, 88 off235448 00000004:00080000:0.0:1746147176.977558:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964620377ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977566:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2839, 88 off235536 00000004:00080000:0.0:1746147176.977569:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964631790ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977577:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2840, 88 off235624 00000004:00080000:0.0:1746147176.977580:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964642382ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977587:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2841, 88 off235712 00000004:00080000:0.0:1746147176.977590:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563964652718ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147176.977598:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off232192 00000004:00080000:0.0:1746147176.977600:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563964663173ns, next at 537465048041ns, rc = 0 00010000:00010000:0.0:1746147177.039859:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e541e expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.039872:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147177.039874:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147177.039878:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe400/0xb4b2209fbdac474a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5425 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.039886:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe400/0xb4b2209fbdac474a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5425 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.039892:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe400/0xb4b2209fbdac474a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5425 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.039926:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe400/0xb4b2209fbdac474a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5425 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.039950:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466273408:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147177.040013:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a37acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.047203:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466273408:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147177.047235:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0xb4b2209fbdac473c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e541e expref: 8 pid: 14049 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147177.047251:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e541e expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.047266:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c400, rc 0) 00000100:00100000:0.0:1746147177.047286:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28443:x1830967463385728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 86789us (86940us total) trans 8589944019 rc 0/0 00000100:00100000:0.0:1746147177.047292:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10313 00000100:00100000:0.0:1746147177.055997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.056021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147177.058021:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147177.061733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.061755:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463387648 00000100:00100000:0.0:1746147177.061762:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463387648 00000100:00100000:0.0:1746147177.061804:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10315 00000100:00100000:0.0:1746147177.061810:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28448:x1830967463387648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.061824:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.061848:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac475f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e543a expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.061965:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5291 00000100:00100000:0.0:1746147177.061971:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967463387008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.061981:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.062471:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f800/0xb4b2209fbdac464e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53b5 expref: 24 pid: 6881 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.062479:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb0f800/0xb4b2209fbdac464e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53b5 expref: 24 pid: 6881 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.062490:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147177.062521:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967463387008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 550us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.062526:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5291 00000100:00100000:0.0:1746147177.062546:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5292 00000100:00100000:0.0:1746147177.062551:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463386880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.062558:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.062565:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1600/0xb4b2209fbdac46da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5402 expref: 11 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.062572:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5a1600/0xb4b2209fbdac46da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5402 expref: 11 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.062581:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.062582:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.062588:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55000/0xb4b2209fbdac4751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e542c expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.062594:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55000/0xb4b2209fbdac4751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e542c expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.062618:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55000/0xb4b2209fbdac4751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e542c expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.062628:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466276480:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147177.062664:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.062997:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5293 00000100:00100000:1.0:1746147177.063003:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463387136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.063010:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.063021:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e03a400/0xb4b2209fbdac4678 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53d8 expref: 19 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063028:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e03a400/0xb4b2209fbdac4678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53d8 expref: 19 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063039:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.063056:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463387136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.063060:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5293 00000100:00100000:1.0:1746147177.063069:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5294 00000100:00100000:1.0:1746147177.063073:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463387264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.063077:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.063082:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57b1a00/0xb4b2209fbdac46e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53fb expref: 12 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063089:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57b1a00/0xb4b2209fbdac46e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53fb expref: 12 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063096:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.063104:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463387264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 31us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.063107:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5294 00000100:00100000:1.0:1746147177.063113:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5295 00000100:00100000:1.0:1746147177.063116:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+26:1958:x1830967463387392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.063121:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.063125:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac4639 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ae expref: 26 pid: 11147 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063131:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac4639 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ae expref: 26 pid: 11147 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.063138:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.063139:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.063142:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c7c200/0xb4b2209fbdac4758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 679936->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5433 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.063148:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c7c200/0xb4b2209fbdac4758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 679936->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5433 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.063162:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c7c200/0xb4b2209fbdac4758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 679936->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5433 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.063170:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466276608:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147177.063188:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00010000:00010000:0.0:1746147177.063189:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063199:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063206:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063215:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063220:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063225:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063406:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063414:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063420:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147177.063429:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147177.063532:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063539:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063544:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063549:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51d4c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.063552:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063558:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063565:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147177.063567:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147177.063570:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063574:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac4774 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063587:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063591:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063595:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063601:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0d600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.063603:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063608:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063613:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147177.063615:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147177.063617:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063621:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d600/0xb4b2209fbdac4766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063627:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063632:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063635:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063639:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51d5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.063641:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063646:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063651:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880132f77e00) 00010000:00010000:0.0:1746147177.063653:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147177.063655:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063659:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac476d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147177.063700:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac475f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e543a expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.063707:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac475f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e543a expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.063714:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8c00, rc 0) 00000100:00100000:0.0:1746147177.063735:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28448:x1830967463387648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1925us (2007us total) trans 8589944020 rc 301/301 00000100:00100000:0.0:1746147177.063740:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10315 00000100:00100000:1.0:1746147177.068294:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466276608:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147177.068315:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.068362:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+25:1958:x1830967463387392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5244us (6549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.068370:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5295 00000100:00100000:0.0:1746147177.069905:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466276480:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147177.069916:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147177.069954:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463386880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7386us (8175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.069961:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5292 00000100:00100000:1.0:1746147177.084006:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5297 00000100:00100000:1.0:1746147177.084014:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463388928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.084022:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.084031:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f00be00/0xb4b2209fbdac4671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53e6 expref: 23 pid: 8481 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.084041:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f00be00/0xb4b2209fbdac4671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53e6 expref: 23 pid: 8481 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.084052:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f00be00/0xb4b2209fbdac4671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53e6 expref: 23 pid: 8481 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.084062:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.084079:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463388928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.084085:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5297 00000100:00100000:1.0:1746147177.084819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:1.0:1746147177.085209:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873091 is committed 00000001:00080000:1.0:1746147177.085216:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873088 is committed 00000001:00080000:1.0:1746147177.085223:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873073 is committed 00000001:00080000:1.0:1746147177.085229:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873095 is committed 00000001:00080000:1.0:1746147177.085236:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873074 is committed 00000001:00080000:1.0:1746147177.085239:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873100 is committed 00000001:00080000:1.0:1746147177.085244:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873098 is committed 00000001:00080000:1.0:1746147177.085263:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873099 is committed 00000100:00100000:0.0:1746147177.103057:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463390080 00000100:00100000:0.0:1746147177.103060:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463390080 00000100:00100000:0.0:1746147177.103079:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4041 00000100:00100000:0.0:1746147177.103083:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28441:x1830967463390080:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147177.103199:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28441:x1830967463390080:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 115us (229us total) trans 8589944021 rc 0/0 00000100:00100000:0.0:1746147177.103205:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4041 00000100:00100000:1.0:1746147177.109830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.109892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.110131:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463390592 00000100:00100000:0.0:1746147177.110136:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463390592 00000100:00100000:0.0:1746147177.110156:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4042 00000100:00100000:0.0:1746147177.110161:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28443:x1830967463390592:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147177.110287:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28443:x1830967463390592:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 124us (465us total) trans 8589944022 rc 0/0 00000100:00100000:0.0:1746147177.110293:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4042 00010000:00010000:0.0:1746147177.110346:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110354:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110361:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110366:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4aec00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147177.110370:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110376:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110386:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.110392:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac4735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.110440:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463384832:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 179946us (180647us total) trans 21474840499 rc 0/0 00000100:00100000:0.0:1746147177.110447:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4013 00000100:00100000:1.0:1746147177.115542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000001:00080000:0.0:1746147177.132582:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873101 is committed 00000001:00080000:0.0:1746147177.132598:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873109 is committed 00000100:00100000:0.0:1746147177.136431:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463391104 00000100:00100000:0.0:1746147177.136440:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463391104 00000100:00100000:0.0:1746147177.136478:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10914 00000100:00100000:0.0:1746147177.136486:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28448:x1830967463391104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.136501:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.136515:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013074f400/0xb4b2209fbdac47ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5464 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.136597:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdac4790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5448 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.136604:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147177.136606:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147177.136609:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013074f400/0xb4b2209fbdac47ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5464 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.136637:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdac4790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5448 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.136647:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdac4790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5448 expref: 7 pid: 17548 timeout: 664 lvb_type: 0 00000100:00100000:0.0:1746147177.136813:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466277888:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.136857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.137069:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.137287:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463391232 00000100:00100000:1.0:1746147177.137291:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463391232 00000100:00100000:1.0:1746147177.137330:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10317 00000100:00100000:1.0:1746147177.137336:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+6:28436:x1830967463391232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.137344:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.137354:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47b3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e546b expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.137415:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdac47ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.137425:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdac47ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.137433:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdac47ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147177.137452:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147177.137456:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147177.138724:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdac47ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.138757:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e546b expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.138771:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094061e00/0xb4b2209fbdac47ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e546b expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.138778:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.138780:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147177.138783:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094061e00, rc 0) 00000100:00100000:1.0:1746147177.138834:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+7:28436:x1830967463391232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1497us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.138839:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10317 00000100:00100000:0.0:1746147177.141988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.142014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.142030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.142098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.146580:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463391360:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4097us (4480us total) trans 17179873111 rc 0/0 00000100:00100000:1.0:1746147177.146588:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1408 00002000:00100000:1.0:1746147177.146597:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1175551) req@ffff88009f76c380 x1830967463391360/t17179873111(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/448 e 0 to 0 dl 1746147188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.146605:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76c380 with x1830967463391360 ext(1048576->1175551) 00010000:00010000:1.0:1746147177.146612:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdac4790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5448 expref: 10 pid: 17548 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.146623:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801309ed400/0xb4b2209fbdac4790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5448 expref: 10 pid: 17548 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.146634:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f76c380 00000100:00100000:0.0:1746147177.151797:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463392000 00000100:00100000:0.0:1746147177.151802:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463392000 00000100:00100000:0.0:1746147177.152449:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10918 00000100:00100000:0.0:1746147177.152459:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463392000:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.152474:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.152487:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013074f600/0xb4b2209fbdac47d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e548e expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.152529:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466278272:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.152585:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.155516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.155592:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463392384 00000100:00100000:0.0:1746147177.155599:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463392384 00000100:00100000:0.0:1746147177.155629:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10318 00000100:00100000:0.0:1746147177.155634:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28453:x1830967463392384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.155652:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.155664:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c2600/0xb4b2209fbdac47e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5495 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.155759:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155768:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155776:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155785:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155790:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155794:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155871:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155877:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155882:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147177.155889:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147177.155960:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155966:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155974:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155979:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013074e200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.155981:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155987:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.155994:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147177.155996:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147177.155998:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156002:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac47f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156012:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156016:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156020:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156023:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800952c3c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.156025:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147177.156182:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466278272:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.156196:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013074f600/0xb4b2209fbdac47d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e548e expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.156204:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013074f600/0xb4b2209fbdac47d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e548e expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.156214:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013074f600, rc 0) 00000100:00100000:1.0:1746147177.156235:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463392000:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3778us (4689us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.156240:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10918 00010000:00010000:0.0:1746147177.156447:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156459:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147177.156461:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147177.156463:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156467:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3c00/0xb4b2209fbdac47eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156474:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156477:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156481:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156484:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094060200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147177.156486:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156490:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156495:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b52b8b00) 00010000:00010000:0.0:1746147177.156496:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147177.156498:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156502:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094060200/0xb4b2209fbdac47f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.156530:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c2600/0xb4b2209fbdac47e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5495 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.156537:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c2600/0xb4b2209fbdac47e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5495 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.156543:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c2600, rc 0) 00000100:00100000:0.0:1746147177.156573:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28453:x1830967463392384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 938us (1062us total) trans 8589944023 rc 301/301 00000100:00100000:0.0:1746147177.156578:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10318 00000100:00100000:0.0:1746147177.158253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.158290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.158341:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463392512 00000100:00100000:1.0:1746147177.158349:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463392512 00000100:00100000:1.0:1746147177.158389:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463392640 00000100:00100000:1.0:1746147177.158392:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463392640 00000100:00100000:1.0:1746147177.158458:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10920 00000100:00100000:0.0:1746147177.158467:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10921 00000100:00100000:0.0:1746147177.158473:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463392640:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.158484:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.158493:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013074ec00/0xb4b2209fbdac4807 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54a3 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.158496:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463392512:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.158503:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.158509:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e549c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.158530:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466278656:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.158579:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00010000:00010000:1.0:1746147177.158635:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.158637:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.158644:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.158659:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.158767:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4513200, rc 0) 00000100:00100000:1.0:1746147177.158792:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463392512:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 327us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.158797:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10920 00000100:00100000:1.0:1746147177.160686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.160738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.160753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.160814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.160837:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463393024 00000100:00100000:1.0:1746147177.160845:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463393024 00000100:00100000:0.0:1746147177.160862:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463393280 00000100:00100000:0.0:1746147177.160865:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463393280 00002000:00100000:1.0:1746147177.160875:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a0448380 x1830967463393024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.160875:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1495040->2097151) req@ffff8800a0448000 x1830967463393280/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.160883:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463393024 ext(1048576->2097151) 00002000:00100000:0.0:1746147177.160883:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463393280 ext(1495040->2097151) 00002000:00010000:1.0:1746147177.160887:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448380 00002000:00010000:0.0:1746147177.160887:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:0.0:1746147177.161255:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463393536 00000100:00100000:0.0:1746147177.161259:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463393536 00002000:00100000:0.0:1746147177.161271:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a0449180 x1830967463393536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.161278:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967463393536 ext(1048576->2097151) 00002000:00010000:0.0:1746147177.161281:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0449180 00000100:00100000:0.0:1746147177.161292:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4019 00000100:00100000:0.0:1746147177.161297:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463393280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147177.161356:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4021 00000100:00100000:1.0:1746147177.161361:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463393536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.161645:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463392768 00000100:00100000:0.0:1746147177.161648:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463392768 00000100:00100000:0.0:1746147177.161681:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10319 00000100:00100000:0.0:1746147177.161686:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28453:x1830967463392768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.161696:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.161716:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac4815 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54aa expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.161772:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3800/0xb4b2209fbdac481c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.161784:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3800/0xb4b2209fbdac481c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.161793:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3800/0xb4b2209fbdac481c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147177.161813:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147177.161817:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147177.161829:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3800/0xb4b2209fbdac481c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147177.161847:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013074e200/0xb4b2209fbdac4815 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54aa expref: 11 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.161858:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800952c3800/0xb4b2209fbdac481c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54aa expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.161864:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147177.161867:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147177.161869:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952c3800, rc 0) 00000100:00100000:0.0:1746147177.161892:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28453:x1830967463392768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 205us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.161897:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10319 00000100:00100000:1.0:1746147177.166285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.170298:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463393024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8993us (9559us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147177.170305:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4020 00002000:00100000:0.0:1746147177.170312:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a0448380 x1830967463393024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.170320:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463393024 ext(1048576->2097151) 00002000:00010000:0.0:1746147177.170324:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448380 00000100:00100000:0.0:1746147177.181631:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466278912:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.181678:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e21e00/0xb4b2209fbdac4838 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54c6 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.181691:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e21e00/0xb4b2209fbdac4838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54c6 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.182208:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e21e00, rc 0) 00000100:00100000:0.0:1746147177.182253:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463394048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 15670us (15785us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.182260:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10925 00000100:00100000:0.0:1746147177.182554:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463394176 00000100:00100000:0.0:1746147177.182560:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463394176 00000100:00100000:0.0:1746147177.182599:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10926 00000100:00100000:0.0:1746147177.182606:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463394176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.182617:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.182628:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e766e00/0xb4b2209fbdac483f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54cd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.182665:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279040:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.182724:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.186117:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4670a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279040:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.186145:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e766e00/0xb4b2209fbdac483f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54cd expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.186157:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e766e00/0xb4b2209fbdac483f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54cd expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.186167:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e766e00, rc 0) 00000100:00100000:0.0:1746147177.186219:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463394176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3612us (3855us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.186226:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10926 00000100:00100000:0.0:1746147177.188837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.190411:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463394560 00000100:00100000:0.0:1746147177.190418:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463394560 00002000:00100000:0.0:1746147177.190447:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012e2b9180 x1830967463394560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.190456:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9180 with x1830967463394560 ext(0->1048575) 00002000:00010000:0.0:1746147177.190460:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b9180 00000100:00100000:0.0:1746147177.190512:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4022 00000100:00100000:0.0:1746147177.190518:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463394560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.196761:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279168:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.196791:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4846 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54d4 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.196803:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9b000/0xb4b2209fbdac4846 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54d4 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.196825:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9b000, rc 0) 00000100:00100000:0.0:1746147177.196864:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463394304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7852us (8035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.196871:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10927 00000100:00100000:0.0:1746147177.205529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.205628:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463394944 00000100:00100000:1.0:1746147177.205637:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463394944 00000100:00100000:1.0:1746147177.205746:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10928 00000100:00100000:1.0:1746147177.205754:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463394944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.205773:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.205788:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb8da00/0xb4b2209fbdac484d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54db expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.205838:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279296:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.205900:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.206804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.206828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.206845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.207256:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4025 00000100:00100000:0.0:1746147177.207263:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463395456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147177.209746:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279296:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.209773:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8da00/0xb4b2209fbdac484d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54db expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.209784:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eb8da00/0xb4b2209fbdac484d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54db expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.209804:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8da00, rc 0) 00000100:00100000:1.0:1746147177.209844:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463394944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4091us (4322us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.209851:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10928 00000100:00100000:0.0:1746147177.216119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.216209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.216233:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463396096 00000100:00100000:1.0:1746147177.216241:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463396096 00000100:00100000:1.0:1746147177.216270:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10929 00000100:00100000:1.0:1746147177.216276:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28453:x1830967463396096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.216290:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.216303:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54e2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.216329:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac4797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e544f expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.216336:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.216338:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.216340:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.216364:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac4797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e544f expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.216372:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac4797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e544f expref: 25 pid: 8480 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.216381:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279424:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.216427:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.224757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.225772:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466279424:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.225806:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.225825:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8c600, rc 0) 00000100:00100000:1.0:1746147177.225865:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28453:x1830967463396096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9589us (9753us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.225873:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10929 00000100:00100000:0.0:1746147177.232713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.232763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.232996:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5303 00000100:00100000:1.0:1746147177.233014:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967463396736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.233032:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.233042:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdac4789 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5441 expref: 304 pid: 14049 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.233054:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdac4789 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5441 expref: 304 pid: 14049 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.233073:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ec200/0xb4b2209fbdac4789 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5441 expref: 304 pid: 14049 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.233095:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.233100:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac485b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147177.233108:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac485b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147177.233114:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac485b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147177.233147:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.233184:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967463396736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 179us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.233191:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5303 00000100:00100000:1.0:1746147177.237907:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1958:x1830967463395456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30634us (31092us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.237920:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4025 00002000:00100000:1.0:1746147177.237930:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a4672680 x1830967463395456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.237959:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967463395456 ext(3145728->4194303) 00002000:00010000:1.0:1746147177.237965:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4672680 00000100:00100000:1.0:1746147177.249623:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463395712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 41373us (42775us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.249631:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4027 00002000:00100000:1.0:1746147177.249638:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012d499c00 x1830967463395712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.249646:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967463395712 ext(2097152->3145727) 00002000:00010000:1.0:1746147177.249650:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:0.0:1746147177.255612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.255818:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463397120 00000100:00100000:1.0:1746147177.255826:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463397120 00000100:00100000:1.0:1746147177.255863:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10930 00000100:00100000:1.0:1746147177.255870:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:28436:x1830967463397120:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.255885:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.255899:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e54f0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.255924:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.255933:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.255957:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a200/0xb4b2209fbdac47c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5472 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.255964:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.255966:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.255970:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54f0 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.255994:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a200/0xb4b2209fbdac47c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5472 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.256004:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a200/0xb4b2209fbdac47c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5472 expref: 14 pid: 8478 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.256015:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466279936:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.256078:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.256086:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 9 pid: 6881 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.256095:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466280064:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.256116:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 14 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.256124:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 14 pid: 21080 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.256136:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466280192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.256148:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.259078:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466279936:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.259088:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466280064:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.259095:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466280192:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.259120:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54f0 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.259132:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8dc00, rc 0) 00000100:00100000:1.0:1746147177.259164:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+14:28436:x1830967463397120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3294us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.259170:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10930 00000100:00100000:0.0:1746147177.260408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.260447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.260502:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398016 00000100:00100000:1.0:1746147177.260510:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398016 00002000:00100000:1.0:1746147177.260540:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f769500 x1830967463398016/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.260547:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769500 with x1830967463398016 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.260552:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769500 00000100:00100000:1.0:1746147177.260576:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398144 00000100:00100000:1.0:1746147177.260578:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398144 00002000:00100000:1.0:1746147177.260590:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f768700 x1830967463398144/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.260597:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768700 with x1830967463398144 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.260601:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f768700 00000100:00100000:1.0:1746147177.260611:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4028 00000100:00100000:1.0:1746147177.260617:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463398016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.261811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.261919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.261963:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463397888 00000100:00100000:0.0:1746147177.261966:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463397888 00010000:00010000:0.0:1746147177.261980:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 11 pid: 6881 timeout: 664 lvb_type: 1 00000100:00100000:0.0:1746147177.261997:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5306 00000100:00100000:0.0:1746147177.262002:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463397888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.262008:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.262020:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 11 pid: 6881 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.262037:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 11 pid: 6881 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.262066:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac4831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54b8 expref: 11 pid: 6881 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.262077:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147177.262108:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463397888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.262118:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5306 00000100:00100000:0.0:1746147177.268688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.268742:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398272 00000100:00100000:1.0:1746147177.268751:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398272 00010000:00010000:1.0:1746147177.268784:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 15 pid: 21080 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.268860:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5307 00000100:00100000:1.0:1746147177.268868:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967463398272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.268881:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.268901:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 15 pid: 21080 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.268912:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 15 pid: 21080 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.268931:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac47a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e545d expref: 15 pid: 21080 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.269303:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.269304:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.269311:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54f0 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.269318:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54f0 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.269352:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb8dc00/0xb4b2209fbdac4869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54f0 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.269364:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466280320:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147177.269444:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.270407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.270613:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398528 00000100:00100000:1.0:1746147177.270621:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398528 00000100:00100000:1.0:1746147177.270650:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10931 00000100:00100000:1.0:1746147177.270656:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463398528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.270677:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.270688:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5505 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.270702:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.270703:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.270708:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5505 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.270717:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5505 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.270724:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8d600, rc 0) 00000100:00100000:1.0:1746147177.270748:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463398528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.270753:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10931 00000100:00100000:0.0:1746147177.272194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.272443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.276399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.276576:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398784 00000100:00100000:1.0:1746147177.276585:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398784 00000100:00100000:1.0:1746147177.276622:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10934 00000100:00100000:1.0:1746147177.276628:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:28436:x1830967463398784:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.276646:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.276660:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d000/0xb4b2209fbdac48a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5513 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.276690:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013074f400/0xb4b2209fbdac47ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5464 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.276698:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f564600/0xb4b2209fbdac482a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54bf expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.276704:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.276709:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.276711:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.276714:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d000/0xb4b2209fbdac48a8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5513 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.276737:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.276745:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.276758:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466280960:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.276810:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f564600/0xb4b2209fbdac482a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54bf expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.276817:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f564600/0xb4b2209fbdac482a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54bf expref: 12 pid: 6881 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.276825:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281088:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.276846:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013074f400/0xb4b2209fbdac47ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5464 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.276853:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013074f400/0xb4b2209fbdac47ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5464 expref: 25 pid: 21080 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.276859:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281216:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.276872:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.276891:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466280320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147177.276900:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.276914:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967463398272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8047us (8248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.276920:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5307 00000100:00100000:0.0:1746147177.283917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.284283:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466280960:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.284292:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281088:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.284299:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281216:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.284317:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d000/0xb4b2209fbdac48a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5513 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.284325:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8d000, rc 0) 00000100:00100000:1.0:1746147177.284351:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:28436:x1830967463398784:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7722us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.284356:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10934 00000100:00100000:1.0:1746147177.284374:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463399424 00000100:00100000:1.0:1746147177.284380:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463399424 00010000:00010000:1.0:1746147177.284397:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198600/0xb4b2209fbdac4632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a7 expref: 14 pid: 4445 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.284429:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5308 00000100:00100000:1.0:1746147177.284435:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1957:x1830967463399424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.284445:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.284460:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f198600/0xb4b2209fbdac4632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a7 expref: 14 pid: 4445 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.284468:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f198600/0xb4b2209fbdac4632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a7 expref: 14 pid: 4445 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.284484:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f198600/0xb4b2209fbdac4632 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53a7 expref: 14 pid: 4445 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.284504:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.284521:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1957:x1830967463399424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.284526:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5308 00000100:00100000:0.0:1746147177.287152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.287186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.287204:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463399680 00000100:00100000:0.0:1746147177.287208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.287214:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463399680 00000100:00100000:0.0:1746147177.287222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.287234:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463398912 00000100:00100000:0.0:1746147177.287237:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463398912 00010000:00010000:0.0:1746147177.287256:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198a00/0xb4b2209fbdac4647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ca expref: 13 pid: 11147 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.287262:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10935 00000100:00100000:1.0:1746147177.287268:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+13:28448:x1830967463399680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.287282:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147177.287282:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5309 00000100:00100000:0.0:1746147177.287288:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463399168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.287293:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8cc00/0xb4b2209fbdac48af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e551a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.287301:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.287307:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.287310:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.287316:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8cc00/0xb4b2209fbdac48af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2310144->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e551a expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.287316:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.287326:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 664 lvb_type: 1 00010000:00010000:1.0:1746147177.287327:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8cc00/0xb4b2209fbdac48af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2310144->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e551a expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.287335:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8cc00, rc 0) 00010000:00010000:0.0:1746147177.287340:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4513200/0xb4b2209fbdac480e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e549c expref: 11 pid: 17548 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.287357:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.287381:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+14:28448:x1830967463399680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.287381:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463399168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.287386:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10935 00000100:00100000:0.0:1746147177.287386:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5309 00000100:00100000:0.0:1746147177.287413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.287452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.294932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.295804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.296050:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463400320 00000100:00100000:1.0:1746147177.296054:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463400320 00000100:00100000:1.0:1746147177.296076:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10936 00000100:00100000:1.0:1746147177.296082:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:28436:x1830967463400320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.296093:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.296105:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5521 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.296123:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.296130:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5505 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.296136:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.296137:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.296141:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5521 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.296161:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5505 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.296172:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8d600/0xb4b2209fbdac4893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5505 expref: 24 pid: 6881 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.296181:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281600:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.296224:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.296232:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 9 pid: 6881 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.296244:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281728:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.296258:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.296316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.296329:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463400192 00000100:00100000:0.0:1746147177.296332:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463400192 00002000:00100000:0.0:1746147177.296347:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2138112->2142207) req@ffff8800a5a0ed80 x1830967463400192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.296354:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463400192 ext(2138112->2142207) 00002000:00010000:0.0:1746147177.296357:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:0.0:1746147177.296366:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4031 00000100:00100000:0.0:1746147177.296371:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463400192:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147177.296460:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463400192:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 89us (144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147177.296466:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4031 00002000:00100000:0.0:1746147177.296470:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2138112->2142207) req@ffff8800a5a0ed80 x1830967463400192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.296476:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463400192 ext(2138112->2142207) 00002000:00010000:0.0:1746147177.296480:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:1.0:1746147177.298803:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281600:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.298812:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466281728:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.298834:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5521 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.298846:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8c000, rc 0) 00000100:00100000:1.0:1746147177.298876:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:28436:x1830967463400320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2794us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.298883:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10936 00000100:00100000:0.0:1746147177.305099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.306106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.306187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.306228:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463400832 00000100:00100000:1.0:1746147177.306233:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463400832 00010000:00010000:1.0:1746147177.306248:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 10 pid: 6881 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.306265:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5315 00000100:00100000:1.0:1746147177.306270:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463400832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.306276:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.306285:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 10 pid: 6881 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.306294:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 10 pid: 6881 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.306306:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c600/0xb4b2209fbdac4854 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e54e2 expref: 10 pid: 6881 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.306317:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.306319:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.306324:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5521 expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.306332:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5521 expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.306355:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eb8c000/0xb4b2209fbdac48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5521 expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.306364:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466281856:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147177.306408:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.308429:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466281856:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147177.308429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147177.308443:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.308470:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463400832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2200us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.308477:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5315 00000100:00100000:1.0:1746147177.308522:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463400960 00000100:00100000:1.0:1746147177.308526:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463400960 00000100:00100000:1.0:1746147177.308562:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10937 00000100:00100000:1.0:1746147177.308568:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:28436:x1830967463400960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.308580:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.308592:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac48bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5528 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.308611:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac4655 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53c3 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.308618:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e2d400/0xb4b2209fbdac46e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5410 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.310753:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ed expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.310762:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.310764:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.310768:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac48bd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5528 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.310797:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ed expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.310810:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a99400/0xb4b2209fbdac466a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53ed expref: 13 pid: 21080 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.310821:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466281984:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.310910:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e2d400/0xb4b2209fbdac46e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5410 expref: 8 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.310922:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e2d400/0xb4b2209fbdac46e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5410 expref: 8 pid: 4445 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.310929:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466282112:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.310978:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac4655 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53c3 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.310984:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a38a00/0xb4b2209fbdac4655 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53c3 expref: 13 pid: 21080 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.310990:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466282240:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.311003:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.313342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.313402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.313488:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463401216 00000100:00100000:0.0:1746147177.313496:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463401216 00000100:00100000:0.0:1746147177.313531:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4043 00000100:00100000:0.0:1746147177.313538:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28455:x1830967463401216:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147177.313708:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28455:x1830967463401216:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 170us (371us total) trans 8589944026 rc 0/0 00000100:00100000:0.0:1746147177.313714:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4043 00000100:00100000:0.0:1746147177.321442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.321468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.321490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.321601:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466281984:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.321610:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466282112:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.321616:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466282240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.321643:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8d200/0xb4b2209fbdac48bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5528 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.321654:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8d200, rc 0) 00000100:00100000:1.0:1746147177.321701:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:28436:x1830967463400960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 13132us (13274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.321707:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10937 00000100:00100000:1.0:1746147177.324302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.324465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.324479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.324506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.324517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.324600:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463402112 00000100:00100000:0.0:1746147177.324607:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463402112 00000100:00100000:0.0:1746147177.324632:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463402240 00000100:00100000:0.0:1746147177.324633:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463402240 00000100:00100000:0.0:1746147177.324652:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463402368 00000100:00100000:0.0:1746147177.324654:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463402368 00000100:00100000:0.0:1746147177.324754:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463402496 00000100:00100000:0.0:1746147177.324757:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463402496 00000100:00100000:0.0:1746147177.324771:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10940 00000100:00100000:0.0:1746147177.324777:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463402112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.324790:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.324802:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f600/0xb4b2209fbdac48d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e553d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.324838:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466282752:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.324884:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.324900:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10943 00000100:00100000:0.0:1746147177.324904:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463402496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.324910:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.324916:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ea00/0xb4b2209fbdac48e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5552 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.324931:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ea00/0xb4b2209fbdac48e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5552 expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.324956:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ea00/0xb4b2209fbdac48e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5552 expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.324968:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9ea00, rc 0) 00000100:00100000:0.0:1746147177.324986:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463402496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 81us (467us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.324991:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10943 00000100:00100000:0.0:1746147177.331825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147177.331876:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147174 -> 1746147176 00002000:00010000:0.0:1746147177.331879:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147176 -> 1746147177 00000100:00100000:0.0:1746147177.331893:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466283008:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.331914:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef76a00/0xb4b2209fbdac48e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e554b expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.331926:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef76a00/0xb4b2209fbdac48e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e554b expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.331935:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef76a00, rc 0) 00000100:00100000:0.0:1746147177.331969:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+13:1957:x1830967463402368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7084us (7463us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.331975:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10942 00002000:00010000:1.0:1746147177.332191:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147176 -> 1746147177 00000100:00100000:1.0:1746147177.332203:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466282752:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.332222:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f600/0xb4b2209fbdac48d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e553d expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.332231:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9f600/0xb4b2209fbdac48d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e553d expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.332239:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9f600, rc 0) 00000100:00100000:1.0:1746147177.332254:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463402112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7478us (7790us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.332258:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10940 00000100:00100000:0.0:1746147177.335150:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466283264:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147177.335179:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.335191:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ef0a00, rc 0) 00000100:00100000:0.0:1746147177.335219:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:28436:x1830967463402624:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3302us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.335225:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10944 00000100:00100000:0.0:1746147177.336289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.340487:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463403008 00000100:00100000:0.0:1746147177.340496:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463403008 00000100:00100000:0.0:1746147177.340544:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10945 00000100:00100000:0.0:1746147177.340600:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+12:28448:x1830967463403008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.340616:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.340629:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac48f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5560 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.340656:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.340662:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.340675:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147177.340678:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac48f5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->5242879] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5560 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.340693:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463402880 00000100:00100000:1.0:1746147177.340696:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463402880 00010000:00010000:1.0:1746147177.340711:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da3d200/0xb4b2209fbdac48a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2138112->2310143] (req 2138112->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e550c expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.340711:0:4444:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.340722:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac48f5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4870144->5242879] (req 4870144->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5560 expref: 13 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.340731:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5320 00010000:00010000:0.0:1746147177.340731:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9e400, rc 0) 00000100:00100000:1.0:1746147177.340736:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463402880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.340743:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.340757:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da3d200/0xb4b2209fbdac48a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2138112->2310143] (req 2138112->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e550c expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.340766:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da3d200/0xb4b2209fbdac48a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2138112->2310143] (req 2138112->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e550c expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00000100:00100000:0.0:1746147177.340767:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+13:28448:x1830967463403008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 216us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.340772:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10945 00010000:00010000:1.0:1746147177.340780:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da3d200/0xb4b2209fbdac48a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2138112->2310143] (req 2138112->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e550c expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.340790:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.340791:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.340795:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.340801:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.340819:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.340828:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.340838:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466283520:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147177.341003:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.345330:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466283520:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147177.345348:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.345690:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463402880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4950us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.345700:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5320 00000100:00100000:0.0:1746147177.347204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.347426:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463403392 00000100:00100000:1.0:1746147177.347434:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463403392 00000100:00100000:1.0:1746147177.347481:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10946 00000100:00100000:1.0:1746147177.347488:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+13:28458:x1830967463403392:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147177.347506:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.347525:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb8da00/0xb4b2209fbdac491f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e556e expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.347551:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.347554:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.347559:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb8da00/0xb4b2209fbdac491f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2584576->2629631] (req 2584576->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e556e expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.347577:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb8da00/0xb4b2209fbdac491f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2584576->2629631] (req 2584576->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e556e expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.347587:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb8da00, rc 0) 00000100:00100000:1.0:1746147177.347633:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+14:28458:x1830967463403392:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 144us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.347639:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10946 00000100:00100000:0.0:1746147177.354402:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1411 00000100:00100000:0.0:1746147177.354424:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1412 00000100:00100000:0.0:1746147177.354434:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463403904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.355491:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463403648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.365151:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463404416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9858us (9956us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147177.365162:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4034 00002000:00100000:0.0:1746147177.365174:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d34700 x1830967463404416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.365181:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34700 with x1830967463404416 ext(3145728->4194303) 00002000:00010000:0.0:1746147177.365186:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34700 00000100:00100000:1.0:1746147177.373191:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463403904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18749us (19962us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.373202:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1412 00002000:00100000:1.0:1746147177.373214:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e5c9c00 x1830967463403904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.373228:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9c00 with x1830967463403904 ext(3145728->4194303) 00010000:00010000:1.0:1746147177.373236:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 12 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.373249:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 12 pid: 8480 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.373255:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9c00 00000100:00100000:1.0:1746147177.376651:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463403648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22231us (23473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.376661:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1411 00002000:00100000:1.0:1746147177.376683:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c8e00 x1830967463403648/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.376691:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967463403648 ext(2097152->3145727) 00010000:00010000:1.0:1746147177.376699:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.376712:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 10 pid: 8480 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.376718:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8e00 00000100:00100000:0.0:1746147177.380855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.381770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.381806:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463404672 00000100:00100000:1.0:1746147177.381810:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463404672 00010000:00010000:1.0:1746147177.381829:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.381850:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5321 00000100:00100000:1.0:1746147177.381855:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463404672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.381863:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147177.381884:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.381893:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.381910:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef76400/0xb4b2209fbdac48c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e552f expref: 11 pid: 8480 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.381934:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.381952:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.381958:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.381965:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.381997:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.382008:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099ef0a00/0xb4b2209fbdac48ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5559 expref: 12 pid: 4444 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.382023:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466283648:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147177.382086:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.383096:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466283648:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147177.383113:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.383139:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463404672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1283us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.383146:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5321 00000100:00100000:0.0:1746147177.383252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.387997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.388221:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463405056 00000100:00100000:1.0:1746147177.388227:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463405056 00000100:00100000:0.0:1746147177.388242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147177.388248:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdac45f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5376 expref: 9 pid: 4444 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.388274:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463404928 00000100:00100000:1.0:1746147177.388275:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463404928 00010000:00010000:1.0:1746147177.388282:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f00a400/0xb4b2209fbdac465c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e53d1 expref: 12 pid: 8481 timeout: 664 lvb_type: 1 00000100:00100000:1.0:1746147177.388297:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5322 00000100:00100000:1.0:1746147177.388301:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463405056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147177.388311:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147177.388319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147177.388334:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdac45f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5376 expref: 9 pid: 4444 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.388343:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdac45f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5376 expref: 9 pid: 4444 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.388375:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a76fe400/0xb4b2209fbdac45f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5376 expref: 9 pid: 4444 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.388529:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.388548:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463405056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 245us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.388554:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5322 00000100:00100000:0.0:1746147177.392576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.392605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.392628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.392642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.393487:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463405568 00000100:00100000:0.0:1746147177.393490:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463405568 00000100:00100000:0.0:1746147177.393508:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10953 00000100:00100000:0.0:1746147177.393513:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463405568:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147177.393584:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147177.393586:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147177.393588:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147177.393590:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147177 -> 1746147177 00002000:00010000:0.0:1746147177.393591:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147177.393611:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463405568:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 98us (137us total) trans 17179873115 rc 0/0 00000100:00100000:0.0:1746147177.393617:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10953 00000100:00100000:0.0:1746147177.393632:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463405824 00000100:00100000:0.0:1746147177.393634:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463405824 00000100:00100000:0.0:1746147177.393645:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10954 00000100:00100000:0.0:1746147177.393649:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463405824:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147177.393718:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147177.393720:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147177 -> 1746147176 00002000:00010000:0.0:1746147177.393722:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147177.393723:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147177 -> 1746147177 00002000:00010000:0.0:1746147177.393725:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:0.0:1746147177.393744:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463405824:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 94us (225us total) trans 21474840514 rc 0/0 00000100:00100000:0.0:1746147177.393749:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10954 00000100:00100000:0.0:1746147177.397229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.397278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.397283:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463406336 00000100:00100000:1.0:1746147177.397290:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463406336 00000100:00100000:1.0:1746147177.397552:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10324 00000100:00100000:1.0:1746147177.397556:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463406336:12345-192.168.203.36@tcp:55:lfs.0 00010000:00010000:1.0:1746147177.397604:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397615:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397623:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397645:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397651:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397656:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397662:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea41600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147177.397675:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397681:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397688:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.397691:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1746147177.397694:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.397698:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac4934 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147177.397722:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463406336:12345-192.168.203.36@tcp:55:lfs.0 Request processed in 165us (504us total) trans 0 rc -22/-22 00000100:00100000:1.0:1746147177.397728:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10324 00000100:00100000:0.0:1746147177.399562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.399601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.399623:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463406720 00000100:00100000:0.0:1746147177.399626:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463406720 00000100:00100000:0.0:1746147177.399652:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10955 00000100:00100000:0.0:1746147177.399658:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1958:x1830967463406720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.399682:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.399694:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b485d400/0xb4b2209fbdac493b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5583 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.399733:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466284672:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.399775:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.399788:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463406848 00000100:00100000:0.0:1746147177.399791:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463406848 00000100:00100000:0.0:1746147177.399809:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10956 00000100:00100000:0.0:1746147177.399813:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463406848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.399820:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.399830:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdac4942 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e558a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.399852:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466284800:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.399863:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463406976 00000100:00100000:1.0:1746147177.399866:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463406976 00000100:00100000:0.0:1746147177.399875:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.399884:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10957 00000100:00100000:1.0:1746147177.399888:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463406976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.399894:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.399900:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea41c00/0xb4b2209fbdac4949 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5591 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.399926:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466284928:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.399994:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.400011:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463406592 00000100:00100000:1.0:1746147177.400014:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463406592 00002000:00100000:1.0:1746147177.400039:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2584576->2588671) req@ffff88009f76d500 x1830967463406592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.400047:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d500 with x1830967463406592 ext(2584576->2588671) 00002000:00010000:1.0:1746147177.400298:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76d500 00000100:00100000:1.0:1746147177.400319:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4035 00000100:00100000:1.0:1746147177.400324:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463406592:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147177.400463:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463406592:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 138us (907us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147177.400468:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4035 00002000:00100000:1.0:1746147177.400473:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2584576->2588671) req@ffff88009f76d500 x1830967463406592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.400480:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d500 with x1830967463406592 ext(2584576->2588671) 00002000:00010000:1.0:1746147177.400483:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76d500 00000100:00100000:0.0:1746147177.401227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.401252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.401440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.401513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.401530:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463407616 00000100:00100000:0.0:1746147177.401533:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463407616 00000100:00100000:0.0:1746147177.401553:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4044 00000100:00100000:0.0:1746147177.401558:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28436:x1830967463407616:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147177.401719:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28436:x1830967463407616:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 159us (204us total) trans 8589944028 rc 0/0 00000100:00100000:0.0:1746147177.401724:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4044 00000100:00100000:0.0:1746147177.401755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.401809:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466284672:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.401823:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b485d400/0xb4b2209fbdac493b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5583 expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.401836:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b485d400/0xb4b2209fbdac493b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5583 expref: 17 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.401848:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485d400, rc 0) 00000100:00100000:0.0:1746147177.401861:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463406720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2204us (2259us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.401867:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10955 00000100:00100000:0.0:1746147177.401900:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466284800:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.401911:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdac4942 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e558a expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.401920:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b95a800/0xb4b2209fbdac4942 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e558a expref: 28 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.401926:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a800, rc 0) 00000100:00100000:0.0:1746147177.401959:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463406848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2144us (2245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.401964:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10956 00000100:00100000:1.0:1746147177.404354:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466284928:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.404380:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea41c00/0xb4b2209fbdac4949 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5591 expref: 26 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.404389:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea41c00/0xb4b2209fbdac4949 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5591 expref: 26 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.404405:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41c00, rc 0) 00000100:00100000:1.0:1746147177.404429:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463406976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4539us (4615us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.404436:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10957 00000100:00100000:0.0:1746147177.405925:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463408128 00000100:00100000:0.0:1746147177.405932:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463408128 00002000:00100000:0.0:1746147177.406170:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2625536->2629631) req@ffff8800a56b5180 x1830967463408128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.406179:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463408128 ext(2625536->2629631) 00002000:00010000:0.0:1746147177.406184:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b5180 00000100:00100000:1.0:1746147177.406192:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463408384 00000100:00100000:1.0:1746147177.406195:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463408384 00000100:00100000:0.0:1746147177.406200:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4037 00000100:00100000:0.0:1746147177.406205:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967463408128:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147177.406216:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4045 00000100:00100000:1.0:1746147177.406220:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:28436:x1830967463408384:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147177.406333:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967463408128:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 127us (466us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147177.406338:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4037 00002000:00100000:0.0:1746147177.406342:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2625536->2629631) req@ffff8800a56b5180 x1830967463408128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.406348:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463408128 ext(2625536->2629631) 00002000:00010000:0.0:1746147177.406350:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b5180 00000100:00100000:1.0:1746147177.406413:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:28436:x1830967463408384:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 191us (270us total) trans 8589944029 rc 0/0 00000100:00100000:1.0:1746147177.406418:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4045 00000100:00100000:1.0:1746147177.413297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.413333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.413374:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463408896 00000100:00100000:0.0:1746147177.413381:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463408896 00000100:00100000:1.0:1746147177.413411:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4047 00000100:00100000:1.0:1746147177.413421:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28448:x1830967463408896:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147177.414118:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28448:x1830967463408896:12345-192.168.203.36@tcp:35:cat.0 Request processed in 698us (782us total) trans 8589944031 rc 0/0 00000100:00100000:1.0:1746147177.414126:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4047 00000100:00100000:1.0:1746147177.416234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.417926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.423759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.434796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.434911:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463409664 00000100:00100000:1.0:1746147177.434918:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463409664 00000100:00100000:1.0:1746147177.435013:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10325 00000100:00100000:1.0:1746147177.435020:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28463:x1830967463409664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147177.435054:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.435071:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e600/0xb4b2209fbdac496c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55b4 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.435173:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435185:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435198:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435211:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435216:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435221:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435321:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4981 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435328:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4981 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435334:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4981 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147177.435341:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147177.435424:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435429:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435434:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435438:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147177.435442:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435448:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435457:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147177.435459:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147177.435462:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435466:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f400/0xb4b2209fbdac4973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435479:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435483:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435487:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435490:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9e000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147177.435491:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435494:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435498:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f300) 00010000:00010000:1.0:1746147177.435500:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147177.435501:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435504:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac497a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.435535:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e600/0xb4b2209fbdac496c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55b4 expref: 14 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.435544:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac4981 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55b4 expref: 13 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.435550:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.435551:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147177.435553:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9f800, rc 0) 00000100:00100000:1.0:1746147177.435591:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28463:x1830967463409664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 572us (804us total) trans 8589944032 rc 0/0 00000100:00100000:1.0:1746147177.435596:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10325 00000100:00100000:0.0:1746147177.437485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.437516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.437536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.437549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.437600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.437876:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10964 00000100:00100000:1.0:1746147177.437883:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463410304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.437888:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.437896:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9fa00/0xb4b2209fbdac4996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55d7 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.437913:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9fa00/0xb4b2209fbdac4996 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55d7 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.437922:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9fa00/0xb4b2209fbdac4996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55d7 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.437932:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9fa00, rc 0) 00000100:00100000:1.0:1746147177.437990:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463410304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 107us (452us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.437996:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10964 00000100:00100000:0.0:1746147177.442512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.454730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.454776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.454801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.454813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.454884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.455521:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10968 00000100:00100000:1.0:1746147177.455529:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463410944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.455536:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.455547:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac49b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55ec expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.455569:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466286208:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.455591:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.455607:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10969 00000100:00100000:1.0:1746147177.455614:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463411200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.455622:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.455630:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac49c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55fa expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.455652:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac49c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55fa expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.455663:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac49c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55fa expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.455695:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9ee00, rc 0) 00000100:00100000:1.0:1746147177.455725:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463411200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (922us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.455732:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10969 00000100:00100000:1.0:1746147177.455750:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10970 00000100:00100000:1.0:1746147177.455755:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463410816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.455761:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.455768:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fc00/0xb4b2209fbdac49c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55e5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.455795:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466286336:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.455823:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.455977:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10971 00000100:00100000:0.0:1746147177.455984:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463411072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.455990:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.455996:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac49ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e55f3 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.456018:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466286464:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.456044:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.457322:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466286464:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.457341:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac49ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55f3 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.457350:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac49ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55f3 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.457371:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40400, rc 0) 00000100:00100000:0.0:1746147177.457393:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463411072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1409us (2509us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.457398:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10971 00000100:00100000:0.0:1746147177.457478:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466286208:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.457527:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac49b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55ec expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.457536:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac49b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55ec expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147177.457543:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466286336:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.457546:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9ec00, rc 0) 00000100:00100000:0.0:1746147177.457566:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463410944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2039us (2789us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.457570:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10968 00010000:00010000:1.0:1746147177.457702:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fc00/0xb4b2209fbdac49c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55e5 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.457711:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fc00/0xb4b2209fbdac49c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e55e5 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.457718:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9fc00, rc 0) 00000100:00100000:1.0:1746147177.457747:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463410816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1992us (2932us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.457753:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10970 00000100:00100000:0.0:1746147177.459861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.459890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.459919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.459951:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463411328 00000100:00100000:0.0:1746147177.459957:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463411328 00000100:00100000:1.0:1746147177.459974:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463411840 00000100:00100000:1.0:1746147177.459978:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463411840 00000100:00100000:0.0:1746147177.460013:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10973 00000100:00100000:0.0:1746147177.460019:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463411328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.460026:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.460036:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac49dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5601 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.460067:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466286720:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.460100:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10974 00000100:00100000:1.0:1746147177.460107:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463411840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.460113:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.460121:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e200/0xb4b2209fbdac49e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e561d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.460144:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e200/0xb4b2209fbdac49e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e561d expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.460153:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e200/0xb4b2209fbdac49e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e561d expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.460161:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9e200, rc 0) 00000100:00100000:1.0:1746147177.460180:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463411840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (260us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.460185:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10974 00000100:00100000:1.0:1746147177.460196:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463411456 00000100:00100000:1.0:1746147177.460199:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463411456 00000100:00100000:1.0:1746147177.460210:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10975 00000100:00100000:1.0:1746147177.460215:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463411456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.460220:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.460226:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac49ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5608 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.460246:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466286848:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.460265:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.460276:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463411712 00000100:00100000:1.0:1746147177.460279:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463411712 00000100:00100000:1.0:1746147177.460292:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10976 00000100:00100000:1.0:1746147177.460296:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463411712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.460302:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.460308:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9fa00/0xb4b2209fbdac49f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5616 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.460327:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466286976:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.460345:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.460423:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.461589:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466286848:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.461603:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac49ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5608 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.461611:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef9fe00/0xb4b2209fbdac49ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5608 expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.461617:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9fe00, rc 0) 00000100:00100000:1.0:1746147177.461637:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463411456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1421us (1481us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.461641:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10975 00000100:00100000:0.0:1746147177.465182:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466286720:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.465199:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac49dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5601 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.465207:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac49dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5601 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.465213:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41c00, rc 0) 00000100:00100000:0.0:1746147177.465236:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463411328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5217us (5382us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.465442:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10973 00000100:00100000:0.0:1746147177.468816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.468904:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463412096 00000100:00100000:1.0:1746147177.468913:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463412096 00000100:00100000:1.0:1746147177.468992:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4048 00000100:00100000:1.0:1746147177.469000:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28453:x1830967463412096:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147177.469170:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28453:x1830967463412096:12345-192.168.203.36@tcp:35:cat.0 Request processed in 171us (361us total) trans 8589944033 rc 0/0 00000100:00100000:1.0:1746147177.469177:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4048 00000100:00100000:0.0:1746147177.496303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.499637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.502180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.508310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.513473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.513499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.516923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.519923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.520022:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463413504 00000100:00100000:1.0:1746147177.520030:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463413504 00000100:00100000:1.0:1746147177.520059:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4049 00000100:00100000:1.0:1746147177.520066:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28463:x1830967463413504:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147177.520610:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28463:x1830967463413504:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 159us (308us total) trans 8589944034 rc 0/0 00000100:00100000:1.0:1746147177.520617:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4049 00000100:00100000:0.0:1746147177.536982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.595788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.597322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.597622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.597641:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463414272 00000100:00100000:0.0:1746147177.597644:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463414272 00002000:00100000:0.0:1746147177.597679:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2584576->2629631) req@ffff88009e682680 x1830967463414272/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.597686:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682680 with x1830967463414272 ext(2584576->2629631) 00010000:00010000:0.0:1746147177.597692:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eb8da00/0xb4b2209fbdac491f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2584576->2629631] (req 2584576->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e556e expref: 15 pid: 4444 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.597706:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eb8da00/0xb4b2209fbdac491f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2584576->2629631] (req 2584576->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e556e expref: 15 pid: 4444 timeout: 664 lvb_type: 0 00002000:00010000:0.0:1746147177.597712:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e682680 00000100:00100000:0.0:1746147177.597726:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1413 00000100:00100000:0.0:1746147177.597731:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967463414272:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147177.599896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.600167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.600196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.600210:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463414784 00000100:00100000:1.0:1746147177.600213:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463414784 00000100:00100000:1.0:1746147177.600230:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463414656 00000100:00100000:1.0:1746147177.600232:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463414656 00000100:00100000:1.0:1746147177.600249:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10981 00000100:00100000:1.0:1746147177.600255:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463414784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.600269:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.600282:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e600/0xb4b2209fbdac4a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e565c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.600323:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466287872:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.600369:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.600426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.600488:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463414912 00000100:00100000:1.0:1746147177.600491:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463414912 00000100:00100000:1.0:1746147177.600507:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10983 00000100:00100000:1.0:1746147177.600511:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463414912:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.600518:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.600525:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac4a53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5663 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.600547:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466288128:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.600595:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.601259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.602803:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466287872:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.602821:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e600/0xb4b2209fbdac4a45 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e565c expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.602830:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e600/0xb4b2209fbdac4a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e565c expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.602841:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9e600, rc 0) 00000100:00100000:1.0:1746147177.602858:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463414784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2604us (2691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.602863:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10981 00000100:00100000:0.0:1746147177.603061:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466288128:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.603076:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac4a53 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5663 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.603083:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e400/0xb4b2209fbdac4a53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5663 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.603103:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9e400, rc 0) 00000100:00100000:0.0:1746147177.603125:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463414912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2609us (2696us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.603130:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10983 00000100:00100000:1.0:1746147177.606756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.607747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.610449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.615793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.616504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.625293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.626748:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463416320 00000100:00100000:1.0:1746147177.626760:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463416320 00000100:00100000:1.0:1746147177.626810:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4050 00000100:00100000:1.0:1746147177.626819:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+308:28467:x1830967463416320:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147177.627006:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28467:x1830967463416320:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 188us (1719us total) trans 8589944037 rc 0/0 00000100:00100000:1.0:1746147177.627012:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4050 00000100:00100000:0.0:1746147177.635166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.639971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.646305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.651266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.652619:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463417088 00000100:00100000:1.0:1746147177.652629:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463417088 00000100:00100000:1.0:1746147177.652694:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10328 00000100:00100000:1.0:1746147177.652702:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28474:x1830967463417088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.652724:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.652738:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5678 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.652812:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.652822:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.652831:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147177.652839:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147177.652922:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 312 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.652954:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 311 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.652961:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.652963:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147177.652965:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9f600, rc 0) 00000100:00100000:1.0:1746147177.652998:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+311:28474:x1830967463417088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 297us (1740us total) trans 8589944038 rc 0/0 00000100:00100000:1.0:1746147177.653004:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10328 00000100:00100000:0.0:1746147177.660871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.660879:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463417600 00000100:00100000:0.0:1746147177.660882:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463417600 00000100:00100000:0.0:1746147177.660900:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10988 00000100:00100000:0.0:1746147177.660904:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967463417600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.660911:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.660919:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdac4a92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5694 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.660972:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466289152:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.661023:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.661048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.661065:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463417216 00000100:00100000:1.0:1746147177.661069:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463417216 00000100:00100000:0.0:1746147177.661071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.661093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.661472:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10990 00000100:00100000:1.0:1746147177.661481:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463417216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.661488:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.661495:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e567f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.661509:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.661511:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.661515:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e567f expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.661525:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e567f expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.661531:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9e000, rc 0) 00000100:00100000:1.0:1746147177.661546:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463417216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 68us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.661551:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10990 00000100:00100000:0.0:1746147177.661722:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10991 00000100:00100000:0.0:1746147177.661728:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463417472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147177.661735:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.661742:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdac4aa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e568d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.661763:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466289408:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147177.661783:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.665791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.667726:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466289152:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147177.667742:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdac4a92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5694 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.667750:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a600/0xb4b2209fbdac4a92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5694 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.667765:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a600, rc 0) 00000100:00100000:0.0:1746147177.667784:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463417600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6879us (6914us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147177.667789:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10988 00000100:00100000:1.0:1746147177.668547:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466289408:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.668560:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdac4aa7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e568d expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.668568:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ac00/0xb4b2209fbdac4aa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e568d expref: 25 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.668576:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95ac00, rc 0) 00000100:00100000:1.0:1746147177.668605:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463417472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6877us (7533us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.668611:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10991 00000100:00100000:0.0:1746147177.671205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.677153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.684466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.684759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.684926:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463418880 00000100:00100000:1.0:1746147177.684930:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463418880 00002000:00100000:1.0:1746147177.684967:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800936df800 x1830967463418880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.684973:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967463418880 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.684977:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:1.0:1746147177.684989:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4048 00000100:00100000:1.0:1746147177.684993:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463418880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.702080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.702867:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463418880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17869us (18104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.702877:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4048 00002000:00100000:1.0:1746147177.702890:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800936df800 x1830967463418880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.702899:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830967463418880 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.702903:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:0.0:1746147177.707516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.710897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.716524:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463419520 00000100:00100000:1.0:1746147177.716534:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463419520 00002000:00100000:1.0:1746147177.716577:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009e5e0380 x1830967463419520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.716585:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463419520 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.716589:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5e0380 00000100:00100000:1.0:1746147177.717057:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463419776 00000100:00100000:1.0:1746147177.717060:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463419776 00002000:00100000:1.0:1746147177.717076:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009e5e3100 x1830967463419776/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.717084:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3100 with x1830967463419776 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.717087:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3100 00000100:00100000:1.0:1746147177.717099:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4049 00000100:00100000:1.0:1746147177.717105:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463419520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147177.732673:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463419520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15551us (16199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.732686:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4049 00002000:00100000:1.0:1746147177.732698:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009e5e0380 x1830967463419520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.732707:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463419520 ext(1048576->2097151) 00002000:00010000:1.0:1746147177.732712:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5e0380 00000100:00100000:0.0:1746147177.748347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.751169:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463419904 00000100:00100000:1.0:1746147177.751182:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463419904 00000100:00100000:1.0:1746147177.751249:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10996 00000100:00100000:1.0:1746147177.751257:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28474:x1830967463419904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.751274:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.751289:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac4aca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e56be expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.751311:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.751313:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.751319:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac4aca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56be expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.751335:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ee00/0xb4b2209fbdac4aca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56be expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.751345:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9ee00, rc 0) 00000100:00100000:1.0:1746147177.754339:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28474:x1830967463419904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3072us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.754349:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10996 00000100:00100000:1.0:1746147177.754637:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463420032 00000100:00100000:1.0:1746147177.754644:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463420032 00000100:00100000:1.0:1746147177.754722:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10997 00000100:00100000:1.0:1746147177.754730:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28470:x1830967463420032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.754748:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.754922:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e56c5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.754967:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b200/0xb4b2209fbdac4a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2109440->3145727] (req 2109440->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5639 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.754974:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.754975:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.754978:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56c5 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.755003:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b200/0xb4b2209fbdac4a29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2109440->3145727] (req 2109440->2764799) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5639 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.755017:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b200/0xb4b2209fbdac4a29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2109440->3145727] (req 2109440->2764799) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5639 expref: 16 pid: 11147 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.755027:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466290176:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.755107:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.758250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.758547:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466290176:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.758576:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56c5 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.758589:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef9ec00, rc 0) 00000100:00100000:1.0:1746147177.758636:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28470:x1830967463420032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3907us (4104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.758643:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10997 00000100:00100000:0.0:1746147177.760796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.765199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.766020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.785605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.785704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.788197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.788335:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463421184 00000100:00100000:1.0:1746147177.788343:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463421184 00000100:00100000:1.0:1746147177.788378:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463421312 00000100:00100000:1.0:1746147177.788380:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463421312 00000100:00100000:1.0:1746147177.788402:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10999 00000100:00100000:1.0:1746147177.788407:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463421312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.788415:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.788472:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea41a00/0xb4b2209fbdac4af4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e56da expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.788499:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466290816:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147177.788545:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147177.796555:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466290816:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147177.796584:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea41a00/0xb4b2209fbdac4af4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56da expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.796595:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea41a00/0xb4b2209fbdac4af4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56da expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.796605:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41a00, rc 0) 00000100:00100000:1.0:1746147177.796651:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463421312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8242us (8460us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147177.796658:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10999 00000100:00100000:0.0:1746147177.798225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.798252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.798271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.798292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.798613:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4053 00000100:00100000:0.0:1746147177.798621:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463422208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.802724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.803388:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463422464 00000100:00100000:1.0:1746147177.803397:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463422464 00000100:00100000:1.0:1746147177.803450:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11000 00000100:00100000:1.0:1746147177.803458:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28474:x1830967463422464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.803476:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.803492:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e56e1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.803515:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.803517:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.803523:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.803540:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.803549:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40a00, rc 0) 00000100:00100000:1.0:1746147177.803577:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28474:x1830967463422464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.803585:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11000 00000100:00100000:1.0:1746147177.806419:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463422208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7793us (8160us total) trans 0 rc 466944/466944 00000100:00100000:1.0:1746147177.806428:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4053 00002000:00100000:1.0:1746147177.806438:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3727360->4194303) req@ffff88012c9f1c00 x1830967463422208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.806447:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1c00 with x1830967463422208 ext(3727360->4194303) 00002000:00010000:1.0:1746147177.806452:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1c00 00000100:00100000:0.0:1746147177.810097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.810176:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463422720 00000100:00100000:1.0:1746147177.810185:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463422720 00002000:00100000:1.0:1746147177.810222:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e977800 x1830967463422720/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.810231:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967463422720 ext(2097152->3145727) 00002000:00010000:1.0:1746147177.810236:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:1.0:1746147177.810263:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4056 00000100:00100000:1.0:1746147177.810270:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463422720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147177.823298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.824543:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463421824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25897us (26269us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746147177.824553:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4054 00002000:00100000:1.0:1746147177.824560:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3178496->4194303) req@ffff88012c9f3100 x1830967463421824/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.824569:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967463421824 ext(3178496->4194303) 00002000:00010000:1.0:1746147177.824573:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:1.0:1746147177.826465:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463422720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16194us (16373us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147177.826473:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4056 00002000:00100000:1.0:1746147177.826481:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e977800 x1830967463422720/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/440 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.826487:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967463422720 ext(2097152->3145727) 00002000:00010000:1.0:1746147177.826491:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:0.0:1746147177.829194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.830761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.833134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.833252:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463423232 00000100:00100000:1.0:1746147177.833261:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463423232 00000100:00100000:1.0:1746147177.833299:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11002 00000100:00100000:1.0:1746147177.833308:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28474:x1830967463423232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.833323:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.833338:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66d000/0xb4b2209fbdac4b25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e56f6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.833362:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.833368:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.833371:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.833374:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66d000/0xb4b2209fbdac4b25 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56f6 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.833400:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 10 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.833412:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 10 pid: 11147 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.833422:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466291200:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.833491:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.837702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.837765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.837812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.838589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.838607:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463423488 00000100:00100000:0.0:1746147177.838610:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463423488 00000100:00100000:0.0:1746147177.838642:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463423616 00000100:00100000:0.0:1746147177.838644:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463423616 00000100:00100000:0.0:1746147177.838652:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463423744 00000100:00100000:0.0:1746147177.838653:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463423744 00000100:00100000:0.0:1746147177.838676:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11003 00000100:00100000:0.0:1746147177.838684:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463423488:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.838700:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.838713:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5704 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.838730:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838732:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838739:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838750:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838759:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485ae00, rc 0) 00000100:00100000:0.0:1746147177.838795:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463423488:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 113us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.838801:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11003 00000100:00100000:0.0:1746147177.838816:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11004 00000100:00100000:0.0:1746147177.838821:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463423616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.838826:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.838832:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e570b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.838841:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838842:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838846:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e570b expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838854:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e570b expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838860:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485a600, rc 0) 00000100:00100000:0.0:1746147177.838875:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463423616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 54us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.838879:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11004 00000100:00100000:0.0:1746147177.838889:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11005 00000100:00100000:0.0:1746147177.838893:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463423744:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147177.838899:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147177.838906:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4b3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5712 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.838919:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838921:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.838924:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4b3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5712 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838933:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4b3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5712 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147177.838961:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b485a000, rc 0) 00000100:00100000:0.0:1746147177.838976:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463423744:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.838981:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11005 00000100:00100000:1.0:1746147177.839216:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466291200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.839233:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66d000/0xb4b2209fbdac4b25 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56f6 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.839242:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66d000, rc 0) 00000100:00100000:1.0:1746147177.839263:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28474:x1830967463423232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5956us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.839268:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11002 00000100:00100000:0.0:1746147177.840681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.840719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.842398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.842537:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463424128 00000100:00100000:1.0:1746147177.842543:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463424128 00002000:00100000:1.0:1746147177.842572:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2564096->3145727) req@ffff8800a46f2680 x1830967463424128/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.842581:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f2680 with x1830967463424128 ext(2564096->3145727) 00010000:00010000:1.0:1746147177.842587:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 11 pid: 11147 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.842597:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 11 pid: 11147 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.842603:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a46f2680 00000100:00100000:1.0:1746147177.842627:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1415 00000100:00100000:1.0:1746147177.842633:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463424128:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147177.861651:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463424128:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19011us (19251us total) trans 17179873116 rc 0/0 00000100:00100000:1.0:1746147177.861675:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1415 00002000:00100000:1.0:1746147177.861685:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2564096->3145727) req@ffff8800a46f2680 x1830967463424128/t17179873116(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/448 e 0 to 0 dl 1746147188 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.861694:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a46f2680 with x1830967463424128 ext(2564096->3145727) 00010000:00010000:1.0:1746147177.861703:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 13 pid: 11147 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.861718:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a200/0xb4b2209fbdac49f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5624 expref: 13 pid: 11147 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.861724:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a46f2680 00000100:00100000:0.0:1746147177.863351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.869279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.869483:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463424896 00000100:00100000:1.0:1746147177.869488:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463424896 00000100:00100000:1.0:1746147177.869520:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10332 00000100:00100000:1.0:1746147177.869526:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+310:28480:x1830967463424896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147177.869545:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.869557:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f200/0xb4b2209fbdac4b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e572e expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.869634:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869643:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869651:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869661:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869677:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869683:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869765:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5646600/0xb4b2209fbdac4b79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869772:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5646600/0xb4b2209fbdac4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869777:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5646600/0xb4b2209fbdac4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147177.869784:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147177.869846:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869856:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869861:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.869866:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009491e400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147177.871036:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871042:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871051:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147177.871054:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147177.871057:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871061:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871193:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871199:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871203:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871207:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009491f800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147177.871210:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871218:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871224:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f900) 00010000:00010000:1.0:1746147177.871227:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147177.871229:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871233:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac4b72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147177.871270:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f200/0xb4b2209fbdac4b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e572e expref: 313 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.871280:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5646600/0xb4b2209fbdac4b79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e572e expref: 312 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.871286:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147177.871288:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147177.871290:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5646600, rc 0) 00000100:00100000:1.0:1746147177.872010:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28480:x1830967463424896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2482us (4084us total) trans 8589944040 rc 0/0 00000100:00100000:1.0:1746147177.872016:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10332 00000100:00100000:0.0:1746147177.874532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.874689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.901594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.901995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.902033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.907169:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466292224:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147177.908057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.908079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.908329:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11014 00000100:00100000:1.0:1746147177.908341:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463426432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147177.908347:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.908354:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4bbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e575f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.908369:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.908371:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147177.908378:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4bbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e575f expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.908388:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4bbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e575f expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147177.908395:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:1.0:1746147177.908410:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463426432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.908415:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11014 00000100:00100000:0.0:1746147177.913261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.913302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.913336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.913363:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463426560 00000100:00100000:0.0:1746147177.913371:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463426560 00010000:00010000:0.0:1746147177.913399:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 14 pid: 4445 timeout: 664 lvb_type: 1 00000100:00100000:0.0:1746147177.913420:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463426688 00000100:00100000:0.0:1746147177.913422:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463426688 00010000:00010000:0.0:1746147177.913431:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac4a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5686 expref: 26 pid: 17530 timeout: 664 lvb_type: 1 00000100:00100000:0.0:1746147177.913441:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463426816 00000100:00100000:0.0:1746147177.913443:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463426816 00010000:00010000:0.0:1746147177.913450:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdac4a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5671 expref: 14 pid: 17530 timeout: 664 lvb_type: 0 00000100:00100000:0.0:1746147177.913469:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5342 00000100:00100000:0.0:1746147177.913477:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463426560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.913489:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.913505:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 14 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913516:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 14 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913533:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b485ae00/0xb4b2209fbdac4b2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5704 expref: 14 pid: 4445 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913553:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147177.913585:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463426560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.913592:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5342 00000100:00100000:0.0:1746147177.913605:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5343 00000100:00100000:0.0:1746147177.913610:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463426688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.913615:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.913623:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac4a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5686 expref: 26 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913630:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac4a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5686 expref: 26 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913641:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac4a8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5686 expref: 26 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.913648:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147177.913660:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463426688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147177.913676:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5343 00000100:00100000:0.0:1746147177.913710:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5344 00000100:00100000:0.0:1746147177.913715:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463426816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.913721:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.913727:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdac4a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5671 expref: 14 pid: 17530 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.913736:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdac4a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5671 expref: 14 pid: 17530 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.913746:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3000/0xb4b2209fbdac4a6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5671 expref: 14 pid: 17530 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.913754:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.913755:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.913761:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.913767:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.913794:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147177.913804:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466292736:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147177.913853:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.915484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.915533:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463426944 00000100:00100000:1.0:1746147177.915544:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463426944 00000100:00100000:1.0:1746147177.915582:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11015 00000100:00100000:1.0:1746147177.915592:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28474:x1830967463426944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147177.915608:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147177.915621:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5766 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.915641:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 12 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.915647:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.915648:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147177.915651:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5766 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.915681:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 12 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.915691:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 12 pid: 11147 timeout: 664 lvb_type: 0 00000100:00100000:1.0:1746147177.915700:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466292864:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147177.915757:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.919019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.920587:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466292736:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147177.920597:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147177.920692:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463426816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6976us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.920700:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5344 00000100:00100000:1.0:1746147177.920726:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466292864:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147177.920740:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5766 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147177.920748:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e800, rc 0) 00000100:00100000:1.0:1746147177.921082:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28474:x1830967463426944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5494us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147177.921088:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11015 00000100:00100000:0.0:1746147177.922023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.922079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.922145:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463427200 00000100:00100000:1.0:1746147177.922150:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463427200 00002000:00100000:1.0:1746147177.922178:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3178495) req@ffff88008daace00 x1830967463427200/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.922187:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daace00 with x1830967463427200 ext(3145728->3178495) 00010000:00010000:1.0:1746147177.922192:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 13 pid: 11147 timeout: 664 lvb_type: 0 00010000:00010000:1.0:1746147177.922200:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 13 pid: 11147 timeout: 664 lvb_type: 0 00002000:00010000:1.0:1746147177.922206:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daace00 00000100:00100000:1.0:1746147177.922219:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1416 00000100:00100000:1.0:1746147177.922224:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463427200:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147177.924547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.924576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.924598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.924910:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5347 00000100:00100000:0.0:1746147177.924916:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463427840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147177.924928:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147177.925566:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d600/0xb4b2209fbdac4b8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e573c expref: 13 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.925574:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d600/0xb4b2209fbdac4b8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e573c expref: 13 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.925584:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9d600/0xb4b2209fbdac4b8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e573c expref: 13 pid: 17530 timeout: 664 lvb_type: 1 00010000:00010000:0.0:1746147177.925650:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.925653:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147177.925660:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e576d expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.925676:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4bcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e576d expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147177.925700:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4bcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e576d expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147177.925706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.925710:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466293376:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147177.925753:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147177.926359:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463427200:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4133us (4335us total) trans 21474840517 rc 0/0 00000100:00100000:0.0:1746147177.926436:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1416 00002000:00100000:0.0:1746147177.926444:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3178495) req@ffff88008daace00 x1830967463427200/t21474840517(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:553/0 lens 488/448 e 0 to 0 dl 1746147188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147177.926453:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daace00 with x1830967463427200 ext(3145728->3178495) 00010000:00010000:0.0:1746147177.926459:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 15 pid: 11147 timeout: 664 lvb_type: 0 00010000:00010000:0.0:1746147177.926469:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac49ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e562b expref: 15 pid: 11147 timeout: 664 lvb_type: 0 00002000:00010000:0.0:1746147177.926474:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daace00 00000100:00100000:0.0:1746147177.929002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.929036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.929348:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463428608 00000100:00100000:1.0:1746147177.929352:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463428608 00002000:00100000:1.0:1746147177.929372:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2502656->2506751) req@ffff88008daad880 x1830967463428608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.929380:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463428608 ext(2502656->2506751) 00002000:00010000:1.0:1746147177.929384:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:1.0:1746147177.929395:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4060 00000100:00100000:1.0:1746147177.929399:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463428608:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147177.929494:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463428608:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 94us (456us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147177.929501:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4060 00002000:00100000:1.0:1746147177.929505:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2502656->2506751) req@ffff88008daad880 x1830967463428608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746147188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.929510:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463428608 ext(2502656->2506751) 00002000:00010000:1.0:1746147177.929513:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:0.0:1746147177.930525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.933795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.937128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.937486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.937521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147177.937897:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463429376 00000100:00100000:1.0:1746147177.937906:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463429376 00000100:00100000:0.0:1746147177.937919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.937934:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463430016 00000100:00100000:0.0:1746147177.937956:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463430016 00002000:00100000:1.0:1746147177.937958:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3010560->3014655) req@ffff88008daae300 x1830967463429376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.937967:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae300 with x1830967463429376 ext(3010560->3014655) 00002000:00010000:1.0:1746147177.937971:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daae300 00000100:00100000:0.0:1746147177.937983:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4052 00000100:00100000:0.0:1746147177.937989:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28476:x1830967463430016:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147177.938130:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28476:x1830967463430016:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 140us (210us total) trans 8589944043 rc 0/0 00000100:00100000:0.0:1746147177.938135:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4052 00000100:00100000:1.0:1746147177.939934:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463429504 00000100:00100000:1.0:1746147177.939950:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463429504 00002000:00100000:1.0:1746147177.939976:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008daae680 x1830967463429504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:553/0 lens 488/0 e 0 to 0 dl 1746147188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147177.939984:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae680 with x1830967463429504 ext(3145728->4194303) 00002000:00010000:1.0:1746147177.939988:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daae680 00000100:00100000:1.0:1746147177.940191:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4063 00000100:00100000:1.0:1746147177.940197:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463429760:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147177.946229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.959558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.968745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.984363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147177.990887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.043390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.043484:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463431168 00000100:00100000:1.0:1746147178.043494:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463431168 00000100:00100000:1.0:1746147178.043580:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10335 00000100:00100000:1.0:1746147178.043590:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28489:x1830967463431168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.043620:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.043641:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408e00/0xb4b2209fbdac4bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5790 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.043764:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043776:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043789:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043802:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043807:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043812:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043913:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408400/0xb4b2209fbdac4c0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043921:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408400/0xb4b2209fbdac4c0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.043927:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408400/0xb4b2209fbdac4c0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147178.043975:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147178.044064:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044070:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044076:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044081:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f408200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147178.044085:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044091:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044101:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147178.044104:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147178.044108:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044112:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408200/0xb4b2209fbdac4bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044133:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044138:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044142:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044145:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f409600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147178.044147:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044151:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044160:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98ff00) 00010000:00010000:1.0:1746147178.044162:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147178.044164:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044167:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409600/0xb4b2209fbdac4c05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147178.044201:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408e00/0xb4b2209fbdac4bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5790 expref: 21 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.044212:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408400/0xb4b2209fbdac4c0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5790 expref: 20 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.044218:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.044220:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147178.044222:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408400, rc 0) 00000100:00100000:1.0:1746147178.044271:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28489:x1830967463431168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 683us (1144us total) trans 8589944045 rc 0/0 00000100:00100000:1.0:1746147178.044277:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10335 00000100:00100000:0.0:1746147178.046637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.046875:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463431424 00000100:00100000:1.0:1746147178.046884:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463431424 00000100:00100000:1.0:1746147178.046934:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4054 00000100:00100000:1.0:1746147178.046967:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28489:x1830967463431424:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147178.047137:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28489:x1830967463431424:12345-192.168.203.36@tcp:35:cat.0 Request processed in 171us (512us total) trans 8589944046 rc 0/0 00000100:00100000:1.0:1746147178.047144:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4054 00000100:00100000:0.0:1746147178.050907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.052070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.061355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.075524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.078729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147178.078841:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147178.089080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.100090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.100129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.100175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.100361:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4067 00000100:00100000:1.0:1746147178.100467:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463432576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147178.100927:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4069 00000100:00100000:0.0:1746147178.100958:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463433088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.121418:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463432576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20949us (21328us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.121429:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4067 00002000:00100000:1.0:1746147178.121438:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a044a680 x1830967463432576/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.121445:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a680 with x1830967463432576 ext(2097152->3145727) 00002000:00010000:1.0:1746147178.121450:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044a680 00000100:00100000:0.0:1746147178.132108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.132731:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463433344 00000100:00100000:1.0:1746147178.132740:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463433344 00002000:00100000:1.0:1746147178.132781:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4671880 x1830967463433344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.132790:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967463433344 ext(4194304->4870143) 00002000:00010000:1.0:1746147178.132794:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:1.0:1746147178.132824:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4070 00000100:00100000:1.0:1746147178.132832:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463433344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147178.136855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147178.138818:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147178.139807:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463433344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6971us (7703us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147178.139816:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4070 00002000:00100000:1.0:1746147178.139825:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4671880 x1830967463433344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.139833:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967463433344 ext(4194304->4870143) 00002000:00010000:1.0:1746147178.139838:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:0.0:1746147178.141929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.150289:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463433984 00000100:00100000:0.0:1746147178.150299:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463433984 00000100:00100000:0.0:1746147178.150339:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463434112 00000100:00100000:0.0:1746147178.150341:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463434112 00000100:00100000:0.0:1746147178.150353:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11023 00000100:00100000:0.0:1746147178.150359:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463433984:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147178.150370:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11024 00010000:00010000:0.0:1746147178.150373:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147178.150378:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463434112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.150385:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.150386:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac4c52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57b3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.150393:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57ba expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.150403:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.150405:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.150412:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57ba expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.150423:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57ba expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147178.150427:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466294400:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147178.150431:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408a00, rc 0) 00000100:00100000:1.0:1746147178.150469:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463434112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 92us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.150474:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11024 00000100:00100000:0.0:1746147178.150764:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.161657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.175023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.175221:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463434368 00000100:00100000:1.0:1746147178.175230:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463434368 00002000:00100000:1.0:1746147178.175271:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1114112->1949695) req@ffff88008fa95f80 x1830967463434368/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.175280:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95f80 with x1830967463434368 ext(1114112->1949695) 00010000:00010000:1.0:1746147178.175289:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 13 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.175314:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 13 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.175320:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa95f80 00000100:00100000:1.0:1746147178.175352:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1418 00000100:00100000:1.0:1746147178.175360:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463434368:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147178.180900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.185905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.185954:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463434880 00000100:00100000:0.0:1746147178.185961:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463434880 00000100:00100000:0.0:1746147178.186841:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466294656:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.186852:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408400/0xb4b2209fbdac4c0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5790 expref: 22 pid: 23726 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.186867:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466294784:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.186875:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee9c000/0xb4b2209fbdac4ba3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5743 expref: 13 pid: 14049 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.186882:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466294912:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.186900:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948d9a00/0xb4b2209fbdac4c6e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147178.192909:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463434368:12345-192.168.203.36@tcp:4:cat.0 Request processed in 17541us (17884us total) trans 17179873118 rc 0/0 00000100:00100000:0.0:1746147178.192921:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1418 00002000:00100000:0.0:1746147178.192961:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1114112->1949695) req@ffff88008fa95f80 x1830967463434368/t17179873118(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/448 e 0 to 0 dl 1746147189 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.192970:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95f80 with x1830967463434368 ext(1114112->1949695) 00010000:00010000:0.0:1746147178.192980:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.192995:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:0.0:1746147178.193002:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa95f80 00000100:00100000:0.0:1746147178.197634:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463435392 00000100:00100000:0.0:1746147178.197643:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463435392 00010000:00010000:0.0:1746147178.197686:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.197722:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5353 00000100:00100000:0.0:1746147178.197730:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463435392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.197743:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.197761:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.197771:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.197790:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee9cc00/0xb4b2209fbdac4bb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1949695) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5751 expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.197821:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.197823:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.197829:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.197836:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.197865:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.197876:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466295040:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147178.197970:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.204486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147178.205721:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147178.208053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.212821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.216874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.216930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.221303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.230122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.233786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.248062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.267041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.267088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.269012:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4077 00000100:00100000:0.0:1746147178.269022:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463437440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147178.283678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.284033:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463437440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15010us (16941us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147178.284041:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4077 00002000:00100000:0.0:1746147178.284053:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009b6bb480 x1830967463437440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.284062:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967463437440 ext(2097152->3145727) 00002000:00010000:0.0:1746147178.284067:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:0.0:1746147178.297386:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463437568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30086us (30352us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147178.297394:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4076 00002000:00100000:0.0:1746147178.297402:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880132e11180 x1830967463437568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.297410:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967463437568 ext(3145728->4194303) 00002000:00010000:0.0:1746147178.297414:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:0.0:1746147178.306358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.306402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.306468:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463438336 00000100:00100000:1.0:1746147178.306477:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463438336 00000100:00100000:1.0:1746147178.306515:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463438464 00000100:00100000:1.0:1746147178.306517:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463438464 00000100:00100000:1.0:1746147178.306530:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11027 00000100:00100000:1.0:1746147178.306536:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463438336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.306551:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.306565:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57e4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.306585:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.306586:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.306593:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.306605:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.306614:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4600, rc 0) 00000100:00100000:1.0:1746147178.306650:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463438336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.306656:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11027 00000100:00100000:1.0:1746147178.306678:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11028 00000100:00100000:1.0:1746147178.306682:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463438464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.306688:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.306695:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4000/0xb4b2209fbdac4cc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57eb expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.306725:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466295680:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147178.306770:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00002000:00010000:1.0:1746147178.311091:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147176 -> 1746147178 00002000:00010000:1.0:1746147178.311098:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147176 -> 1746147178 00002000:00010000:1.0:1746147178.311101:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147177 -> 1746147178 00000100:00100000:1.0:1746147178.311121:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466295680:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147178.311149:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4000/0xb4b2209fbdac4cc2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57eb expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.311162:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4000/0xb4b2209fbdac4cc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57eb expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.311174:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4000, rc 0) 00000100:00100000:1.0:1746147178.312293:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463438464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5604us (5885us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147178.312301:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11028 00000100:00100000:0.0:1746147178.325234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.330836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.331861:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463438848 00000100:00100000:1.0:1746147178.331873:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463438848 00000100:00100000:1.0:1746147178.332567:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11029 00000100:00100000:1.0:1746147178.332577:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28496:x1830967463438848:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147178.332597:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.332613:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57f2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.332640:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.332647:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147178.332648:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147178.332652:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1105920->1949695] (req 1105920->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.332688:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.332699:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 19 pid: 17530 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.332710:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466295808:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.332801:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147178.339489:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466295808:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.339521:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1105920->1949695] (req 1105920->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.339543:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4e00, rc 0) 00000100:00100000:1.0:1746147178.339593:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28496:x1830967463438848:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7018us (8765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.339601:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11029 00000100:00100000:0.0:1746147178.339875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.340359:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463438976 00000100:00100000:1.0:1746147178.340366:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463438976 00002000:00100000:1.0:1746147178.340392:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1667072->1925119) req@ffff88009f76ed80 x1830967463438976/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.340401:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76ed80 with x1830967463438976 ext(1667072->1925119) 00010000:00010000:1.0:1746147178.340407:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 20 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.340417:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 20 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.340423:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76ed80 00000100:00100000:0.0:1746147178.352274:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463438976:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10973us (12393us total) trans 21474840518 rc 0/0 00000100:00100000:0.0:1746147178.352284:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1419 00002000:00100000:0.0:1746147178.352294:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1667072->1925119) req@ffff88009f76ed80 x1830967463438976/t21474840518(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/448 e 0 to 0 dl 1746147189 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.352302:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76ed80 with x1830967463438976 ext(1667072->1925119) 00010000:00010000:0.0:1746147178.352311:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 22 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.352324:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f569600/0xb4b2209fbdac4c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57d6 expref: 22 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:0.0:1746147178.352331:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76ed80 00000100:00100000:0.0:1746147178.356169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.356242:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463439104 00000100:00100000:1.0:1746147178.356251:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463439104 00000100:00100000:1.0:1746147178.357276:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11030 00000100:00100000:1.0:1746147178.357286:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28502:x1830967463439104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.357306:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.357321:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e57f9 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.357346:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147178.357352:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1105920->1949695] (req 1105920->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.357357:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147178.357360:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f9 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.357391:0:11147:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1105920->1949695] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.357402:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f9 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.357410:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4800, rc 0) 00000100:00100000:1.0:1746147178.357813:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28502:x1830967463439104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 528us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.357818:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11030 00000100:00100000:0.0:1746147178.358751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.362125:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463439488 00000100:00100000:0.0:1746147178.362133:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463439488 00002000:00100000:1.0:1746147178.362175:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1105920->1110015) req@ffff88008fc94380 x1830967463439488/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.362184:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94380 with x1830967463439488 ext(1105920->1110015) 00010000:00010000:1.0:1746147178.362192:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.362203:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.362209:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc94380 00000100:00100000:1.0:1746147178.362238:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1420 00000100:00100000:1.0:1746147178.362244:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463439488:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.362364:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463439488:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 120us (262us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.362370:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1420 00002000:00100000:1.0:1746147178.362375:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1105920->1110015) req@ffff88008fc94380 x1830967463439488/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.362381:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94380 with x1830967463439488 ext(1105920->1110015) 00010000:00010000:1.0:1746147178.362385:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.362394:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.362399:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc94380 00000100:00100000:0.0:1746147178.369913:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463439744 00000100:00100000:0.0:1746147178.369923:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463439744 00002000:00100000:1.0:1746147178.370342:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1945600->1949695) req@ffff88008fc96300 x1830967463439744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.370352:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96300 with x1830967463439744 ext(1945600->1949695) 00010000:00010000:1.0:1746147178.370360:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.370372:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.370378:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc96300 00000100:00100000:1.0:1746147178.370407:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1421 00000100:00100000:1.0:1746147178.370415:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463439744:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.370567:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463439744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 153us (848us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.370573:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1421 00002000:00100000:1.0:1746147178.370579:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1945600->1949695) req@ffff88008fc96300 x1830967463439744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.370585:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96300 with x1830967463439744 ext(1945600->1949695) 00010000:00010000:1.0:1746147178.370589:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.370596:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.370602:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc96300 00000100:00100000:0.0:1746147178.378080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.378112:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463440000 00000100:00100000:0.0:1746147178.378121:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463440000 00002000:00100000:1.0:1746147178.378198:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1105920->1949695) req@ffff880092a70000 x1830967463440000/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.378208:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70000 with x1830967463440000 ext(1105920->1949695) 00010000:00010000:1.0:1746147178.378215:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.378228:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4e00/0xb4b2209fbdac4cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f2 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.378234:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a70000 00000100:00100000:1.0:1746147178.378259:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1422 00000100:00100000:1.0:1746147178.378270:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463440000:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147178.397181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.404000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.416379:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463440384:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12030us (12377us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.416389:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4079 00002000:00100000:1.0:1746147178.416401:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880092a70700 x1830967463440384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.416409:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a70700 with x1830967463440384 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.416414:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a70700 00000100:00100000:0.0:1746147178.442283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.445456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.445497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.448382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.448421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147178.449720:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac4cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449729:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac4cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147178.449762:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147178.449765:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147178.449778:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac4cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449785:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac4cec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449793:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449798:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449803:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449807:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f568e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147178.449810:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449815:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449822:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147178.449824:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147178.449826:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449831:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568e00/0xb4b2209fbdac4cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449842:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449846:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449850:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449854:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f569c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147178.449856:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449860:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449865:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134d0ae00) 00010000:00010000:0.0:1746147178.449866:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147178.449868:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449872:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569c00/0xb4b2209fbdac4ce5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147178.449895:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569800/0xb4b2209fbdac4cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5800 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.449904:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac4cec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5800 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.449910:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147178.449912:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147178.449914:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568000, rc 0) 00000100:00100000:0.0:1746147178.449934:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:28505:x1830967463440512:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6771us (7659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.449957:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10340 00000100:00100000:1.0:1746147178.455712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.455746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.455975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.456007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.456034:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463441536 00000100:00100000:1.0:1746147178.456042:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463441536 00000100:00100000:1.0:1746147178.456074:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463441792 00000100:00100000:1.0:1746147178.456076:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463441792 00000100:00100000:1.0:1746147178.456085:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463441408 00000100:00100000:1.0:1746147178.456086:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463441408 00000100:00100000:1.0:1746147178.456094:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463441664 00000100:00100000:1.0:1746147178.456096:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463441664 00000100:00100000:1.0:1746147178.456108:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11031 00000100:00100000:1.0:1746147178.456115:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463441536:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147178.456130:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.456142:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e580e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.456164:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.456166:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.456172:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.456184:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.456194:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f0b400, rc 0) 00000100:00100000:0.0:1746147178.456230:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11032 00000100:00100000:0.0:1746147178.456237:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463441792:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147178.456243:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.456251:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4cfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e581c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.456260:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456261:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456266:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4cfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e581c expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456274:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac4cfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e581c expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456280:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:0.0:1746147178.456315:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463441792:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 79us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.456320:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11032 00000100:00100000:0.0:1746147178.456334:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11033 00000100:00100000:0.0:1746147178.456338:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463441408:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147178.456344:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.456349:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5807 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.456358:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456359:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456363:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456370:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456376:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f200, rc 0) 00000100:00100000:0.0:1746147178.456388:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463441408:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.456392:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11033 00000100:00100000:0.0:1746147178.456399:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11034 00000100:00100000:0.0:1746147178.456403:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463441664:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147178.456408:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.456414:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5815 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.456422:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456423:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.456427:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456435:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.456444:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e400, rc 0) 00000100:00100000:0.0:1746147178.456457:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463441664:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.456461:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11034 00000100:00100000:1.0:1746147178.457023:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463441536:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 907us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.457029:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11031 00000100:00100000:0.0:1746147178.459503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.466633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.473116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.478214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.478238:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463442688 00000100:00100000:1.0:1746147178.478247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.478247:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463442688 00000100:00100000:0.0:1746147178.478290:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463442560 00000100:00100000:0.0:1746147178.478293:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463442560 00000100:00100000:0.0:1746147178.478309:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11035 00000100:00100000:0.0:1746147178.478316:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463442688:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147178.478354:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478369:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478376:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478382:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478390:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.478392:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.478394:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478420:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478430:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 14 pid: 11147 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.478441:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296704:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.478507:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478514:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 14 pid: 6881 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.478521:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296832:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.478545:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478551:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.478564:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296960:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147178.478579:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.478593:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11036 00000100:00100000:0.0:1746147178.478598:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463442560:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147178.478620:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478629:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac4a68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e566a expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478635:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac4b41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56fd expref: 16 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478641:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e567f expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478646:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.478647:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.478648:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.478672:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e567f expref: 20 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.478679:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9e000/0xb4b2209fbdac4aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e567f expref: 20 pid: 17548 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.478687:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466297088:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.482902:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463442944 00000100:00100000:1.0:1746147178.482913:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463442944 00000100:00100000:1.0:1746147178.482966:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463442816 00000100:00100000:1.0:1746147178.482968:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463442816 00000100:00100000:1.0:1746147178.482981:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463443072 00000100:00100000:1.0:1746147178.482983:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463443072 00000100:00100000:1.0:1746147178.482995:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11037 00000100:00100000:1.0:1746147178.483002:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463442944:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147178.483041:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483055:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f9 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483068:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.483074:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.483076:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.483078:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483107:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.483117:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 18 pid: 8481 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.483128:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466297472:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147178.483146:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11038 00000100:00100000:0.0:1746147178.483152:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463442816:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147178.483170:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.483180:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdac4ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56a9 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483186:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f9 expref: 16 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.483186:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e570b expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.483192:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483193:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac4cd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57f9 expref: 16 pid: 11147 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.483197:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.483198:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.483200:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.483201:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466297600:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.483213:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.483217:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0406c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147178.483220:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.483232:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297728:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.483234:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11039 00000100:00100000:1.0:1746147178.483240:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463443072:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147178.483253:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.483255:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e570b expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.483262:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b485a600/0xb4b2209fbdac4b33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e570b expref: 15 pid: 4445 timeout: 665 lvb_type: 1 00010000:00010000:1.0:1746147178.483263:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5766 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483269:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147178.483269:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297856:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483275:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.483281:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56c5 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483287:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.483287:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdac4ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56a9 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483292:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147178.483293:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147178.483293:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31cc00/0xb4b2209fbdac4ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56a9 expref: 14 pid: 8481 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.483295:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 8/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.483300:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297984:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483306:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.483311:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a300 going to sleep for 11 seconds 00010000:00010000:1.0:1746147178.483313:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 20 pid: 6881 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.483320:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298112:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483338:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56c5 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483344:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ef9ec00/0xb4b2209fbdac4ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56c5 expref: 16 pid: 6881 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.483351:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483369:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.483377:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 16 pid: 8481 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.483383:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298368:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483398:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.483405:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 18 pid: 6881 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.483411:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298496:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.483430:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5766 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.483438:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491e800/0xb4b2209fbdac4bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5766 expref: 20 pid: 6881 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.483445:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.483463:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147178.489701:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac4cbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57e4 expref: 14 pid: 11147 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.489725:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296704:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.489736:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac4d01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5807 expref: 16 pid: 6881 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.489743:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296832:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.489751:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948d8400/0xb4b2209fbdac4c60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57c1 expref: 27 pid: 17530 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.489757:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466296960:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.489775:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489782:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489792:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489810:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489817:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489823:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489829:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f446000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147178.489831:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489837:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489846:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.489851:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f446000/0xb4b2209fbdac4d39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.489884:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463442688:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 11569us (11676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.489890:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11035 00000100:00100000:0.0:1746147178.494127:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466297216:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147178.494141:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466297344:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.494166:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.496252:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466297472:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.496264:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466297600:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.496289:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.496631:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298112:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.496649:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297728:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.496656:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297856:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.496670:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466297984:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.496685:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.496878:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463444992 00000100:00100000:0.0:1746147178.496883:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463444992 00010000:00010000:0.0:1746147178.496899:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 20 pid: 6881 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.496912:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5367 00000100:00100000:0.0:1746147178.496917:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463444352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.496925:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.496952:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.496961:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.496977:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31c600/0xb4b2209fbdac4ac3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56b7 expref: 27 pid: 8481 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.497051:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147178.497069:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463444352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 152us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.497075:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5367 00000100:00100000:0.0:1746147178.497085:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5369 00000100:00100000:0.0:1746147178.497090:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463444992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.497096:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.497105:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 18 pid: 6881 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.497112:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 18 pid: 6881 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.497123:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147178.497136:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463444992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.497140:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5369 00010000:00010000:0.0:1746147178.497158:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497164:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497179:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497185:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497190:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497195:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f565400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147178.497198:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497204:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497215:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.497221:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f565400/0xb4b2209fbdac4d40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.497252:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463442560:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 18654us (19004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.497258:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11036 00000100:00100000:1.0:1746147178.498200:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298240:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.498210:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298368:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.498218:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac4d08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5815 expref: 16 pid: 6881 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.498228:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298496:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147178.498235:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466298624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147178.498252:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.499142:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463444608 00000100:00100000:0.0:1746147178.499150:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463444608 00010000:00010000:0.0:1746147178.499173:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac4afb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e56e1 expref: 20 pid: 6881 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.499956:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463443968 00000100:00100000:0.0:1746147178.499961:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463443968 00010000:00010000:0.0:1746147178.499977:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f0b400/0xb4b2209fbdac4cf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e580e expref: 16 pid: 8481 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.499993:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5373 00000100:00100000:0.0:1746147178.499998:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463445120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.500005:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.500454:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500462:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500479:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500486:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500492:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500497:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea40800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147178.500501:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500507:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500515:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.500520:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac4d47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.500559:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463442944:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 17557us (18825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.500565:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11037 00010000:00010000:0.0:1746147178.500669:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 15 pid: 8481 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.500677:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 15 pid: 8481 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.500691:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4c1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5797 expref: 15 pid: 8481 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.500699:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147178.500715:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463445120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 717us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.500720:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5373 00010000:00010000:1.0:1746147178.503487:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503495:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503515:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503521:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503527:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503533:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5426a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147178.503536:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503543:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503552:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.503558:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5426a00/0xb4b2209fbdac4d4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.503596:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463442816:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20443us (21177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.503603:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11038 00010000:00010000:1.0:1746147178.504052:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504060:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504072:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504077:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504082:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504086:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b485a000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147178.504088:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504093:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504102:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.504107:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b485a000/0xb4b2209fbdac4d55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.504137:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463443072:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20897us (21410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.504142:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11039 00000100:00100000:0.0:1746147178.504282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.504332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.504386:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5380 00000100:00100000:0.0:1746147178.504393:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463445504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.504400:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.504410:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57ba expref: 26 pid: 6881 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.504420:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57ba expref: 26 pid: 6881 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.504728:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f408a00/0xb4b2209fbdac4c59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57ba expref: 26 pid: 6881 timeout: 665 lvb_type: 1 00010000:00010000:0.0:1746147178.504737:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.504738:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.504741:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efdd000/0xb4b2209fbdac4d5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.504749:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efdd000/0xb4b2209fbdac4d5c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.504770:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147178.504802:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463445504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 410us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.504808:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5380 00000100:00100000:0.0:1746147178.512567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.521186:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463446656 00000100:00100000:1.0:1746147178.521190:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463446656 00000100:00100000:1.0:1746147178.521216:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463446528 00000100:00100000:1.0:1746147178.521218:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463446528 00000100:00100000:1.0:1746147178.521235:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4059 00000100:00100000:1.0:1746147178.521240:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:19601:x1830967463446656:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746147178.522321:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408e00/0xb4b2209fbdac4cad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e57dd expref: 25 pid: 14049 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.522338:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299136:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.522354:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5646600/0xb4b2209fbdac4b79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e572e expref: 317 pid: 23726 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.522365:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299264:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147178.522372:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299392:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147178.522383:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299520:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.522390:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe400/0xb4b2209fbdac474a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5425 expref: 316 pid: 14125 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.522397:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299648:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.522404:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c400/0xb4b2209fbdac4743 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e541e expref: 24 pid: 14049 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.522415:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466299776:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147178.522441:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129efec00/0xb4b2209fbdac4d63 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147178.525297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.525377:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463447040 00000100:00100000:1.0:1746147178.525386:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463447040 00010000:00010000:1.0:1746147178.525413:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 316 pid: 23726 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.525447:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5385 00000100:00100000:1.0:1746147178.525453:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1956:x1830967463447040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147178.525465:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.525469:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 316 pid: 23726 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.525482:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 316 pid: 23726 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.525499:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f600/0xb4b2209fbdac4a7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5678 expref: 316 pid: 23726 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.525527:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.525531:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129efec00/0xb4b2209fbdac4d63 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.525537:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147178.525567:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+315:1956:x1830967463447040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.525578:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5385 00000100:00100000:0.0:1746147178.527652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147178.527901:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129efec00/0xb4b2209fbdac4d63 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147178.527909:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129efec00/0xb4b2209fbdac4d63 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:0.0:1746147178.528526:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2842, 88 off235800 00000004:00080000:0.0:1746147178.528532:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565515594729ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.528582:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off232280 00000004:00080000:0.0:1746147178.528587:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565515649326ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531170:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off232368 00000004:00080000:0.0:1746147178.531281:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518342737ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531301:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2843, 88 off235888 00000004:00080000:0.0:1746147178.531304:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518366970ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531326:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2844, 88 off235976 00000004:00080000:0.0:1746147178.531330:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518392485ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531338:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off232456 00000004:00080000:0.0:1746147178.531342:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518404318ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531348:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2805, 88 off232544 00000004:00080000:0.0:1746147178.531351:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518413435ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531357:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off232632 00000004:00080000:0.0:1746147178.531360:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518422974ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531367:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2845, 88 off236064 00000004:00080000:0.0:1746147178.531369:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518432288ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531390:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off232720 00000004:00080000:0.0:1746147178.531393:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518455455ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531399:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2846, 88 off236152 00000004:00080000:0.0:1746147178.531401:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518464004ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531407:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2808, 88 off232808 00000004:00080000:0.0:1746147178.531409:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518472088ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.531415:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2847, 88 off236240 00000004:00080000:0.0:1746147178.531418:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518480429ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531423:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2848, 88 off236328 00000004:00080000:0.0:1746147178.531426:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518488517ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531678:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2849, 88 off236416 00000004:00080000:0.0:1746147178.531683:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518745345ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531706:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2850, 88 off236504 00000004:00080000:0.0:1746147178.531709:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565518771539ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.531716:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2809, 88 off232896 00000004:00080000:0.0:1746147178.531718:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565518781310ns, next at 537465048041ns, rc = 0 00000100:00100000:1.0:1746147178.552509:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466299904 00000100:00100000:1.0:1746147178.552517:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466299904 00000100:00100000:0.0:1746147178.552674:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300032 00000100:00100000:0.0:1746147178.552677:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300032 00000100:00100000:1.0:1746147178.552731:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300544 00000100:00100000:1.0:1746147178.552733:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300544 00000100:00100000:0.0:1746147178.552736:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300160 00000100:00100000:0.0:1746147178.552738:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300160 00000100:00100000:1.0:1746147178.552740:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300672 00000100:00100000:1.0:1746147178.552742:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300672 00000100:00100000:0.0:1746147178.552746:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466301184 00000100:00100000:1.0:1746147178.552748:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300288 00000100:00100000:0.0:1746147178.552748:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466301184 00000100:00100000:1.0:1746147178.552750:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300288 00000100:00100000:1.0:1746147178.552754:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466300800 00000100:00100000:1.0:1746147178.552756:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466300800 00000100:00100000:1.0:1746147178.552762:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11041 00000100:00100000:1.0:1746147178.552768:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466299904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.552899:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466299904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (537us total) trans 17179873119 rc 0/0 00000100:00100000:1.0:1746147178.552906:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11041 00000100:00100000:1.0:1746147178.552914:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466301312 00000100:00100000:1.0:1746147178.552916:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466301312 00000100:00100000:1.0:1746147178.552922:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11042 00000100:00100000:1.0:1746147178.552925:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466300032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.553008:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466300032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (540us total) trans 17179873120 rc 0/0 00000100:00100000:1.0:1746147178.553013:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11042 00000100:00100000:1.0:1746147178.553022:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11044 00000100:00100000:1.0:1746147178.553025:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466300160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.553083:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11045 00000100:00100000:1.0:1746147178.553087:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466300672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.553095:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11046 00000100:00100000:1.0:1746147178.553098:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466300288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.553104:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11047 00000100:00100000:1.0:1746147178.553107:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466300800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.553115:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11048 00000100:00100000:1.0:1746147178.553117:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967466301312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.553195:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3295:x1830967466301312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (429us total) trans 21474840520 rc 0/0 00000100:00100000:1.0:1746147178.553199:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11048 00000100:00100000:1.0:1746147178.553684:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466301824 00000100:00100000:1.0:1746147178.553688:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466301824 00000100:00100000:1.0:1746147178.553698:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466301696 00000100:00100000:1.0:1746147178.553699:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466301696 00000100:00100000:1.0:1746147178.553706:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11049 00000100:00100000:1.0:1746147178.553709:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466301824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.553773:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1746147178.553776:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.553778:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.553779:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.553781:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:1.0:1746147178.553801:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466301824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (205us total) trans 21474840521 rc 0/0 00000100:00100000:1.0:1746147178.553805:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11049 00000100:00100000:1.0:1746147178.553813:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11050 00000100:00100000:1.0:1746147178.553817:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466301696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.553869:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147178.553871:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.553872:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.553874:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.553875:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1746147178.553889:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466301696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (264us total) trans 21474840522 rc 0/0 00000100:00100000:1.0:1746147178.553893:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11050 00000004:00080000:1.0:1746147178.553911:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80d180/2, rc 0, transno 21474840522 00000100:00100000:1.0:1746147178.553914:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466301696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147178.553919:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80d500/2, rc 0, transno 21474840521 00000100:00100000:1.0:1746147178.553922:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466301824:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.554018:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147178.554020:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.554022:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.554024:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.554025:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147178.554041:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967466300672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 954us (1365us total) trans 17179873123 rc 0/0 00000100:00100000:1.0:1746147178.554045:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11045 00002000:00010000:1.0:1746147178.554134:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147178.554136:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.554138:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.554139:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.554141:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1746147178.554150:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11052 00000100:00100000:0.0:1746147178.554155:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830967466301184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147178.554245:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830967466301184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1541us total) trans 21474840523 rc 0/0 00000100:00100000:0.0:1746147178.554250:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11052 00000100:00100000:1.0:1746147178.554739:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967466300288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1640us (2006us total) trans 17179873124 rc 0/0 00000100:00100000:1.0:1746147178.554745:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11046 00000100:00100000:1.0:1746147178.554756:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11055 00000100:00100000:1.0:1746147178.554761:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967466300928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.554848:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3294:x1830967466300928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (312us total) trans 21474840526 rc 0/0 00000100:00100000:1.0:1746147178.554854:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11055 00000100:00100000:1.0:1746147178.554865:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11057 00000100:00100000:1.0:1746147178.554869:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967466301952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.554950:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147178.554952:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.554955:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.554957:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.554959:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147178.554979:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967466301952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (404us total) trans 21474840528 rc 0/0 00000100:00100000:1.0:1746147178.554984:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11057 00002000:00010000:1.0:1746147178.555090:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147178.555093:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.555095:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.555096:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.555098:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147178.555116:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967466300800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2008us (2364us total) trans 17179873125 rc 0/0 00000100:00100000:1.0:1746147178.555121:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11047 00002000:00010000:0.0:1746147178.556006:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147178.556009:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147178.556011:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147178.556012:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147178.556014:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147178.556654:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.556903:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466300544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3891us (4407us total) trans 17179873122 rc 0/0 00000100:00100000:0.0:1746147178.556908:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11043 00000100:00100000:0.0:1746147178.562129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.562172:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463447424 00000100:00100000:1.0:1746147178.562182:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463447424 00000100:00100000:1.0:1746147178.562237:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 575 00000100:00100000:1.0:1746147178.562247:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:28505:x1830967463447424:12345-192.168.203.36@tcp:103:mirror_io.0 00010000:00010000:1.0:1746147178.562261:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.562280:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac4d2b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e582a expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.562293:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.562296:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147178.562334:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+7:28505:x1830967463447424:12345-192.168.203.36@tcp:103:mirror_io.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.562343:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 575 00000100:00100000:0.0:1746147178.564485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.566778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.586054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.586099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.586226:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10345 00000100:00100000:1.0:1746147178.586236:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28511:x1830967463448192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147178.586259:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.586274:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdac4d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5838 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.586426:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586434:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586441:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586448:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586454:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586458:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586522:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586528:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586534:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147178.586540:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147178.586580:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586586:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586590:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586594:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147178.586701:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586707:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586714:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147178.586716:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147178.586718:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.586722:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac4d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587402:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587409:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587413:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587421:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147178.587423:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587428:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587435:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800928bd900) 00010000:00010000:1.0:1746147178.587437:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147178.587439:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587443:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac4d94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.587468:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0xb4b2209fbdac4d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.587477:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.587483:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.587485:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147178.587486:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486800, rc 0) 00000100:00100000:1.0:1746147178.587514:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28511:x1830967463448192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1280us (1466us total) trans 8589944063 rc 0/0 00000100:00100000:1.0:1746147178.587519:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10345 00000100:00100000:0.0:1746147178.591057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.591087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.591191:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463448704 00000100:00100000:1.0:1746147178.591199:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463448704 00000100:00100000:1.0:1746147178.591232:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10347 00000100:00100000:1.0:1746147178.591238:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28515:x1830967463448704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.591258:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.591270:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdac4db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5846 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.591330:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486e00/0xb4b2209fbdac4dcc lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.591436:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486e00/0xb4b2209fbdac4dcc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.591444:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486e00/0xb4b2209fbdac4dcc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147178.591453:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147178.591542:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487400/0xb4b2209fbdac4db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5846 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.591554:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486e00/0xb4b2209fbdac4dcc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5846 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.591559:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.591562:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147178.591563:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486e00, rc 0) 00000100:00100000:1.0:1746147178.591729:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28515:x1830967463448704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 490us (677us total) trans 8589944064 rc 0/0 00000100:00100000:1.0:1746147178.591735:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10347 00000100:00100000:0.0:1746147178.594053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.594600:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463449088 00000100:00100000:1.0:1746147178.594606:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463449088 00010000:00010000:1.0:1746147178.594642:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 8 pid: 14125 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.594682:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5387 00000100:00100000:1.0:1746147178.594689:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1958:x1830967463449088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147178.594699:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.594704:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 8 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.594713:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 8 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.594729:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0xb4b2209fbdac4da9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5838 expref: 8 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.594740:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.594744:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.594751:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.594755:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147178.594780:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1958:x1830967463449088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.594785:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5387 00000100:00100000:0.0:1746147178.595228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.595293:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463449216 00000100:00100000:1.0:1746147178.595296:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463449216 00000100:00100000:1.0:1746147178.595314:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10349 00000100:00100000:1.0:1746147178.595319:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28515:x1830967463449216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.595334:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.595344:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0xb4b2209fbdac4dda lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5854 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.595396:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.595403:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.595408:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.595419:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.595427:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147178.595966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147178.596364:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147178.596369:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000040:00080000:0.0:1746147178.596864:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2851, 88 off236592 00000004:00080000:0.0:1746147178.596869:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565583930882ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.596891:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2810, 88 off232984 00000004:00080000:0.0:1746147178.596894:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565583956467ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597041:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2811, 88 off233072 00000004:00080000:0.0:1746147178.597045:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584107377ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597051:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2852, 88 off236680 00000004:00080000:0.0:1746147178.597053:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584116347ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597072:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2853, 88 off236768 00000004:00080000:0.0:1746147178.597075:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584137977ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597082:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2812, 88 off233160 00000004:00080000:0.0:1746147178.597084:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584147112ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597090:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2813, 88 off233248 00000004:00080000:0.0:1746147178.597092:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584155099ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597231:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2814, 88 off233336 00000004:00080000:0.0:1746147178.597235:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584297354ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597242:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2854, 88 off236856 00000004:00080000:0.0:1746147178.597244:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584307325ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597251:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2815, 88 off233424 00000004:00080000:0.0:1746147178.597253:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584315854ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597259:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2855, 88 off236944 00000004:00080000:0.0:1746147178.597261:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584324267ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597267:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2816, 88 off233512 00000004:00080000:0.0:1746147178.597270:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584332614ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147178.597276:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2856, 88 off237032 00000004:00080000:0.0:1746147178.597278:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584340965ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597321:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2857, 88 off237120 00000004:00080000:0.0:1746147178.597325:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584388067ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597371:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2858, 88 off237208 00000004:00080000:0.0:1746147178.597375:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584437503ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597385:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2859, 88 off237296 00000004:00080000:0.0:1746147178.597387:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565584450224ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147178.597394:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2817, 88 off233600 00000004:00080000:0.0:1746147178.597396:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565584459068ns, next at 537465048041ns, rc = 0 00000100:00100000:0.0:1746147178.610174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.610198:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463449472 00000100:00100000:0.0:1746147178.610207:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463449472 00000100:00100000:0.0:1746147178.610245:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10350 00000100:00100000:0.0:1746147178.610252:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28511:x1830967463449472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147178.610274:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.610290:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e585b expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.610334:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.610343:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.610353:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147178.610355:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147178.610358:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.610364:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efdd000, rc 0) 00000100:00100000:0.0:1746147178.610400:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28511:x1830967463449472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 148us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.610405:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10350 00000100:00100000:1.0:1746147178.621436:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466303744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.621456:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147178.621466:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466304256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.621480:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147178.621487:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147178.621489:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466303616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.621499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147178.621505:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466304128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.621515:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147178.621530:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466303744 00000100:00100000:1.0:1746147178.621532:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466303744 00000100:00100000:1.0:1746147178.621542:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466304256 00000100:00100000:1.0:1746147178.621544:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466304256 00000100:00100000:1.0:1746147178.621549:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466303616 00000100:00100000:1.0:1746147178.621551:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466303616 00000100:00100000:1.0:1746147178.621556:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466304128 00000100:00100000:1.0:1746147178.621558:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466304128 00000100:00100000:1.0:1746147178.621565:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11058 00000100:00100000:1.0:1746147178.621570:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967466302336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.621729:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967466302336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (1039us total) trans 17179873127 rc 0/0 00000100:00100000:1.0:1746147178.621736:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11058 00000100:00100000:1.0:1746147178.621748:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11059 00000100:00100000:1.0:1746147178.621752:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967466302848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.621823:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967466302848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1081us total) trans 17179873128 rc 0/0 00000100:00100000:1.0:1746147178.621828:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11059 00000100:00100000:1.0:1746147178.621837:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11060 00000100:00100000:1.0:1746147178.621841:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967466302720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147178.621901:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147178.621904:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.621905:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.621907:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.621908:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1746147178.621926:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967466302720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1155us total) trans 17179873129 rc 0/0 00000100:00100000:1.0:1746147178.621933:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11060 00000100:00100000:1.0:1746147178.621960:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11061 00000100:00100000:1.0:1746147178.621964:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1830967466303232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147178.622027:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147178.622030:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.622032:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.622033:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.622035:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147178.622052:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830967466303232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1262us total) trans 17179873130 rc 0/0 00000100:00100000:1.0:1746147178.622056:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11061 00000100:00100000:1.0:1746147178.622064:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11062 00000100:00100000:1.0:1746147178.622068:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466302464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.622142:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466302464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1323us total) trans 17179873131 rc 0/0 00000100:00100000:1.0:1746147178.622146:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11062 00000100:00100000:1.0:1746147178.622154:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11063 00000100:00100000:1.0:1746147178.622158:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466302592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147178.622229:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466302592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1373us total) trans 17179873132 rc 0/0 00000100:00100000:1.0:1746147178.622234:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11063 00000100:00100000:1.0:1746147178.622243:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11064 00000100:00100000:1.0:1746147178.622246:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1830967466303104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147178.622306:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147178.622309:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.622311:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.622312:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147178.622314:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147178.622331:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466303104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1457us total) trans 17179873133 rc 0/0 00000100:00100000:1.0:1746147178.622335:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11064 00000100:00100000:1.0:1746147178.622344:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11065 00000100:00100000:1.0:1746147178.622347:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466303872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.622453:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466303872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1170us total) trans 21474840529 rc 0/0 00000100:00100000:1.0:1746147178.622458:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11065 00000100:00100000:1.0:1746147178.622467:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11066 00000100:00100000:1.0:1746147178.622471:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466304384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.622532:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1746147178.622534:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.622536:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.622537:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.622539:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:1.0:1746147178.622557:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466304384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1253us total) trans 21474840530 rc 0/0 00000100:00100000:1.0:1746147178.622562:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11066 00000100:00100000:1.0:1746147178.622572:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11067 00000100:00100000:1.0:1746147178.622576:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466303488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.622648:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466303488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1322us total) trans 21474840531 rc 0/0 00000100:00100000:1.0:1746147178.622652:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11067 00000100:00100000:1.0:1746147178.622671:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11068 00000100:00100000:1.0:1746147178.622675:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466303744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.622747:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466303744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1290us total) trans 21474840532 rc 0/0 00000100:00100000:1.0:1746147178.622753:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11068 00000100:00100000:1.0:1746147178.622762:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11069 00000100:00100000:1.0:1746147178.622766:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466304256:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147178.622789:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80e680/2, rc 0, transno 21474840531 00000100:00100000:0.0:1746147178.622802:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466303488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147178.622810:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80f100/2, rc 0, transno 21474840529 00000100:00100000:0.0:1746147178.622813:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466303872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147178.622819:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e11880/2, rc 0, transno 21474840530 00000100:00100000:0.0:1746147178.622821:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466304384:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147178.622825:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147178.622827:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.622829:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147178.622830:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147178.622832:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1746147178.622849:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466304256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1367us total) trans 21474840533 rc 0/0 00000100:00100000:1.0:1746147178.622853:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11069 00000100:00100000:0.0:1746147178.622857:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147178.622862:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11070 00000100:00100000:0.0:1746147178.622864:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466304512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.622866:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466303616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147178.622886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147178.623336:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008daadc00/2, rc 0, transno 21474840536 00000100:00100000:0.0:1746147178.623341:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466304512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147178.623816:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967466303616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 947us (2313us total) trans 21474840534 rc 0/0 00000100:00100000:1.0:1746147178.623821:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11070 00010000:00010000:1.0:1746147178.623849:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00080000:0.0:1746147178.623855:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80f480/2, rc 0, transno 21474840537 00010000:00010000:1.0:1746147178.623856:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147178.623859:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466304000:0@lo:2:osp-syn-0-0.0 00000004:00200000:1.0:1746147178.623886:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147178.623889:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147178.623900:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147178.623927:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0xb4b2209fbdac4dda lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5854 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.623952:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5854 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.623959:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.623961:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746147178.623963:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486400, rc 0) 00000100:00100000:1.0:1746147178.624001:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28515:x1830967463449216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 28681us (28773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.624007:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10349 00000004:00080000:1.0:1746147178.624048:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80ea00/2, rc 0, transno 21474840534 00000100:00100000:1.0:1746147178.624052:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466303616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147178.624058:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80f800/2, rc 0, transno 21474840535 00000100:00100000:1.0:1746147178.624060:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466304128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147178.624065:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80ed80/2, rc 0, transno 21474840532 00000100:00100000:1.0:1746147178.624067:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466303744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147178.624071:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80fb80/2, rc 0, transno 21474840533 00000100:00100000:1.0:1746147178.624073:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466304256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147178.630162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.630249:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463449600 00000100:00100000:1.0:1746147178.630259:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463449600 00000100:00100000:1.0:1746147178.630300:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10351 00000100:00100000:1.0:1746147178.630307:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28515:x1830967463449600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.630325:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.630341:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948d8400/0xb4b2209fbdac4def lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5862 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.630387:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948d8400/0xb4b2209fbdac4def lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5862 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.630398:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948d8400/0xb4b2209fbdac4def lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5862 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.630412:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.630414:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147178.630417:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948d8400, rc 0) 00000100:00100000:1.0:1746147178.630454:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28515:x1830967463449600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 147us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.630460:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10351 00000100:00100000:0.0:1746147178.630876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.635459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.635529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.635553:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11075 00000100:00100000:1.0:1746147178.635852:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28512:x1830967463449856:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147178.635860:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.635870:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4fe3a00/0xb4b2209fbdac4dfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5869 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147178.635883:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141769, atime: 0x68141769, ctime: 0x68141769, blocks: 0x1029 00010000:00010000:1.0:1746147178.635893:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.635894:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.635898:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4fe3a00/0xb4b2209fbdac4dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2125824->2224127) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5869 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.635907:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4fe3a00/0xb4b2209fbdac4dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2125824->2224127) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5869 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.635914:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fe3a00, rc 0) 00000100:00100000:1.0:1746147178.635965:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28512:x1830967463449856:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 405us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.635970:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11075 00000100:00100000:1.0:1746147178.639901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.639946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.639972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.639994:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463450240 00000100:00100000:1.0:1746147178.639997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.640003:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463450240 00000100:00100000:1.0:1746147178.640011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.640023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.640035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.640039:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463450112 00000100:00100000:0.0:1746147178.640041:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463450112 00000100:00100000:1.0:1746147178.640050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.640053:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463450624 00000100:00100000:0.0:1746147178.640054:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463450624 00000100:00100000:0.0:1746147178.640063:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463450496 00000100:00100000:0.0:1746147178.640064:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463450496 00000100:00100000:0.0:1746147178.640071:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463450752 00000100:00100000:0.0:1746147178.640072:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463450752 00000100:00100000:0.0:1746147178.640082:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11078 00000100:00100000:0.0:1746147178.640087:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463450112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.640095:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.640109:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc9aa00/0xb4b2209fbdac4e0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5877 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.640113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147178.640125:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141768, atime: 0x68141768, ctime: 0x68141769, blocks: 0x7f9 00000100:00100000:1.0:1746147178.640131:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463451264 00000100:00100000:1.0:1746147178.640134:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463451264 00010000:00010000:0.0:1746147178.640139:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640140:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640147:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9aa00/0xb4b2209fbdac4e0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5877 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746147178.640157:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2125824->2129919) req@ffff8800a5a0fb80 x1830967463451264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746147178.640159:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9aa00/0xb4b2209fbdac4e0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5877 expref: 21 pid: 8481 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746147178.640166:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967463451264 ext(2125824->2129919) 00010000:00010000:0.0:1746147178.640168:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9aa00, rc 0) 00002000:00010000:1.0:1746147178.640170:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:1.0:1746147178.640181:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463451392 00000100:00100000:1.0:1746147178.640183:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463451392 00000100:00100000:0.0:1746147178.640328:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463450112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 240us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.640334:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11078 00000100:00100000:0.0:1746147178.640345:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11080 00000100:00100000:0.0:1746147178.640350:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463450368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.640356:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.640363:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5885 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147178.640373:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141768, atime: 0x68141768, ctime: 0x68141769, blocks: 0x821 00010000:00010000:0.0:1746147178.640380:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640382:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640385:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5885 expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.640398:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5885 expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.640404:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9be00, rc 0) 00000100:00100000:0.0:1746147178.640419:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463450368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.640424:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11080 00000100:00100000:0.0:1746147178.640434:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11081 00000100:00100000:0.0:1746147178.640439:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463450496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.640444:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.640451:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e588c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147178.640460:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814176a, atime: 0x6814176a, ctime: 0x6814176a, blocks: 0x821 00010000:00010000:0.0:1746147178.640465:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640466:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.640469:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 22 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.640476:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 22 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.640481:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9bc00, rc 0) 00000100:00100000:0.0:1746147178.640494:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463450496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.640502:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11081 00002000:00100000:1.0:1746147178.640655:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2605056->2609151) req@ffff8800a5a0ce00 x1830967463451392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.640669:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ce00 with x1830967463451392 ext(2605056->2609151) 00002000:00010000:1.0:1746147178.640672:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ce00 00000100:00100000:1.0:1746147178.640692:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4080 00000100:00100000:1.0:1746147178.640698:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463451264:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.640822:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463451264:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 124us (770us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.641875:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4080 00002000:00100000:1.0:1746147178.641882:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2125824->2129919) req@ffff8800a5a0fb80 x1830967463451264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.641889:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967463451264 ext(2125824->2129919) 00002000:00010000:1.0:1746147178.641892:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:0.0:1746147178.650057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.650099:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463451648 00000100:00100000:1.0:1746147178.650107:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463451648 00002000:00100000:1.0:1746147178.650136:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2220032->2224127) req@ffff88008daafb80 x1830967463451648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.650144:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daafb80 with x1830967463451648 ext(2220032->2224127) 00002000:00010000:1.0:1746147178.650148:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daafb80 00000100:00100000:1.0:1746147178.650175:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4082 00000100:00100000:1.0:1746147178.650183:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463451648:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.650334:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463451648:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 151us (278us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.650341:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4082 00002000:00100000:1.0:1746147178.650346:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2220032->2224127) req@ffff88008daafb80 x1830967463451648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.650352:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daafb80 with x1830967463451648 ext(2220032->2224127) 00002000:00010000:1.0:1746147178.650355:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daafb80 00000100:00100000:0.0:1746147178.652359:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463451904 00000100:00100000:0.0:1746147178.652366:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463451904 00002000:00100000:0.0:1746147178.652391:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2973696->2977791) req@ffff880132e11f80 x1830967463451904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.652403:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11f80 with x1830967463451904 ext(2973696->2977791) 00002000:00010000:0.0:1746147178.652407:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11f80 00000100:00100000:0.0:1746147178.652421:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4083 00000100:00100000:0.0:1746147178.652428:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463451904:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147178.652546:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463451904:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 118us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147178.652552:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4083 00002000:00100000:0.0:1746147178.652556:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2973696->2977791) req@ffff880132e11f80 x1830967463451904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.652563:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11f80 with x1830967463451904 ext(2973696->2977791) 00002000:00010000:0.0:1746147178.652566:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11f80 00000100:00100000:0.0:1746147178.656652:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463452160 00000100:00100000:0.0:1746147178.656670:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463452160 00000100:00100000:0.0:1746147178.656715:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4064 00000100:00100000:0.0:1746147178.656722:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28512:x1830967463452160:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147178.656994:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28512:x1830967463452160:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 271us (475us total) trans 8589944067 rc 0/0 00000100:00100000:0.0:1746147178.657005:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4064 00000100:00100000:0.0:1746147178.660869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.663330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.663358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.663383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.663403:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463452928 00000100:00100000:1.0:1746147178.663408:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463452928 00002000:00100000:1.0:1746147178.663437:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a5a0f100 x1830967463452928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.663445:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463452928 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.663450:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:1.0:1746147178.663462:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463453184 00000100:00100000:1.0:1746147178.663464:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463453184 00002000:00100000:1.0:1746147178.663474:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a5a0ea00 x1830967463453184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.663480:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ea00 with x1830967463453184 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.663484:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ea00 00000100:00100000:1.0:1746147178.663491:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463453440 00000100:00100000:1.0:1746147178.663493:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463453440 00002000:00100000:1.0:1746147178.663503:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a5a0e300 x1830967463453440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.663509:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e300 with x1830967463453440 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.663513:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0e300 00000100:00100000:1.0:1746147178.663524:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4085 00000100:00100000:1.0:1746147178.663530:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463452928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.664687:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4086 00000100:00100000:1.0:1746147178.664695:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463453184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.668831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.673315:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463452928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9783us (9990us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.673322:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4085 00002000:00100000:1.0:1746147178.673328:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a5a0f100 x1830967463452928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.673335:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463452928 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.673338:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0f100 00000100:00100000:1.0:1746147178.677215:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463453184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12511us (13846us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.677227:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4086 00002000:00100000:1.0:1746147178.677240:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a5a0ea00 x1830967463453184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.677249:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ea00 with x1830967463453184 ext(1048576->2097151) 00002000:00010000:1.0:1746147178.677255:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ea00 00000100:00100000:0.0:1746147178.681138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.681699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.681752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.681779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.681812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.681834:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463453824 00000100:00100000:1.0:1746147178.681842:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463453824 00000100:00100000:1.0:1746147178.681877:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463454080 00000100:00100000:1.0:1746147178.681879:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463454080 00000100:00100000:1.0:1746147178.681902:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463454208 00000100:00100000:1.0:1746147178.681905:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463454208 00000100:00100000:1.0:1746147178.681913:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463454336 00000100:00100000:1.0:1746147178.681914:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463454336 00000100:00100000:0.0:1746147178.681919:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11083 00000100:00100000:0.0:1746147178.681927:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463453824:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147178.681932:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11084 00000100:00100000:1.0:1746147178.681956:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463453952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.681960:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.681965:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.681976:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac4e58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58af expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.681976:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac4e51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58a8 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.681996:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.681996:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.681998:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.681998:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.682005:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac4e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a8 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.682006:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac4e58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58af expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.682019:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac4e58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58af expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.682019:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac4e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a8 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.682028:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199000, rc 0) 00010000:00010000:0.0:1746147178.682028:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e58800, rc 0) 00000100:00100000:0.0:1746147178.682058:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463453824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 132us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.682059:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463453952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.682064:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11083 00000100:00100000:1.0:1746147178.682068:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11084 00000100:00100000:0.0:1746147178.682080:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11085 00000100:00100000:1.0:1746147178.682084:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11086 00000100:00100000:0.0:1746147178.682085:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463454080:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147178.682089:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463454208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.682091:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.682095:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.682099:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58b6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.682103:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58bd expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.682108:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.682109:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.682113:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58b6 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.682116:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.682117:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.682121:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.682122:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58b6 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147178.682128:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e59400, rc 0) 00010000:00010000:1.0:1746147178.682129:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.682135:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199800, rc 0) 00000100:00100000:0.0:1746147178.682143:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463454080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.682147:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11085 00000100:00100000:1.0:1746147178.682150:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463454208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.682156:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11086 00000100:00100000:0.0:1746147178.682159:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11087 00000100:00100000:0.0:1746147178.682162:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463454336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147178.682168:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147178.682322:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab5f800/0xb4b2209fbdac4e6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58c4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.682362:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466304896:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147178.682509:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.693218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.697143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.703562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.703647:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463454976 00000100:00100000:1.0:1746147178.703666:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463454976 00002000:00100000:1.0:1746147178.703708:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d01180 x1830967463454976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.703719:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463454976 ext(0->1048575) 00002000:00010000:1.0:1746147178.703725:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:1.0:1746147178.703749:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4088 00000100:00100000:1.0:1746147178.703756:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463454976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147178.704104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.704121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.704141:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.705511:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4091 00000100:00100000:0.0:1746147178.705521:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463455488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147178.715118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.722114:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463454976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18356us (18560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.722123:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4088 00002000:00100000:1.0:1746147178.722131:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d01180 x1830967463454976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.722145:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463454976 ext(0->1048575) 00002000:00010000:1.0:1746147178.722150:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:0.0:1746147178.727904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.727933:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.728142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.729379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.729457:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463456000 00000100:00100000:1.0:1746147178.729465:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463456000 00002000:00100000:1.0:1746147178.729507:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012c9f2680 x1830967463456000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.729517:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967463456000 ext(2097152->3145727) 00002000:00010000:1.0:1746147178.729521:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:1.0:1746147178.729536:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463456512 00000100:00100000:1.0:1746147178.729539:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463456512 00002000:00100000:1.0:1746147178.729551:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3244031) req@ffff88009f733100 x1830967463456512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 504/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.729556:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967463456512 ext(2097152->3244031) 00002000:00010000:1.0:1746147178.729559:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f733100 00000100:00100000:1.0:1746147178.729566:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463456768 00000100:00100000:1.0:1746147178.729567:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463456768 00002000:00100000:1.0:1746147178.729574:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3244032->4194303) req@ffff8800a4faca80 x1830967463456768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.729579:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967463456768 ext(3244032->4194303) 00002000:00010000:1.0:1746147178.729580:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:1.0:1746147178.729604:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4092 00000100:00100000:1.0:1746147178.729611:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463456000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.729680:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4095 00000100:00100000:1.0:1746147178.729685:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463456768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.743258:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463456000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13639us (15356us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.743268:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4092 00002000:00100000:1.0:1746147178.743280:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012c9f2680 x1830967463456000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.743289:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2680 with x1830967463456000 ext(2097152->3145727) 00002000:00010000:1.0:1746147178.743294:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2680 00000100:00100000:0.0:1746147178.750843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.750926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.751093:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463456896 00000100:00100000:1.0:1746147178.751102:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463456896 00000100:00100000:1.0:1746147178.751132:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463457024 00000100:00100000:1.0:1746147178.751134:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463457024 00000100:00100000:1.0:1746147178.751147:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11089 00000100:00100000:1.0:1746147178.751154:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463456896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.751169:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.751181:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58d2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.751199:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.751201:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.751208:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.751220:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.751229:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a1fa00, rc 0) 00000100:00100000:1.0:1746147178.751274:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463456896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147178.751283:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11089 00000100:00100000:1.0:1746147178.754098:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463456768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24399us (24707us total) trans 0 rc 950272/950272 00000100:00100000:1.0:1746147178.754110:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4095 00002000:00100000:1.0:1746147178.754124:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3244032->4194303) req@ffff8800a4faca80 x1830967463456768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.754132:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967463456768 ext(3244032->4194303) 00002000:00010000:1.0:1746147178.754137:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:0.0:1746147178.760613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.760680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.760908:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463457408 00000100:00100000:1.0:1746147178.760917:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463457408 00002000:00100000:1.0:1746147178.760983:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4fad180 x1830967463457408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.760992:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463457408 ext(4194304->4870143) 00002000:00010000:1.0:1746147178.760997:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad180 00000100:00100000:1.0:1746147178.761023:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463457536 00000100:00100000:1.0:1746147178.761026:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463457536 00002000:00100000:1.0:1746147178.761039:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e975500 x1830967463457536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.761045:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975500 with x1830967463457536 ext(2097152->3145727) 00002000:00010000:1.0:1746147178.761048:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e975500 00000100:00100000:1.0:1746147178.761061:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4096 00000100:00100000:1.0:1746147178.761068:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463457408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.767671:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463457408:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6586us (7047us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147178.767681:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4096 00002000:00100000:1.0:1746147178.767693:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4fad180 x1830967463457408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.767702:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463457408 ext(4194304->4870143) 00002000:00010000:1.0:1746147178.767707:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad180 00000100:00100000:0.0:1746147178.784437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.787118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.787684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.790848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.790876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.790894:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463458304 00000100:00100000:0.0:1746147178.790898:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463458304 00010000:00010000:0.0:1746147178.790920:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b27200/0xb4b2209fbdac4e43 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a1 expref: 12 pid: 14049 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.790958:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463458176 00000100:00100000:0.0:1746147178.790961:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5390 00000100:00100000:1.0:1746147178.790963:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463458176 00000100:00100000:0.0:1746147178.790967:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463458304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147178.790976:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5854 expref: 304 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.790976:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.790981:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b27200/0xb4b2209fbdac4e43 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a1 expref: 12 pid: 14049 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.790989:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b27200/0xb4b2209fbdac4e43 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a1 expref: 12 pid: 14049 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.791006:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147178.791010:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac4e97 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147178.791016:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac4e97 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147178.791020:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147178.791187:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5391 00000100:00100000:1.0:1746147178.791193:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967463458176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147178.791199:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.791202:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5854 expref: 304 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.791209:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0xb4b2209fbdac4de1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5854 expref: 304 pid: 14125 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.791220:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147178.791222:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac4e97 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.791228:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac4e97 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.791234:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac4e97 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147178.791247:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147178.791623:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967463458176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 430us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.791623:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463458304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 655us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147178.791628:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5390 00000100:00100000:1.0:1746147178.791631:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5391 00000100:00100000:0.0:1746147178.795582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.808043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.808085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.808168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.808198:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463459200 00000100:00100000:1.0:1746147178.808201:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463459200 00002000:00100000:1.0:1746147178.808224:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f7cca80 x1830967463459200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.808231:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cca80 with x1830967463459200 ext(3145728->4194303) 00002000:00010000:1.0:1746147178.808233:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cca80 00000100:00100000:1.0:1746147178.808246:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4099 00000100:00100000:1.0:1746147178.808250:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463458944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.808291:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4100 00000100:00100000:1.0:1746147178.808296:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463459200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.819551:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463459200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11243us (11372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.819569:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4100 00002000:00100000:1.0:1746147178.819583:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f7cca80 x1830967463459200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.819594:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cca80 with x1830967463459200 ext(3145728->4194303) 00002000:00010000:1.0:1746147178.819601:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cca80 00000100:00100000:0.0:1746147178.828237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.832891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.832968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.833059:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463459456 00000100:00100000:1.0:1746147178.833065:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463459456 00000100:00100000:1.0:1746147178.833103:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11093 00000100:00100000:1.0:1746147178.833109:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463459456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147178.833125:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147178.833139:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efdc800/0xb4b2209fbdac4eac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e58f5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147178.833153:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147178.833161:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efdc800/0xb4b2209fbdac4eac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58f5 expref: 19 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.833177:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efdc800/0xb4b2209fbdac4eac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58f5 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147178.833194:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efdc800, rc 0) 00000100:00100000:1.0:1746147178.833212:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463459456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 104us (332us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147178.833217:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11093 00000100:00100000:0.0:1746147178.837503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.838803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.853384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.854321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.862433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.862491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.862558:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463460608 00000100:00100000:1.0:1746147178.862564:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463460608 00010000:00010000:1.0:1746147178.862599:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 20 pid: 8478 timeout: 665 lvb_type: 1 00000100:00100000:1.0:1746147178.862624:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463460736 00000100:00100000:1.0:1746147178.862627:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463460736 00010000:00010000:1.0:1746147178.862637:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efdce00/0xb4b2209fbdac4e74 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58cb expref: 21 pid: 17548 timeout: 665 lvb_type: 0 00000100:00100000:1.0:1746147178.862673:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5394 00000100:00100000:1.0:1746147178.862681:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a46f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463460608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147178.862694:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.862717:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 20 pid: 8478 timeout: 665 lvb_type: 1 00010000:00010000:1.0:1746147178.862727:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 20 pid: 8478 timeout: 665 lvb_type: 1 00010000:00010000:1.0:1746147178.862749:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac4e7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58d2 expref: 20 pid: 8478 timeout: 665 lvb_type: 1 00000100:00100000:0.0:1746147178.862749:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5395 00000100:00100000:0.0:1746147178.862757:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463460736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.862765:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147178.862768:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147178.862774:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efdce00/0xb4b2209fbdac4e74 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58cb expref: 21 pid: 17548 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.862784:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efdce00/0xb4b2209fbdac4e74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58cb expref: 21 pid: 17548 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.862797:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.862798:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.862804:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac4eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58fc expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.862811:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a46f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463460608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147178.862812:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac4eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58fc expref: 19 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147178.862817:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5394 00010000:00010000:0.0:1746147178.862838:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4af000/0xb4b2209fbdac4eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58fc expref: 18 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.862849:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466306432:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147178.862897:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.870220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.880103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.891135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.899880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.900958:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463461504 00000100:00100000:1.0:1746147178.900967:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463461504 00002000:00100000:1.0:1746147178.901004:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2969600->3145727) req@ffff88008fc97800 x1830967463461504/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.901014:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463461504 ext(2969600->3145727) 00010000:00010000:1.0:1746147178.901021:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.901039:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 15 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.901045:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc97800 00000100:00100000:1.0:1746147178.901073:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1425 00000100:00100000:1.0:1746147178.901080:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463461504:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147178.903142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.906255:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463461504:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5171us (6381us total) trans 17179873136 rc 0/0 00000100:00100000:1.0:1746147178.906266:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1425 00002000:00100000:1.0:1746147178.906275:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2969600->3145727) req@ffff88008fc97800 x1830967463461504/t17179873136(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:554/0 lens 488/448 e 0 to 0 dl 1746147189 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.906285:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463461504 ext(2969600->3145727) 00010000:00010000:1.0:1746147178.906294:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:1.0:1746147178.906307:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00002000:00010000:1.0:1746147178.906314:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc97800 00000100:00100000:0.0:1746147178.910597:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463462016 00000100:00100000:0.0:1746147178.910605:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463462016 00010000:00010000:0.0:1746147178.910640:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00000100:00100000:0.0:1746147178.910685:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463461888 00000100:00100000:0.0:1746147178.910687:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463461888 00000100:00100000:0.0:1746147178.910706:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5396 00000100:00100000:0.0:1746147178.910713:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463462016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147178.910725:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147178.910746:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.910757:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.910780:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9ff400/0xb4b2209fbdac4ea5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58ee expref: 17 pid: 17530 timeout: 665 lvb_type: 0 00010000:00010000:0.0:1746147178.910809:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.910811:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147178.910819:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.910826:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147178.910855:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147178.910871:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466306688:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147178.910982:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147178.914013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.914037:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463462528 00000100:00100000:1.0:1746147178.914044:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463462528 00002000:00100000:1.0:1746147178.914085:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3420160->3424255) req@ffff88008fc96d80 x1830967463462528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.914095:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463462528 ext(3420160->3424255) 00002000:00010000:1.0:1746147178.914101:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96d80 00000100:00100000:1.0:1746147178.914133:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4104 00000100:00100000:1.0:1746147178.914140:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463462528:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.914527:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463462528:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 386us (515us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.914533:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4104 00002000:00100000:1.0:1746147178.914539:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3420160->3424255) req@ffff88008fc96d80 x1830967463462528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.914546:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463462528 ext(3420160->3424255) 00002000:00010000:1.0:1746147178.914550:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96d80 00000100:00100000:0.0:1746147178.915144:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.920135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147178.920279:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463462912 00000100:00100000:1.0:1746147178.920288:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463462912 00002000:00100000:1.0:1746147178.920334:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3645440->3649535) req@ffff88008fc96680 x1830967463462912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.920344:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96680 with x1830967463462912 ext(3645440->3649535) 00002000:00010000:1.0:1746147178.920349:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96680 00000100:00100000:1.0:1746147178.920380:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4105 00000100:00100000:1.0:1746147178.920388:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463462912:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147178.920587:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463462912:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 199us (462us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147178.920593:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4105 00002000:00100000:1.0:1746147178.920599:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3645440->3649535) req@ffff88008fc96680 x1830967463462912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.920611:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96680 with x1830967463462912 ext(3645440->3649535) 00002000:00010000:1.0:1746147178.920614:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96680 00000100:00100000:0.0:1746147178.926580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.929442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.934976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.947585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.947626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.947668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.947701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.947731:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463463808 00000100:00100000:0.0:1746147178.947738:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463463808 00002000:00100000:0.0:1746147178.947777:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc94000 x1830967463463808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.947786:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94000 with x1830967463463808 ext(2097152->3145727) 00002000:00010000:0.0:1746147178.947791:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc94000 00000100:00100000:0.0:1746147178.947892:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463464192 00000100:00100000:0.0:1746147178.947895:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463464192 00002000:00100000:0.0:1746147178.948004:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e681f80 x1830967463464192/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.948012:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967463464192 ext(2097152->3145727) 00002000:00010000:0.0:1746147178.948015:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:1.0:1746147178.948065:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463464576 00000100:00100000:1.0:1746147178.948069:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463464576 00002000:00100000:1.0:1746147178.948086:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090508000 x1830967463464576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 504/0 e 0 to 0 dl 1746147189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.948092:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508000 with x1830967463464576 ext(3145728->4194303) 00002000:00010000:1.0:1746147178.948094:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508000 00000100:00100000:1.0:1746147178.948108:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4107 00000100:00100000:1.0:1746147178.948113:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463464064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147178.966868:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463464064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18743us (19230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147178.966881:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4107 00002000:00100000:1.0:1746147178.966893:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e681880 x1830967463464064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147178.966903:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681880 with x1830967463464064 ext(3145728->4194303) 00002000:00010000:1.0:1746147178.966908:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681880 00000100:00100000:0.0:1746147178.973752:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463464192:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25576us (26075us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147178.973762:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4108 00002000:00100000:0.0:1746147178.973771:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e681f80 x1830967463464192/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:554/0 lens 488/440 e 0 to 0 dl 1746147189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147178.973779:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967463464192 ext(2097152->3145727) 00002000:00010000:0.0:1746147178.973784:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:0.0:1746147178.989534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.993292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147178.996226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.002309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.002346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.002406:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463465472 00000100:00100000:1.0:1746147179.002411:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463465472 00000100:00100000:0.0:1746147179.002451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.002475:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11098 00000100:00100000:1.0:1746147179.002488:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463465472:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147179.002490:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463465728 00000100:00100000:0.0:1746147179.002497:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463465728 00010000:00010000:1.0:1746147179.002504:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.002517:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe9a200/0xb4b2209fbdac4f5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e593b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147179.002532:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4069 00000100:00100000:0.0:1746147179.002538:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:19602:x1830967463465728:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147179.002560:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466307328:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147179.002838:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.003407:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:19602:x1830967463465728:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 865us (951us total) trans 8589944076 rc 0/0 00000100:00100000:1.0:1746147179.003415:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4069 00000100:00100000:1.0:1746147179.005248:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466307328:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147179.005277:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe9a200/0xb4b2209fbdac4f5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e593b expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.005289:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe9a200/0xb4b2209fbdac4f5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e593b expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.005312:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9a200, rc 0) 00000100:00100000:1.0:1746147179.005469:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463465472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2984us (3119us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.005476:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11098 00000100:00100000:0.0:1746147179.017727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.020123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.021346:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466240 00000100:00100000:0.0:1746147179.021353:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466240 00000100:00100000:0.0:1746147179.021406:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466496 00000100:00100000:0.0:1746147179.021408:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466496 00000100:00100000:0.0:1746147179.021424:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466368 00000100:00100000:0.0:1746147179.021425:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466368 00000100:00100000:0.0:1746147179.021433:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466624 00000100:00100000:0.0:1746147179.021434:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466624 00000100:00100000:0.0:1746147179.021443:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466752 00000100:00100000:0.0:1746147179.021444:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466752 00000100:00100000:0.0:1746147179.021450:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463466880 00000100:00100000:0.0:1746147179.021451:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463466880 00000100:00100000:0.0:1746147179.021461:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11100 00000100:00100000:0.0:1746147179.021467:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463466240:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147179.021488:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.021508:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6a9a00/0xb4b2209fbdac4f62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5942 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.021532:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.021534:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.021543:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6a9a00/0xb4b2209fbdac4f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5942 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.021560:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6a9a00/0xb4b2209fbdac4f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5942 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.021571:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a9a00, rc 0) 00000100:00100000:0.0:1746147179.021609:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463466240:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 143us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.021614:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11100 00000100:00100000:0.0:1746147179.021629:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11101 00000100:00100000:0.0:1746147179.022233:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463466496:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147179.022240:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.022247:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5950 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.022256:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.022257:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.022261:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5950 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.022269:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5950 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.022276:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a9800, rc 0) 00000100:00100000:0.0:1746147179.022294:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463466496:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 63us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.022299:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11101 00000100:00100000:1.0:1746147179.041579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.041698:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463467264 00000100:00100000:0.0:1746147179.041707:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463467264 00000100:00100000:0.0:1746147179.041752:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11106 00000100:00100000:0.0:1746147179.041759:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28535:x1830967463467264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.041779:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.041798:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5973 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.041828:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.041836:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147179.041838:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147179.041841:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5973 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.041873:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.041885:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae200/0xb4b2209fbdac4edd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3649535) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e590a expref: 29 pid: 8478 timeout: 666 lvb_type: 0 00000100:00100000:0.0:1746147179.041896:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466307584:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147179.042009:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.047620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.049762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.054881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.055473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.061088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.061206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.061221:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463468416 00000100:00100000:1.0:1746147179.061229:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463468416 00000100:00100000:1.0:1746147179.061265:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4070 00000100:00100000:1.0:1746147179.061272:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28536:x1830967463468416:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147179.061637:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463468160 00000100:00100000:0.0:1746147179.061640:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463468160 00000100:00100000:0.0:1746147179.061674:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 578 00000100:00100000:0.0:1746147179.061679:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1958:x1830967463468160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147179.061692:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147179.061711:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b400/0xb4b2209fbdac4fbd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e597a expref: 310 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.061872:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.061875:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147179.061906:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1958:x1830967463468160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 226us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.061914:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 578 00000100:00100000:0.0:1746147179.062036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.062113:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28536:x1830967463468416:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 840us (905us total) trans 8589944079 rc 0/0 00000100:00100000:1.0:1746147179.062120:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4070 00000100:00100000:0.0:1746147179.070514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.079678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.079711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.079770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.080899:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463469184 00000100:00100000:1.0:1746147179.080904:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463469184 00002000:00100000:1.0:1746147179.080922:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880092a72680 x1830967463469184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.080929:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830967463469184 ext(2097152->3145727) 00010000:00010000:1.0:1746147179.080947:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5973 expref: 18 pid: 21080 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.080958:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5973 expref: 18 pid: 21080 timeout: 666 lvb_type: 0 00002000:00010000:1.0:1746147179.080964:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72680 00000100:00100000:1.0:1746147179.080981:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1428 00000100:00100000:1.0:1746147179.080986:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463469184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147179.090352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.092385:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463469184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11376us (12650us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147179.092393:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1428 00002000:00100000:1.0:1746147179.092401:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880092a72680 x1830967463469184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.092410:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a72680 with x1830967463469184 ext(2097152->3145727) 00010000:00010000:1.0:1746147179.092417:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5973 expref: 19 pid: 21080 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.092434:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac4f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5973 expref: 19 pid: 21080 timeout: 666 lvb_type: 0 00002000:00010000:1.0:1746147179.092440:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a72680 00000100:00100000:1.0:1746147179.104113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.108023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.108238:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463470080 00000100:00100000:1.0:1746147179.108248:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463470080 00000100:00100000:1.0:1746147179.108302:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11108 00000100:00100000:1.0:1746147179.108309:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28535:x1830967463470080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.108325:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.108339:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5996 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.108361:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.108363:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.108389:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5996 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.108401:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5996 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.108411:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9ba00, rc 0) 00000100:00100000:1.0:1746147179.108471:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28535:x1830967463470080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.108477:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11108 00000100:00100000:0.0:1746147179.116280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.116315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.116520:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463470336 00000100:00100000:1.0:1746147179.116528:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463470336 00000100:00100000:0.0:1746147179.116537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.116571:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11110 00000100:00100000:1.0:1746147179.116575:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463470336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.116587:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.116600:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe9be00/0xb4b2209fbdac5011 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59a4 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.116618:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.116625:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe9be00/0xb4b2209fbdac5011 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59a4 expref: 19 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.116634:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe9be00/0xb4b2209fbdac5011 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59a4 expref: 19 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.116668:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9be00, rc 0) 00000100:00100000:1.0:1746147179.116699:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463470336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 123us (384us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.116704:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11110 00000100:00100000:0.0:1746147179.119735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.125792:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463470848 00000100:00100000:1.0:1746147179.125800:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463470848 00010000:00010000:1.0:1746147179.125838:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4aee00/0xb4b2209fbdac4f0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e591f expref: 21 pid: 8478 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.125871:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5402 00000100:00100000:1.0:1746147179.125879:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463470848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.125891:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.125908:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4aee00/0xb4b2209fbdac4f0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e591f expref: 21 pid: 8478 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.125919:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4aee00/0xb4b2209fbdac4f0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e591f expref: 21 pid: 8478 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.125962:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4aee00/0xb4b2209fbdac4f0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e591f expref: 21 pid: 8478 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.125979:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.126009:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463470848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.126015:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5402 00000100:00100000:0.0:1746147179.129772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.130113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.130564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.130645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.131909:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4115 00000100:00100000:1.0:1746147179.131933:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463471488:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147179.137127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.137189:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463471744 00000100:00100000:1.0:1746147179.137200:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463471744 00002000:00100000:1.0:1746147179.137237:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3530752->3534847) req@ffff88009a80c700 x1830967463471744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.137247:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c700 with x1830967463471744 ext(3530752->3534847) 00002000:00010000:1.0:1746147179.137251:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c700 00000100:00100000:1.0:1746147179.137283:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4116 00000100:00100000:1.0:1746147179.137290:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463471744:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147179.137442:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463471744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 152us (322us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147179.137448:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4116 00002000:00100000:1.0:1746147179.137454:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3530752->3534847) req@ffff88009a80c700 x1830967463471744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/4536 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.137460:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c700 with x1830967463471744 ext(3530752->3534847) 00002000:00010000:1.0:1746147179.137463:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c700 00000100:00100000:1.0:1746147179.140029:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463471488:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8106us (9375us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746147179.140039:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4115 00002000:00100000:1.0:1746147179.140050:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4206592->4870143) req@ffff88009a80c380 x1830967463471488/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 663552/663552 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.140058:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c380 with x1830967463471488 ext(4206592->4870143) 00002000:00010000:1.0:1746147179.140063:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c380 00000100:00100000:0.0:1746147179.142536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.143478:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463472000 00000100:00100000:1.0:1746147179.143487:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463472000 00002000:00100000:1.0:1746147179.143537:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2850816->2854911) req@ffff88009a80e300 x1830967463472000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.143545:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463472000 ext(2850816->2854911) 00002000:00010000:1.0:1746147179.143549:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:1.0:1746147179.143582:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4117 00000100:00100000:1.0:1746147179.143589:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463472000:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147179.143759:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463472000:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 170us (1228us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147179.143766:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4117 00002000:00100000:1.0:1746147179.143771:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2850816->2854911) req@ffff88009a80e300 x1830967463472000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/4536 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.143784:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463472000 ext(2850816->2854911) 00002000:00010000:1.0:1746147179.143786:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:0.0:1746147179.146555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.146676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.147979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.148054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.148086:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463472768 00000100:00100000:0.0:1746147179.148091:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463472768 00000100:00100000:0.0:1746147179.148129:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4071 00000100:00100000:0.0:1746147179.148135:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28539:x1830967463472768:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147179.148304:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:28539:x1830967463472768:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 168us (249us total) trans 8589944081 rc 0/0 00000100:00100000:0.0:1746147179.148313:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4071 00000100:00100000:0.0:1746147179.151381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.152862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.152898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.153280:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11115 00000100:00100000:0.0:1746147179.153285:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463473280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.153296:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.153309:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f5a400/0xb4b2209fbdac502d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59c7 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.153330:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f5a400/0xb4b2209fbdac502d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59c7 expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.153338:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5a400/0xb4b2209fbdac502d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59c7 expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.153346:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5a400, rc 0) 00000100:00100000:0.0:1746147179.153369:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463473280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 85us (472us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147179.153374:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11115 00000100:00100000:0.0:1746147179.160228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.246273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.253430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.258119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.258398:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463474176 00000100:00100000:1.0:1746147179.258409:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463474176 00000100:00100000:1.0:1746147179.258460:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11116 00000100:00100000:1.0:1746147179.258467:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463474176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.258483:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.258496:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac505e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59d5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.258521:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac505e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59d5 expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.258531:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac505e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59d5 expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.258550:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9aa00, rc 0) 00000100:00100000:1.0:1746147179.258585:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463474176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (473us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.258592:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11116 00000100:00100000:0.0:1746147179.258917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.270139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.270183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.270236:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463474432 00000100:00100000:1.0:1746147179.270246:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463474432 00000100:00100000:1.0:1746147179.270463:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463474560 00000100:00100000:1.0:1746147179.270466:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463474560 00000100:00100000:1.0:1746147179.270498:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11118 00000100:00100000:1.0:1746147179.270507:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463474432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.270524:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.270537:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a200/0xb4b2209fbdac506c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59e3 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.270564:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a200/0xb4b2209fbdac506c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59e3 expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.270574:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a200/0xb4b2209fbdac506c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59e3 expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.270587:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9a200, rc 0) 00000100:00100000:0.0:1746147179.270686:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11119 00000100:00100000:0.0:1746147179.270692:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463474560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.270703:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.270713:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f5b800/0xb4b2209fbdac5073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59ea expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.270727:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f5b800/0xb4b2209fbdac5073 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ea expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.270734:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5b800/0xb4b2209fbdac5073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ea expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.270745:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5b800, rc 0) 00000100:00100000:1.0:1746147179.271136:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463474432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 628us (1003us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.271142:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11118 00000100:00100000:0.0:1746147179.271223:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463474560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 531us (1039us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147179.271228:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11119 00000100:00100000:0.0:1746147179.274587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.274693:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463474688 00000100:00100000:1.0:1746147179.274703:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463474688 00000100:00100000:1.0:1746147179.274738:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11120 00000100:00100000:1.0:1746147179.275716:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28549:x1830967463474688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.275735:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.275749:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59f1 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.275770:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.275772:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.275778:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.275798:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.275806:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9b600, rc 0) 00000100:00100000:1.0:1746147179.275859:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28549:x1830967463474688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1113us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.275865:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11120 00000100:00100000:0.0:1746147179.279077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.280528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.288287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.288331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.289053:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463475328 00000100:00100000:1.0:1746147179.289061:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463475328 00000100:00100000:1.0:1746147179.289106:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463475456 00000100:00100000:1.0:1746147179.289109:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463475456 00000100:00100000:1.0:1746147179.289125:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11121 00000100:00100000:1.0:1746147179.289133:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463475328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.289147:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.289163:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a000/0xb4b2209fbdac5096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e59ff expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.289188:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a000/0xb4b2209fbdac5096 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ff expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.289198:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9a000/0xb4b2209fbdac5096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ff expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.289218:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9a000, rc 0) 00000100:00100000:1.0:1746147179.289253:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463475328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 122us (972us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.289259:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11121 00000100:00100000:1.0:1746147179.289274:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11122 00000100:00100000:1.0:1746147179.289279:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463475456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.289285:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.289293:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac509d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a06 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.289305:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac509d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a06 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.289312:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe9aa00/0xb4b2209fbdac509d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a06 expref: 18 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.289323:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9aa00, rc 0) 00000100:00100000:1.0:1746147179.290125:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463475456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 845us (1792us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.290131:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11122 00000100:00100000:0.0:1746147179.295018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.300996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.302602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.305540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.307292:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463476096 00000100:00100000:1.0:1746147179.307302:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463476096 00002000:00100000:1.0:1746147179.307342:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d34a80 x1830967463476096/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.307352:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34a80 with x1830967463476096 ext(2097152->3145727) 00002000:00010000:1.0:1746147179.307357:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34a80 00000100:00100000:1.0:1746147179.307390:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4120 00000100:00100000:1.0:1746147179.307399:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463476096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147179.316228:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463476096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8829us (10694us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147179.316236:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4120 00002000:00100000:0.0:1746147179.316243:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d34a80 x1830967463476096/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.316251:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34a80 with x1830967463476096 ext(2097152->3145727) 00002000:00010000:0.0:1746147179.316254:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34a80 00000100:00100000:0.0:1746147179.323847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.324365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.335406:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463476480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10817us (11559us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147179.335414:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4121 00002000:00100000:0.0:1746147179.335419:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880093d35880 x1830967463476480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.335426:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35880 with x1830967463476480 ext(2097152->3145727) 00002000:00010000:0.0:1746147179.335429:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d35880 00000100:00100000:0.0:1746147179.342417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.343197:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463476992 00000100:00100000:1.0:1746147179.343205:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463476992 00000100:00100000:1.0:1746147179.343256:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11126 00000100:00100000:1.0:1746147179.343263:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28549:x1830967463476992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.343279:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.343294:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a22 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.343320:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ba00/0xb4b2209fbdac500a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3530752->3764223] (req 3530752->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e599d expref: 21 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.343327:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.343329:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.343332:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.343358:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ba00/0xb4b2209fbdac500a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3530752->3764223] (req 3530752->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e599d expref: 21 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.343369:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ba00/0xb4b2209fbdac500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3530752->3764223] (req 3530752->3764223) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e599d expref: 21 pid: 21080 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.343381:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466308992:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.343449:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.347426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.347694:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466308992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.347718:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.347733:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9bc00, rc 0) 00000100:00100000:1.0:1746147179.347775:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:28549:x1830967463476992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4512us (5365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.347783:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11126 00000100:00100000:0.0:1746147179.349998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.350040:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463477248 00000100:00100000:1.0:1746147179.350047:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463477248 00000100:00100000:1.0:1746147179.350084:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11127 00000100:00100000:1.0:1746147179.350091:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28552:x1830967463477248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.350102:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.350115:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a29 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.350134:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.350139:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.350147:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.350155:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe9b400, rc 0) 00000100:00100000:1.0:1746147179.350193:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28552:x1830967463477248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 101us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.350198:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11127 00000100:00100000:0.0:1746147179.357585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.366048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.366095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.379884:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463478144 00000100:00100000:0.0:1746147179.379893:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463478144 00002000:00100000:0.0:1746147179.379928:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880132e12680 x1830967463478144/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.379950:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463478144 ext(3145728->4194303) 00002000:00010000:0.0:1746147179.379955:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147179.379980:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463478400 00000100:00100000:0.0:1746147179.379983:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463478400 00002000:00100000:0.0:1746147179.379994:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880132e12a00 x1830967463478400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.380001:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12a00 with x1830967463478400 ext(3145728->4194303) 00002000:00010000:0.0:1746147179.380003:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12a00 00000100:00100000:0.0:1746147179.380019:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4125 00000100:00100000:0.0:1746147179.380026:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463478144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147179.381270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.388697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.403375:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463478144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23341us (23901us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147179.403386:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4125 00002000:00100000:0.0:1746147179.403397:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880132e12680 x1830967463478144/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.403405:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463478144 ext(3145728->4194303) 00002000:00010000:0.0:1746147179.403410:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147179.403458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.403475:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463479168 00000100:00100000:0.0:1746147179.403482:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463479168 00000100:00100000:0.0:1746147179.403508:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10365 00000100:00100000:0.0:1746147179.403514:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28556:x1830967463479168:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147179.403529:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.403542:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8600/0xb4b2209fbdac50d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a37 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.403617:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147179.403627:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147179.403634:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147179.403730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147179.404439:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147179.404446:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:0.0:1746147179.404456:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147179.404547:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8600/0xb4b2209fbdac50d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a37 expref: 23 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.404564:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6a8a00/0xb4b2209fbdac50dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a37 expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.404570:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.404572:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147179.404574:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a8a00, rc 0) 00000100:00100000:0.0:1746147179.404594:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28556:x1830967463479168:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1079us (1135us total) trans 8589944087 rc 0/0 00000100:00100000:0.0:1746147179.404599:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10365 00000100:00100000:1.0:1746147179.407323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.407368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.409276:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463479680 00000100:00100000:0.0:1746147179.409280:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463479680 00002000:00100000:0.0:1746147179.409293:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4206591) req@ffff88009f7cc380 x1830967463479680/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.409300:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc380 with x1830967463479680 ext(4194304->4206591) 00002000:00010000:0.0:1746147179.409302:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cc380 00000100:00100000:0.0:1746147179.422134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.433743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.433799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.434203:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463479936 00000100:00100000:1.0:1746147179.434211:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463479936 00010000:00010000:1.0:1746147179.434245:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6a9a00/0xb4b2209fbdac4f62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5942 expref: 15 pid: 6881 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.434431:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463480064 00000100:00100000:1.0:1746147179.434435:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463480064 00010000:00010000:1.0:1746147179.434449:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac4e51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58a8 expref: 24 pid: 17548 timeout: 666 lvb_type: 1 00000100:00100000:0.0:1746147179.436236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.440304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.448030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.452017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.452057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.452513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.457231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.479634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.488730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.494192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.503558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147179.504434:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98200/0xb4b2209fbdac5114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504441:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98200/0xb4b2209fbdac5114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147179.504484:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147179.504488:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147179.504504:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98200/0xb4b2209fbdac5114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504514:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98200/0xb4b2209fbdac5114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504524:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504529:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504535:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504541:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a98600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147179.504545:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504551:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504561:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147179.504564:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147179.504567:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504571:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504590:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504596:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504600:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504604:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a98e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147179.504607:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504612:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504619:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a56dea00) 00010000:00010000:0.0:1746147179.504621:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147179.504623:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504628:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac510d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.504684:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98a00/0xb4b2209fbdac50ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a4c expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.504697:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98200/0xb4b2209fbdac5114 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a4c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.504702:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.504704:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147179.504706:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a98200, rc 0) 00000100:00100000:0.0:1746147179.506339:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28560:x1830967463481344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 25968us (26712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.506347:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10366 00000100:00100000:0.0:1746147179.509911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.510012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.510046:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463481984 00000100:00100000:1.0:1746147179.510054:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463481984 00000100:00100000:0.0:1746147179.510054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.510091:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463482112 00000100:00100000:1.0:1746147179.510093:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463482112 00000100:00100000:0.0:1746147179.510099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.510540:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463482240 00000100:00100000:1.0:1746147179.510543:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463482240 00000100:00100000:0.0:1746147179.510916:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11133 00000100:00100000:0.0:1746147179.510926:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463482368:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147179.510963:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.510975:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a68 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.510988:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.510990:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.510997:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a68 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.511008:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a68 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.511016:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a8000, rc 0) 00000100:00100000:0.0:1746147179.513177:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463482368:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2243us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.513186:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11133 00000100:00100000:0.0:1746147179.521459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.524850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.525084:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147179.525099:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147179.526724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147179.526764:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466311296 00000100:00100000:1.0:1746147179.526770:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466311296 00000100:00100000:1.0:1746147179.526809:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1746147179.526815:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967466311296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147179.526837:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 403243008 pending 17039360 free 3839885312 avail 3837788160 00000100:00100000:1.0:1746147179.526871:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3296:x1830967466311296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.526877:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1746147179.526929:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147179.533975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.543875:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b57d6275-d138-4373-818f-9bad59bb9e6f:3293:1830967466311680:0@lo:400:kworker.0 00000100:00100000:1.0:1746147179.544350:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147179.544453:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466311552:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.544472:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5153 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147179.544510:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466311680 00000100:00100000:1.0:1746147179.544512:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466311680 00000100:00100000:1.0:1746147179.544550:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1746147179.544555:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3293:x1830967466311680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147179.544577:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3293:x1830967466311680:12345-0@lo:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.544582:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1746147179.544605:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466311808 00000100:00100000:1.0:1746147179.544607:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466311808 00000100:00100000:1.0:1746147179.544625:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1746147179.544629:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466311808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147179.544649:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466311808:12345-0@lo:400:kworker.0 Request processed in 20us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.544663:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1746147179.544678:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b57d6275-d138-4373-818f-9bad59bb9e6f:3293:1830967466311680:0@lo:400:kworker.0 00000100:00100000:0.0:1746147179.553069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.553128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147179.554301:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5153 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.554307:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5153 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147179.554349:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147179.554354:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147179.554375:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5153 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147179.554404:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98e00/0xb4b2209fbdac514c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a76 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.554418:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98600/0xb4b2209fbdac5153 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a76 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.554424:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.554426:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147179.554428:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a98600, rc 0) 00000100:00100000:0.0:1746147179.554452:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:28560:x1830967463482880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 19087us (20525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.554458:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10368 00000100:00100000:0.0:1746147179.555177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.561016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.561045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.561456:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463483392 00000100:00100000:1.0:1746147179.561463:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463483392 00000100:00100000:1.0:1746147179.561501:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463483520 00000100:00100000:1.0:1746147179.561502:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463483520 00000100:00100000:1.0:1746147179.561518:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11136 00000100:00100000:1.0:1746147179.561526:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463483392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147179.561542:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.561560:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac5168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a8b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147179.561610:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466312448:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147179.562242:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.563819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.564339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.566242:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4132 00000100:00100000:1.0:1746147179.566254:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463484032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147179.572276:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466312448:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147179.572315:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac5168 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a8b expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.572328:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac5168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a8b expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.572344:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0f200, rc 0) 00000100:00100000:1.0:1746147179.572395:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463483392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10868us (11388us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.572404:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11136 00000100:00100000:0.0:1746147179.575061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.575135:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463484160 00000100:00100000:1.0:1746147179.575142:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463484160 00000100:00100000:1.0:1746147179.575271:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11138 00000100:00100000:1.0:1746147179.575279:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28565:x1830967463484160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147179.575296:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.575312:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5a99 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.575338:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.575346:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.575347:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.575351:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a99 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.575378:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.575390:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 23 pid: 4444 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.575402:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466312704:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.575460:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.577496:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463484032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11242us (13156us total) trans 0 rc 1007616/1007616 00000100:00100000:1.0:1746147179.577504:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4132 00002000:00100000:1.0:1746147179.577510:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1089536->2097151) req@ffff88009ef7dc00 x1830967463484032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.577517:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7dc00 with x1830967463484032 ext(1089536->2097151) 00002000:00010000:1.0:1746147179.577522:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7dc00 00000100:00100000:0.0:1746147179.578604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.579261:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466312704:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.579294:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a99 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.579307:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e531a00, rc 0) 00000100:00100000:1.0:1746147179.579339:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28565:x1830967463484160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4061us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.579345:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11138 00000100:00100000:0.0:1746147179.582979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.583066:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463484544 00000100:00100000:1.0:1746147179.583074:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463484544 00000100:00100000:0.0:1746147179.583929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147179.584065:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x416:0x0] (774144->1048575) req@ffff88009ef7ea00 x1830967463484544/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.584076:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ea00 with x1830967463484544 ext(774144->1048575) 00010000:00010000:1.0:1746147179.584085:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 22 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.584098:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 22 pid: 4444 timeout: 666 lvb_type: 0 00002000:00010000:1.0:1746147179.584111:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7ea00 00000100:00100000:1.0:1746147179.584143:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1432 00000100:00100000:1.0:1746147179.584152:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463484544:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147179.584400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.592872:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463485312 00000100:00100000:0.0:1746147179.592878:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463485312 00000100:00100000:0.0:1746147179.592919:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11139 00000100:00100000:0.0:1746147179.592925:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463485312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.592955:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.592969:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6a8e00/0xb4b2209fbdac51a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5aae expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147179.593006:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466312960:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147179.593076:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.599310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.599629:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463485440 00000100:00100000:1.0:1746147179.599638:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463485440 00010000:00010000:1.0:1746147179.599683:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 24 pid: 4444 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.599729:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5420 00000100:00100000:1.0:1746147179.599737:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463485440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.599750:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.599773:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 24 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.599785:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 24 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.599808:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a98400/0xb4b2209fbdac50f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a3e expref: 24 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.599825:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.599828:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.599836:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a99 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.599845:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a99 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.599879:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e531a00/0xb4b2209fbdac5176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a99 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147179.599892:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466313088:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147179.600017:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.600408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.600488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.602834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.602862:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466313088:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147179.602884:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.602919:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463485440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3181us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.602928:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5420 00000100:00100000:1.0:1746147179.602980:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463485824 00000100:00100000:1.0:1746147179.602986:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463485824 00010000:00010000:1.0:1746147179.603005:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b29b200/0xb4b2209fbdac51a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5abc expref: 26 pid: 8478 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.603025:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5421 00000100:00100000:1.0:1746147179.603032:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463485824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.603042:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.603064:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b29b200/0xb4b2209fbdac51a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5abc expref: 26 pid: 8478 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.603073:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b29b200/0xb4b2209fbdac51a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5abc expref: 26 pid: 8478 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.603094:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.603110:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463485824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.603115:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5421 00000100:00100000:0.0:1746147179.603765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.603806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.614976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.619459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.625573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.626672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.629387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.629404:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463486848 00000100:00100000:1.0:1746147179.629409:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463486848 00010000:00010000:1.0:1746147179.629441:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a99a00/0xb4b2209fbdac50f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a45 expref: 36 pid: 4444 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.629476:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5423 00000100:00100000:1.0:1746147179.629482:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463486848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.629493:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.629509:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a99a00/0xb4b2209fbdac50f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a45 expref: 36 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.629519:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a99a00/0xb4b2209fbdac50f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a45 expref: 36 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.629537:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a99a00/0xb4b2209fbdac50f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a45 expref: 36 pid: 4444 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.629560:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.629562:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.629567:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7600/0xb4b2209fbdac51bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aca expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.629574:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7600/0xb4b2209fbdac51bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aca expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.629595:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7600/0xb4b2209fbdac51bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aca expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.629605:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7600/0xb4b2209fbdac51bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aca expref: 18 pid: 21080 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.629618:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466313856:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147179.629685:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.630858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.631511:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466313856:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147179.631527:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.631546:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463486848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2064us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.631553:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5423 00000100:00100000:0.0:1746147179.631820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.635976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.636071:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463487616 00000100:00100000:1.0:1746147179.636079:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463487616 00002000:00100000:1.0:1746147179.636121:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (663552->667647) req@ffff88009e587480 x1830967463487616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.636130:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587480 with x1830967463487616 ext(663552->667647) 00002000:00010000:1.0:1746147179.636136:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587480 00000100:00100000:1.0:1746147179.636166:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4134 00000100:00100000:1.0:1746147179.636173:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463487616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147179.636360:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463487616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 187us (431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147179.636366:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4134 00002000:00100000:1.0:1746147179.636372:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (663552->667647) req@ffff88009e587480 x1830967463487616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/4536 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.636378:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587480 with x1830967463487616 ext(663552->667647) 00002000:00010000:1.0:1746147179.636381:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587480 00000100:00100000:0.0:1746147179.638925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.646585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.646614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.646637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.646824:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463488128 00000100:00100000:1.0:1746147179.646831:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463488128 00010000:00010000:1.0:1746147179.646858:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5950 expref: 13 pid: 6881 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.646878:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463488256 00000100:00100000:1.0:1746147179.646880:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463488256 00010000:00010000:1.0:1746147179.646888:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5885 expref: 35 pid: 8481 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.646900:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463488384 00000100:00100000:1.0:1746147179.646902:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463488384 00010000:00010000:1.0:1746147179.646910:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58b6 expref: 23 pid: 17548 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.646922:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5424 00000100:00100000:1.0:1746147179.646928:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463488128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.646961:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.646980:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5950 expref: 13 pid: 6881 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.646990:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9800/0xb4b2209fbdac4f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5950 expref: 13 pid: 6881 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.647015:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.647039:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463488128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.647045:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5424 00000100:00100000:1.0:1746147179.647059:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5425 00000100:00100000:1.0:1746147179.647064:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463488256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.647070:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.647076:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5885 expref: 35 pid: 8481 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.647084:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac4e19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5885 expref: 35 pid: 8481 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.647095:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.647107:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463488256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.647112:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5425 00000100:00100000:1.0:1746147179.647121:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5426 00000100:00100000:1.0:1746147179.647125:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463488384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147179.647130:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147179.647136:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58b6 expref: 23 pid: 17548 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.647144:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e59400/0xb4b2209fbdac4e5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58b6 expref: 23 pid: 17548 timeout: 666 lvb_type: 1 00010000:00010000:1.0:1746147179.647154:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.647156:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147179.647162:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b29bc00/0xb4b2209fbdac51ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad8 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.647176:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b29bc00/0xb4b2209fbdac51ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad8 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.647206:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b29bc00/0xb4b2209fbdac51ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad8 expref: 23 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147179.647217:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466314368:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147179.647268:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.651446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.651978:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466314368:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147179.652005:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147179.652036:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463488384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4908us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.652043:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5426 00000100:00100000:0.0:1746147179.658068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.658109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.658638:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4136 00000100:00100000:0.0:1746147179.658645:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463489024:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147179.662179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.662249:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463489280 00000100:00100000:1.0:1746147179.662260:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463489280 00000100:00100000:1.0:1746147179.662320:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4077 00000100:00100000:1.0:1746147179.662328:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28556:x1830967463489280:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147179.662560:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28556:x1830967463489280:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 232us (388us total) trans 8589944093 rc 0/0 00000100:00100000:1.0:1746147179.662567:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4077 00000100:00100000:1.0:1746147179.673825:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463489024:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15168us (15702us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147179.673838:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4136 00002000:00100000:1.0:1746147179.673861:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a5ba1880 x1830967463489024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.673872:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1880 with x1830967463489024 ext(1048576->2097151) 00002000:00010000:1.0:1746147179.673878:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1880 00000100:00100000:1.0:1746147179.680286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.706039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.712231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.716888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.720538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.722097:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463490304 00000100:00100000:0.0:1746147179.722102:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463490304 00010000:00010000:0.0:1746147179.722130:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ae00/0xb4b2209fbdac5192 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aa7 expref: 317 pid: 14048 timeout: 666 lvb_type: 0 00000100:00100000:0.0:1746147179.722151:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5428 00000100:00100000:0.0:1746147179.722157:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967463490304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147179.722170:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147179.722175:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ae00/0xb4b2209fbdac5192 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aa7 expref: 317 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.722185:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ae00/0xb4b2209fbdac5192 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aa7 expref: 317 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.722203:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ae00/0xb4b2209fbdac5192 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5aa7 expref: 317 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.722232:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.722236:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.722246:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.722252:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.722285:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147179.722407:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967463490304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 249us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.722414:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5428 00000100:00100000:1.0:1746147179.731223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.731287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.731310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.731349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.731365:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463490560 00000100:00100000:1.0:1746147179.731368:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463490560 00000100:00100000:1.0:1746147179.731386:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463490688 00000100:00100000:1.0:1746147179.731388:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463490688 00000100:00100000:1.0:1746147179.731615:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11149 00000100:00100000:1.0:1746147179.731622:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463490560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147179.731630:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.731639:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efdc800/0xb4b2209fbdac5202 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5afb expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147179.731671:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466315136:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147179.731739:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.732249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.732266:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463490944 00000100:00100000:0.0:1746147179.732269:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463490944 00000100:00100000:0.0:1746147179.732290:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11152 00000100:00100000:0.0:1746147179.732294:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463490944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.732300:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.732306:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b10 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.732317:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.732318:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147179.732322:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 35 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.732330:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 35 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.732338:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a9200, rc 0) 00000100:00100000:0.0:1746147179.732352:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463490944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.732356:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11152 00000100:00100000:0.0:1746147179.732397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.732407:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463491072 00000100:00100000:0.0:1746147179.732409:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463491072 00000100:00100000:0.0:1746147179.732420:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11153 00000100:00100000:0.0:1746147179.732424:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463491072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147179.732429:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.732434:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8200/0xb4b2209fbdac521e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b17 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147179.732451:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466315392:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147179.732470:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.734628:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466315392:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147179.734647:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8200/0xb4b2209fbdac521e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b17 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.734666:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8200/0xb4b2209fbdac521e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b17 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.734676:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a8200, rc 0) 00000100:00100000:0.0:1746147179.734693:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463491072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2268us (2296us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147179.739839:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11153 00000100:00100000:0.0:1746147179.740361:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466315008:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147179.740394:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b29b400/0xb4b2209fbdac51fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5af4 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.740408:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b29b400/0xb4b2209fbdac51fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5af4 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.740417:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b29b400, rc 0) 00000100:00100000:0.0:1746147179.740471:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463490432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9062us (9258us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147179.740478:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11148 00000100:00100000:0.0:1746147179.746991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.749913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.757961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.763157:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463491968 00000100:00100000:0.0:1746147179.763164:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463491968 00010000:00010000:0.0:1746147179.763194:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ae6 expref: 13 pid: 14048 timeout: 666 lvb_type: 0 00000100:00100000:0.0:1746147179.763219:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5429 00000100:00100000:0.0:1746147179.763225:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463491968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147179.763237:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147179.763242:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ae6 expref: 13 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.763252:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ae6 expref: 13 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.763278:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29a800/0xb4b2209fbdac51ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ae6 expref: 13 pid: 14048 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.763293:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147179.763298:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ac00/0xb4b2209fbdac522c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.763307:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ac00/0xb4b2209fbdac522c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.763314:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b29ac00/0xb4b2209fbdac522c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.763336:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147179.763376:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463491968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 151us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.763383:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5429 00000100:00100000:0.0:1746147179.769855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.779621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.782220:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10374 00000100:00100000:1.0:1746147179.782231:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28579:x1830967463492352:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147179.782247:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.782258:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a99600/0xb4b2209fbdac524f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b2c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.782324:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147179.782335:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd7800/0xb4b2209fbdac5241 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b25 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.782340:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147179.782362:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd7800/0xb4b2209fbdac5241 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b25 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.782371:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd7800/0xb4b2209fbdac5241 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b25 expref: 12 pid: 14048 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.782380:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466315904:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.782715:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.786111:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463492736 00000100:00100000:1.0:1746147179.786118:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463492736 00000100:00100000:1.0:1746147179.786156:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11155 00000100:00100000:1.0:1746147179.786372:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463492736:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147179.786387:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.786402:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a99800/0xb4b2209fbdac525d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b3a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147179.787094:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466316032:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147179.787151:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.788274:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466315904:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.788292:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147179.788758:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147179.788763:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147179.788781:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147179.788932:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a99600/0xb4b2209fbdac524f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b2c expref: 319 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.788980:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b2c expref: 318 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.788985:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147179.788987:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147179.788989:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a98800, rc 0) 00000100:00100000:1.0:1746147179.789011:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28579:x1830967463492352:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6784us (9397us total) trans 8589944096 rc 0/0 00000100:00100000:1.0:1746147179.789017:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10374 00000100:00100000:1.0:1746147179.792661:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466316032:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147179.792680:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a99800/0xb4b2209fbdac525d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b3a expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.792689:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a99800/0xb4b2209fbdac525d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b3a expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.792701:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a99800, rc 0) 00000100:00100000:1.0:1746147179.792732:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463492736:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6362us (6874us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147179.792737:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11155 00000100:00100000:0.0:1746147179.799723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.800403:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463493248 00000100:00100000:1.0:1746147179.800412:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463493248 00000100:00100000:1.0:1746147179.800474:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10375 00000100:00100000:1.0:1746147179.800481:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:28573:x1830967463493248:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147179.800499:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.800516:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98a00/0xb4b2209fbdac5272 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b48 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.800572:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98a00/0xb4b2209fbdac5272 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b48 expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.800585:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98a00/0xb4b2209fbdac5272 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b48 expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.800602:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147179.800605:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147179.800609:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a98a00, rc 0) 00000100:00100000:1.0:1746147179.800660:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:28573:x1830967463493248:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 169us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.800665:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10375 00000100:00100000:0.0:1746147179.803052:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463493504 00000100:00100000:0.0:1746147179.803063:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463493504 00000100:00100000:0.0:1746147179.803112:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10376 00000100:00100000:0.0:1746147179.803120:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:28573:x1830967463493504:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147179.803135:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147179.803150:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f400/0xb4b2209fbdac5279 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b4f expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.803227:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac5280 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.803239:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b2c expref: 317 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.803245:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb0f200/0xb4b2209fbdac5280 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147179.803271:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b2c expref: 317 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147179.803280:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98800/0xb4b2209fbdac5256 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b2c expref: 317 pid: 16361 timeout: 666 lvb_type: 0 00000100:00100000:0.0:1746147179.803289:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466316288:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147179.806469:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147179.810448:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466316416:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147179.810466:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147179.810507:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463493632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4409us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147179.810514:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5432 00000100:00100000:0.0:1746147179.814190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.819224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.820726:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463494272 00000100:00100000:1.0:1746147179.820736:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463494272 00000100:00100000:1.0:1746147179.820788:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4079 00000100:00100000:1.0:1746147179.820795:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:28573:x1830967463494272:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147179.821054:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:28573:x1830967463494272:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 258us (1838us total) trans 8589944097 rc 0/0 00000100:00100000:1.0:1746147179.821061:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4079 00000100:00100000:1.0:1746147179.821088:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463494400 00000100:00100000:1.0:1746147179.821091:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463494400 00000100:00100000:1.0:1746147179.821111:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11157 00000100:00100000:1.0:1746147179.821115:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28579:x1830967463494400:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147179.821125:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147179.821143:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5b56 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821175:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac50a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a0d expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821183:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a68 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.821191:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a600/0xb4b2209fbdac50b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a1b expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821202:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5996 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821208:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.821210:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147179.821213:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3543040->3932159] (req 3543040->3932159) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 39 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821240:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5996 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821251:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe9ba00/0xb4b2209fbdac5003 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5996 expref: 20 pid: 17548 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.821263:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316544:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.821334:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a600/0xb4b2209fbdac50b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a1b expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821342:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a600/0xb4b2209fbdac50b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a1b expref: 20 pid: 4444 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.821350:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316672:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.821374:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a68 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147179.821382:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a8000/0xb4b2209fbdac5130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a68 expref: 12 pid: 11147 timeout: 666 lvb_type: 1 00000100:00100000:1.0:1746147179.821390:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316800:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.821412:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac50a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a0d expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.821420:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac50a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a0d expref: 39 pid: 4444 timeout: 666 lvb_type: 0 00000100:00100000:1.0:1746147179.821427:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.821441:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f040780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147179.825735:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316544:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.830291:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316672:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.830303:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316800:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147179.830309:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466316928:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147179.830341:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3543040->3932159] (req 3543040->3932159) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 39 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147179.830355:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a98200, rc 0) 00000100:00100000:1.0:1746147179.830394:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28579:x1830967463494400:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9277us (10469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147179.830402:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11157 00000100:00100000:0.0:1746147179.831598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.831614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.831656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.835464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.840571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.845119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.845311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.845534:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463495424 00000100:00100000:1.0:1746147179.845543:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463495424 00002000:00100000:1.0:1746147179.845577:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4670a80 x1830967463495424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.845585:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670a80 with x1830967463495424 ext(2097152->3145727) 00002000:00010000:1.0:1746147179.845589:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4670a80 00000100:00100000:1.0:1746147179.845603:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463495680 00000100:00100000:1.0:1746147179.845604:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463495680 00002000:00100000:1.0:1746147179.845611:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4671880 x1830967463495680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 504/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.845616:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967463495680 ext(3145728->4194303) 00002000:00010000:1.0:1746147179.845618:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:1.0:1746147179.845632:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4142 00000100:00100000:1.0:1746147179.845637:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463495424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147179.845979:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4143 00000100:00100000:0.0:1746147179.845986:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463495680:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147179.862800:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463495424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17154us (17680us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147179.862810:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4142 00002000:00100000:1.0:1746147179.862820:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4670a80 x1830967463495424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/440 e 0 to 0 dl 1746147190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.862828:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670a80 with x1830967463495424 ext(2097152->3145727) 00002000:00010000:1.0:1746147179.862833:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4670a80 00000100:00100000:0.0:1746147179.866084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.866198:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463495936 00000100:00100000:1.0:1746147179.866208:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463495936 00000100:00100000:1.0:1746147179.867214:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4080 00000100:00100000:1.0:1746147179.867225:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28579:x1830967463495936:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147179.867427:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28579:x1830967463495936:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 205us (1348us total) trans 8589944098 rc 0/0 00000100:00100000:1.0:1746147179.867433:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4080 00000100:00100000:0.0:1746147179.890036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.901996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.902080:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463496320 00000100:00100000:1.0:1746147179.902090:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463496320 00000100:00100000:0.0:1746147179.909372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.909451:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463496448 00000100:00100000:1.0:1746147179.909461:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463496448 00002000:00100000:1.0:1746147179.909502:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3543040->3932159) req@ffff8800a4670000 x1830967463496448/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1746147190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147179.909511:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967463496448 ext(3543040->3932159) 00010000:00010000:1.0:1746147179.909519:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 36 pid: 11147 timeout: 666 lvb_type: 0 00010000:00010000:1.0:1746147179.909531:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 36 pid: 11147 timeout: 666 lvb_type: 0 00002000:00010000:1.0:1746147179.909538:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4670000 00000100:00100000:1.0:1746147179.909570:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1438 00000100:00100000:1.0:1746147179.909577:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463496448:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147179.918987:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463496448:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9401us (9614us total) trans 17179873142 rc 0/0 00000100:00100000:0.0:1746147179.918998:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1438 00002000:00100000:0.0:1746147179.919010:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3543040->3932159) req@ffff8800a4670000 x1830967463496448/t17179873142(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:555/0 lens 488/448 e 0 to 0 dl 1746147190 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147179.919019:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670000 with x1830967463496448 ext(3543040->3932159) 00010000:00010000:0.0:1746147179.919027:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 38 pid: 11147 timeout: 666 lvb_type: 0 00010000:00010000:0.0:1746147179.919040:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a98200/0xb4b2209fbdac5287 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b56 expref: 38 pid: 11147 timeout: 666 lvb_type: 0 00002000:00010000:0.0:1746147179.919047:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4670000 00000100:00100000:0.0:1746147179.926007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.932015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.936867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.961859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147179.962231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.965423:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466317440:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147179.965453:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbd7600/0xb4b2209fbdac52aa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b6b expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.965462:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbd7600/0xb4b2209fbdac52aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b6b expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147179.965485:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbd7600, rc 0) 00000100:00100000:0.0:1746147179.965518:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463497216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3002us (3666us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147179.965524:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11159 00000100:00100000:0.0:1746147179.969324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.979656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147179.987552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.001370:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4147 00000100:00100000:0.0:1746147180.001377:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463498240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.009914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.010893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.016669:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463498240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15265us (16138us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147180.016680:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4147 00002000:00100000:0.0:1746147180.016692:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f369500 x1830967463498240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.016700:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369500 with x1830967463498240 ext(1048576->2097151) 00002000:00010000:0.0:1746147180.016706:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f369500 00000100:00100000:0.0:1746147180.033632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.043288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.044058:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:1.0:1746147180.044070:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1956:x1830967463498880:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1746147180.044110:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1956:x1830967463498880:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 45us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.044116:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:0.0:1746147180.049511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.049555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.049640:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463499264 00000100:00100000:1.0:1746147180.049658:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463499264 00002000:00100000:1.0:1746147180.049700:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3411968->4194303) req@ffff88009f452d80 x1830967463499264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.049710:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452d80 with x1830967463499264 ext(3411968->4194303) 00002000:00010000:1.0:1746147180.049715:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f452d80 00000100:00100000:1.0:1746147180.049729:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463499136 00000100:00100000:1.0:1746147180.049731:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463499136 00002000:00100000:1.0:1746147180.049739:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3411967) req@ffff88009f450e00 x1830967463499136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 504/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.049745:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450e00 with x1830967463499136 ext(2097152->3411967) 00002000:00010000:1.0:1746147180.049747:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450e00 00000100:00100000:1.0:1746147180.049755:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4149 00000100:00100000:1.0:1746147180.049760:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463499264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147180.051335:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4150 00000100:00100000:1.0:1746147180.051345:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463499136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147180.067968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.069737:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463499136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18388us (20174us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.069748:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4150 00000100:00100000:0.0:1746147180.069751:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463499264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19983us (20242us total) trans 0 rc 782336/782336 00002000:00100000:1.0:1746147180.069760:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3411967) req@ffff88009f450e00 x1830967463499136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 504/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147180.069763:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4149 00002000:00100000:1.0:1746147180.069769:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450e00 with x1830967463499136 ext(2097152->3411967) 00002000:00100000:0.0:1746147180.069773:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3411968->4194303) req@ffff88009f452d80 x1830967463499264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147180.069776:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 22 pid: 21080 timeout: 667 lvb_type: 0 00002000:00100000:0.0:1746147180.069782:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452d80 with x1830967463499264 ext(3411968->4194303) 00010000:00010000:1.0:1746147180.069789:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 22 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.069791:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 22 pid: 21080 timeout: 667 lvb_type: 0 00002000:00010000:1.0:1746147180.069796:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f450e00 00010000:00010000:0.0:1746147180.069803:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 22 pid: 21080 timeout: 667 lvb_type: 0 00002000:00010000:0.0:1746147180.069810:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f452d80 00000100:00100000:0.0:1746147180.072270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.072587:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463499648 00000100:00100000:1.0:1746147180.072595:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463499648 00002000:00100000:1.0:1746147180.072633:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2646016->2912255) req@ffff88009f452a00 x1830967463499648/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.072642:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452a00 with x1830967463499648 ext(2646016->2912255) 00010000:00010000:1.0:1746147180.072660:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 21 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.072673:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 21 pid: 21080 timeout: 667 lvb_type: 0 00002000:00010000:1.0:1746147180.072680:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f452a00 00000100:00100000:1.0:1746147180.072699:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1440 00000100:00100000:1.0:1746147180.072706:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463499648:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147180.077891:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463499648:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5179us (5622us total) trans 17179873143 rc 0/0 00000100:00100000:1.0:1746147180.077900:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1440 00002000:00100000:1.0:1746147180.077909:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2646016->2912255) req@ffff88009f452a00 x1830967463499648/t17179873143(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/448 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.077917:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452a00 with x1830967463499648 ext(2646016->2912255) 00010000:00010000:1.0:1746147180.077925:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.077950:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6000/0xb4b2209fbdac52a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b64 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00002000:00010000:1.0:1746147180.077955:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f452a00 00000100:00100000:0.0:1746147180.085118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.095715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.095796:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463500160 00000100:00100000:1.0:1746147180.095804:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463500160 00002000:00100000:1.0:1746147180.095838:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f451c00 x1830967463500160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.095847:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451c00 with x1830967463500160 ext(3145728->4194303) 00002000:00010000:1.0:1746147180.095851:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451c00 00000100:00100000:1.0:1746147180.095882:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4151 00000100:00100000:1.0:1746147180.095889:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463500160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.101461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.102438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.102730:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463500672 00000100:00100000:1.0:1746147180.102734:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463500672 00002000:00100000:1.0:1746147180.102769:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f451180 x1830967463500672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.102779:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451180 with x1830967463500672 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.102784:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451180 00000100:00100000:0.0:1746147180.103573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.105331:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463500928 00000100:00100000:1.0:1746147180.105342:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463500928 00002000:00100000:1.0:1746147180.105372:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f452300 x1830967463500928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.105380:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452300 with x1830967463500928 ext(3145728->4194303) 00002000:00010000:1.0:1746147180.105383:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f452300 00000100:00100000:1.0:1746147180.105402:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4153 00000100:00100000:1.0:1746147180.105408:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463500928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147180.124544:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463500928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19135us (22077us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.124550:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4153 00002000:00100000:1.0:1746147180.124556:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f452300 x1830967463500928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.124562:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452300 with x1830967463500928 ext(3145728->4194303) 00002000:00010000:1.0:1746147180.124565:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f452300 00000100:00100000:0.0:1746147180.135433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.135527:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501056 00000100:00100000:1.0:1746147180.135538:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501056 00000100:00100000:1.0:1746147180.135637:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11166 00000100:00100000:1.0:1746147180.135657:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28594:x1830967463501056:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147180.135674:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.135689:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ba3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135713:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135721:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a99200/0xb4b2209fbdac5129 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a61 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.135727:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135734:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135739:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147180.135740:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147180.135744:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135769:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.135780:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 23 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.135790:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318336:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.137138:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.137147:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.137154:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318464:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.137203:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a99200/0xb4b2209fbdac5129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a61 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.137211:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a99200/0xb4b2209fbdac5129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a61 expref: 14 pid: 8481 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.137217:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.137245:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.137302:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.137309:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318720:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.137330:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.140246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.140290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.140311:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501184 00000100:00100000:0.0:1746147180.140317:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501184 00010000:00010000:0.0:1746147180.140351:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 24 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.140373:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501312 00000100:00100000:0.0:1746147180.140375:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501312 00000100:00100000:1.0:1746147180.140378:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318336:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147180.140384:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a99200/0xb4b2209fbdac5129 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a61 expref: 15 pid: 8481 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.140387:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318464:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.140394:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318592:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.140399:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5441 00000100:00100000:1.0:1746147180.140400:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466318720:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.140405:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463501184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147180.140415:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.140428:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 27 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.140431:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 24 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.140440:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a470a600, rc 0) 00010000:00010000:0.0:1746147180.140447:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 24 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.140465:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a99400/0xb4b2209fbdac5018 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [3764224->18446744073709551615] (req 4206592->4870143) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59ab expref: 24 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.140473:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28594:x1830967463501056:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4829us (5048us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.140479:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11166 00010000:00010000:0.0:1746147180.140487:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147180.140544:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463501184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.140549:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5441 00000100:00100000:0.0:1746147180.140631:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501568 00000100:00100000:0.0:1746147180.140634:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501568 00010000:00010000:0.0:1746147180.140644:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac50b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a22 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.140665:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501440 00000100:00100000:0.0:1746147180.140667:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501440 00010000:00010000:0.0:1746147180.140675:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.140698:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5444 00000100:00100000:0.0:1746147180.140702:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463501440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147180.140707:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147180.140713:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.140720:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.140730:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b400/0xb4b2209fbdac50c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a29 expref: 23 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.140737:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.140739:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.140744:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.140751:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.140780:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 25 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.140788:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466318848:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147180.140837:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.143632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.143692:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501824 00000100:00100000:1.0:1746147180.143698:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501824 00002000:00100000:1.0:1746147180.143765:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3952640->3956735) req@ffff88009ee5f100 x1830967463501824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.143773:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967463501824 ext(3952640->3956735) 00002000:00010000:1.0:1746147180.143776:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:1.0:1746147180.143798:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4154 00000100:00100000:1.0:1746147180.143805:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463501824:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147180.144204:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463501824:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 398us (571us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147180.144210:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4154 00002000:00100000:0.0:1746147180.144216:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3952640->3956735) req@ffff88009ee5f100 x1830967463501824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.144223:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f100 with x1830967463501824 ext(3952640->3956735) 00002000:00010000:0.0:1746147180.144226:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5f100 00000100:00100000:0.0:1746147180.147435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.147517:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463501952 00000100:00100000:1.0:1746147180.147525:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463501952 00000100:00100000:1.0:1746147180.147574:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11167 00000100:00100000:1.0:1746147180.147581:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28594:x1830967463501952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147180.147595:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.147609:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5baa expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.147632:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4600/0xb4b2209fbdac52cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b8e expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.147640:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a809200/0xb4b2209fbdac52d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b95 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.147656:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.147658:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.147661:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3371007] (req 3145728->3371007) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 39 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.147690:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a809200/0xb4b2209fbdac52d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b95 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.147701:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a809200/0xb4b2209fbdac52d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b95 expref: 22 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.147717:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466318976:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.148227:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4600/0xb4b2209fbdac52cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b8e expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.148236:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4600/0xb4b2209fbdac52cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b8e expref: 39 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.148244:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466319104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.148631:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147180.149524:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466318976:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.151002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.151805:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466319104:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.151828:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->3371007] (req 3145728->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 39 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.151837:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a470b200, rc 0) 00000100:00100000:1.0:1746147180.151857:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28594:x1830967463501952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4277us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.151862:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11167 00000100:00100000:0.0:1746147180.156127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.158684:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466319232:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147180.158700:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147180.158730:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463502208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2458us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.158739:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5446 00000100:00100000:0.0:1746147180.160095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.242179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.242260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.242295:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463502592 00000100:00100000:1.0:1746147180.242304:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463502592 00000100:00100000:0.0:1746147180.243851:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11169 00000100:00100000:0.0:1746147180.244383:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466319360:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147180.244404:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac52fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bb8 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.244414:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac52fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bb8 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.244425:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a809a00, rc 0) 00000100:00100000:0.0:1746147180.244457:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463502720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2101us (2197us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147180.244463:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11168 00000100:00100000:0.0:1746147180.256689:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463503104 00000100:00100000:0.0:1746147180.256695:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463503104 00000100:00100000:0.0:1746147180.256722:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11172 00000100:00100000:0.0:1746147180.256727:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463503104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147180.256734:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.256740:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac531a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5bcd expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.256760:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466319872:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147180.256785:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147180.261571:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466319872:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147180.261591:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac531a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bcd expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.261605:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac531a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bcd expref: 27 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.261615:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3200, rc 0) 00000100:00100000:1.0:1746147180.261632:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463503104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4904us (5108us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147180.261637:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11172 00000100:00100000:0.0:1746147180.264327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.264423:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463503232 00000100:00100000:1.0:1746147180.264432:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463503232 00000100:00100000:1.0:1746147180.264490:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11173 00000100:00100000:1.0:1746147180.264498:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28602:x1830967463503232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.264513:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.264529:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5bd4 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.264551:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 37 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.264558:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147180.264560:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147180.264563:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.264587:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 37 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.264603:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 37 pid: 11147 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.264613:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466320000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.264696:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.272071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.272131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.272152:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463503488 00000100:00100000:0.0:1746147180.272159:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463503488 00002000:00100000:0.0:1746147180.272192:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3371007) req@ffff88009ee5e680 x1830967463503488/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.272200:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967463503488 ext(3145728->3371007) 00010000:00010000:0.0:1746147180.272206:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 38 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.272217:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 38 pid: 11147 timeout: 667 lvb_type: 0 00002000:00010000:0.0:1746147180.272223:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee5e680 00000100:00100000:1.0:1746147180.272316:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466320000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.272338:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 23 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.272350:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a470ae00, rc 0) 00000100:00100000:1.0:1746147180.272385:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28602:x1830967463503232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7888us (8066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.272391:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11173 00000100:00100000:0.0:1746147180.272604:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1441 00000100:00100000:0.0:1746147180.272610:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463503488:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147180.275214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.278624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.281126:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463503488:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8512us (8988us total) trans 17179873144 rc 0/0 00000100:00100000:1.0:1746147180.281136:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1441 00002000:00100000:1.0:1746147180.281144:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3371007) req@ffff88009ee5e680 x1830967463503488/t17179873144(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/448 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.281152:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967463503488 ext(3145728->3371007) 00010000:00010000:1.0:1746147180.281160:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 41 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.281175:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a470b200/0xb4b2209fbdac52f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5baa expref: 41 pid: 11147 timeout: 667 lvb_type: 0 00002000:00010000:1.0:1746147180.281181:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee5e680 00000100:00100000:0.0:1746147180.287405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.288198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.288318:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463504000 00000100:00100000:0.0:1746147180.288322:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463504000 00010000:00010000:0.0:1746147180.288337:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 28 pid: 11147 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.288363:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5448 00000100:00100000:0.0:1746147180.288369:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463504000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147180.288378:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147180.288394:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 28 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.288406:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 28 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.288418:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac52f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3952640->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ba3 expref: 28 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.288432:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.288433:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.288437:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a808a00/0xb4b2209fbdac5328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bdb expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.288443:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a808a00/0xb4b2209fbdac5328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bdb expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.288462:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a808a00/0xb4b2209fbdac5328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bdb expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.288469:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466320512:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147180.288493:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.293014:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466320512:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147180.293028:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147180.293332:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463504000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4962us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.293338:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5448 00000100:00100000:0.0:1746147180.293754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.293772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.293792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.294269:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463504768 00000100:00100000:1.0:1746147180.294275:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463504768 00002000:00100000:1.0:1746147180.294306:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4050944->4055039) req@ffff88012e2b8380 x1830967463504768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.294314:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8380 with x1830967463504768 ext(4050944->4055039) 00002000:00010000:1.0:1746147180.294319:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8380 00000100:00100000:1.0:1746147180.294330:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463504384 00000100:00100000:1.0:1746147180.294332:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463504384 00002000:00100000:1.0:1746147180.294340:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012e2bb100 x1830967463504384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.294346:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb100 with x1830967463504384 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.294348:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb100 00000100:00100000:1.0:1746147180.294358:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4157 00000100:00100000:1.0:1746147180.294361:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463504512:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147180.303071:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463504512:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8698us (9307us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.303082:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4157 00002000:00100000:1.0:1746147180.303094:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012e2b8000 x1830967463504512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.303109:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8000 with x1830967463504512 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.303114:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8000 00000100:00100000:0.0:1746147180.309343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.309800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.314850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.318494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.322120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.322160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.322384:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463505280 00000100:00100000:1.0:1746147180.322391:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463505280 00010000:00010000:1.0:1746147180.322419:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a808800/0xb4b2209fbdac532f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be2 expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.322450:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463505536 00000100:00100000:1.0:1746147180.322452:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463505536 00010000:00010000:1.0:1746147180.322463:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 24 pid: 11147 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.322477:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5449 00000100:00100000:1.0:1746147180.322483:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463505280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.322495:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.322510:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a808800/0xb4b2209fbdac532f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be2 expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322520:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a808800/0xb4b2209fbdac532f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be2 expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322537:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a808800/0xb4b2209fbdac532f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be2 expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322553:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.322584:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463505280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.322590:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5449 00000100:00100000:1.0:1746147180.322606:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5450 00000100:00100000:1.0:1746147180.322610:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463505536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.322616:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.322623:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 24 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322630:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 24 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322640:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a470ae00/0xb4b2209fbdac5321 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bd4 expref: 24 pid: 11147 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.322663:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.322665:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.322670:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4a00/0xb4b2209fbdac533d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf0 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.322678:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4a00/0xb4b2209fbdac533d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf0 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.322702:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4a00/0xb4b2209fbdac533d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf0 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.323332:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466321024:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147180.323382:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.326879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.326987:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466321024:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147180.327005:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.327041:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463505536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4428us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.327051:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5450 00000100:00100000:1.0:1746147180.327086:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463505664 00000100:00100000:1.0:1746147180.327091:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463505664 00010000:00010000:1.0:1746147180.327113:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a808a00/0xb4b2209fbdac5328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4050944->18446744073709551615] (req 4050944->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bdb expref: 26 pid: 8481 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.333344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.333376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.336607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.336627:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463506432 00000100:00100000:0.0:1746147180.336634:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463506432 00002000:00100000:0.0:1746147180.336673:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3887104->3891199) req@ffff88012e2bb800 x1830967463506432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.336682:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967463506432 ext(3887104->3891199) 00002000:00010000:0.0:1746147180.336686:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:0.0:1746147180.336709:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4161 00000100:00100000:0.0:1746147180.336716:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463506432:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147180.336822:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463506432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 106us (219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147180.336828:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4161 00002000:00100000:0.0:1746147180.336833:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3887104->3891199) req@ffff88012e2bb800 x1830967463506432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.336839:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967463506432 ext(3887104->3891199) 00002000:00010000:0.0:1746147180.336842:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:0.0:1746147180.352387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.355888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.358886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.365402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.368204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.385002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.385049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147180.389990:0:17530:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009f36a680 x1830967466321664) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4a00/0xb4b2209fbdac533d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf0 expref: 27 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.390023:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd4a00/0xb4b2209fbdac533d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf0 expref: 27 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.390039:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466321664:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147180.390065:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac5359 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c0c expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.390077:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac5359 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c0c expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.390085:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17000, rc 0) 00000100:00100000:3.0:1746147180.390124:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463507584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4952us (5129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147180.390132:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11181 00000100:00100000:0.0:1746147180.392221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.392473:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463507712 00000100:00100000:3.0:1746147180.392482:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463507712 00000100:00100000:3.0:1746147180.392517:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11182 00000100:00100000:3.0:1746147180.392525:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463507712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.392540:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.392554:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c13 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.392575:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.392577:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.392584:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 25 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.392595:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 25 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.392604:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17400, rc 0) 00000100:00100000:3.0:1746147180.392662:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463507712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 136us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.392667:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11182 00000100:00100000:3.0:1746147180.393917:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463507968 00000100:00100000:3.0:1746147180.393922:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463507968 00002000:00100000:3.0:1746147180.393957:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880132e12d80 x1830967463507968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.393965:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463507968 ext(3145728->4194303) 00002000:00010000:3.0:1746147180.393969:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:3.0:1746147180.394014:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4164 00000100:00100000:3.0:1746147180.394019:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463507968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.399773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.406047:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967463507968:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12020us (12258us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147180.406058:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4164 00002000:00100000:3.0:1746147180.406069:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880132e12d80 x1830967463507968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.406077:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463507968 ext(3145728->4194303) 00002000:00010000:3.0:1746147180.406083:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:0.0:1746147180.407728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.407764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.407955:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5454 00000100:00100000:3.0:1746147180.407964:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463508352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.407973:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.407995:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b29aa00/0xb4b2209fbdac5248 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b33 expref: 41 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.408006:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b29aa00/0xb4b2209fbdac5248 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b33 expref: 41 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.408018:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b29aa00/0xb4b2209fbdac5248 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b33 expref: 41 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.408048:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.408073:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463508352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.408079:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5454 00000100:00100000:0.0:1746147180.411228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.411341:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463508608 00000100:00100000:3.0:1746147180.411351:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463508608 00002000:00100000:3.0:1746147180.411390:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880134d01880 x1830967463508608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.411399:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01880 with x1830967463508608 ext(4194304->4870143) 00002000:00010000:3.0:1746147180.411405:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01880 00000100:00100000:3.0:1746147180.411437:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4165 00000100:00100000:3.0:1746147180.411449:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463508608:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147180.417044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.419678:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463508608:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8233us (8455us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147180.419685:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4165 00002000:00100000:3.0:1746147180.419691:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880134d01880 x1830967463508608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 675840/675840 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.419698:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01880 with x1830967463508608 ext(4194304->4870143) 00002000:00010000:3.0:1746147180.419701:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01880 00000100:00100000:1.0:1746147180.426067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.426495:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463509120 00000100:00100000:3.0:1746147180.426504:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463509120 00002000:00100000:3.0:1746147180.426540:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (2068480->2072575) req@ffff88009f7cc700 x1830967463509120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.426549:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc700 with x1830967463509120 ext(2068480->2072575) 00002000:00010000:3.0:1746147180.426553:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cc700 00000100:00100000:3.0:1746147180.426579:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4167 00000100:00100000:3.0:1746147180.426585:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463509120:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147180.426730:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463509120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 145us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147180.426736:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4167 00002000:00100000:3.0:1746147180.426741:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (2068480->2072575) req@ffff88009f7cc700 x1830967463509120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.426747:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc700 with x1830967463509120 ext(2068480->2072575) 00002000:00010000:3.0:1746147180.426750:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cc700 00000100:00100000:0.0:1746147180.450032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.455276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.455870:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463509504 00000100:00100000:1.0:1746147180.455876:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463509504 00000100:00100000:1.0:1746147180.455928:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4081 00000100:00100000:1.0:1746147180.455967:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:7641:x1830967463509504:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147180.456262:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+321:7641:x1830967463509504:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 326us (997us total) trans 8589944101 rc 0/0 00000100:00100000:1.0:1746147180.456269:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4081 00000100:00100000:1.0:1746147180.458516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:3.0:1746147180.459078:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147180.459493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.459709:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463509888 00000100:00100000:3.0:1746147180.459714:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463509888 00010000:00010000:3.0:1746147180.459737:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd5a00/0xb4b2209fbdac52e2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b9c expref: 321 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.459772:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5455 00000100:00100000:3.0:1746147180.459779:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1957:x1830967463509888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.459788:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.459793:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd5a00/0xb4b2209fbdac52e2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b9c expref: 321 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.459803:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd5a00/0xb4b2209fbdac52e2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b9c expref: 321 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.459824:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbd5a00/0xb4b2209fbdac52e2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b9c expref: 321 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.459850:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.459854:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.459862:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.459866:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.459871:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.460040:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1957:x1830967463509888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 261us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.460046:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5455 00000100:00100000:0.0:1746147180.461120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.461184:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463510016 00000100:00100000:3.0:1746147180.461188:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463510016 00010000:00010000:3.0:1746147180.461204:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ddfa00/0xb4b2209fbdac5295 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b5d expref: 24 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.461593:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5456 00000100:00100000:3.0:1746147180.461600:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463510016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.461612:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.461617:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ddfa00/0xb4b2209fbdac5295 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b5d expref: 24 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.461626:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ddfa00/0xb4b2209fbdac5295 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b5d expref: 24 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.461643:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ddfa00/0xb4b2209fbdac5295 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b5d expref: 24 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.461664:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.461668:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.461676:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.461682:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.461708:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.461742:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463510016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.461747:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5456 00000100:00100000:3.0:1746147180.469040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.469073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.469095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.469162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.469182:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463510528 00000100:00100000:1.0:1746147180.469187:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463510528 00000100:00100000:3.0:1746147180.469188:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11184 00000100:00100000:1.0:1746147180.469234:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11186 00000100:00100000:1.0:1746147180.469240:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463510400:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147180.469242:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11187 00010000:00010000:1.0:1746147180.469247:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147180.469249:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463510528:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147180.469256:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.469262:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c36 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.469263:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3600/0xb4b2209fbdac5391 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c3d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.469282:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.469282:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.469283:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.469284:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.469292:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3600/0xb4b2209fbdac5391 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c3d expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.469293:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.469305:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3600/0xb4b2209fbdac5391 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c3d expref: 15 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.469306:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.469315:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e812400, rc 0) 00010000:00010000:0.0:1746147180.469315:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3600, rc 0) 00000100:00100000:3.0:1746147180.469355:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463510144:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147180.469360:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463510400:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 121us (264us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147180.469361:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147180.469366:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11186 00010000:00010000:3.0:1746147180.469368:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c28 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.469376:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.469377:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.469382:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c28 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.469390:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c28 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.469396:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17200, rc 0) 00000100:00100000:3.0:1746147180.469408:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463510144:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 215us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.469428:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463510528:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 178us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.469461:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11184 00000100:00100000:0.0:1746147180.469494:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11187 00000100:00100000:0.0:1746147180.473277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.476075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.476119:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463510912 00000100:00100000:1.0:1746147180.476126:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463510912 00010000:00010000:1.0:1746147180.476156:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c21 expref: 16 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.476192:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5457 00000100:00100000:1.0:1746147180.476199:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463510912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.476209:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.476214:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c21 expref: 16 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.476225:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c21 expref: 16 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.476247:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9bc00/0xb4b2209fbdac5383 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c21 expref: 16 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.476274:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.476278:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.476288:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.476294:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.476310:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.476351:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463510912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.476357:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5457 00010000:00010000:3.0:1746147180.476529:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.476535:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147180.476553:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147180.476787:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074a00/0xb4b2209fbdac53a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c44 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.476800:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c44 expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.476805:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.476808:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147180.476810:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074c00, rc 0) 00000100:00100000:3.0:1746147180.476846:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28612:x1830967463510784:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3243us (3578us total) trans 8589944103 rc 0/0 00000100:00100000:3.0:1746147180.476852:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10380 00000100:00100000:0.0:1746147180.478686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.478738:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511168 00000100:00100000:3.0:1746147180.478744:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511168 00000100:00100000:3.0:1746147180.478780:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10381 00000100:00100000:3.0:1746147180.478788:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28612:x1830967463511168:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147180.478808:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.478811:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147180.478830:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac53ad lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c44 expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.478843:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.478846:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147180.478856:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac53bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c4b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.478962:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.478976:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.478984:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147180.478994:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147180.479089:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac53bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 17 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.479100:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.479106:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.479109:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147180.479110:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17a00, rc 0) 00000100:00100000:3.0:1746147180.479156:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28612:x1830967463511168:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 368us (475us total) trans 8589944104 rc 0/0 00000100:00100000:3.0:1746147180.479399:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10381 00000100:00100000:0.0:1746147180.481794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.481868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.481897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.481919:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511552 00000100:00100000:0.0:1746147180.481919:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511808 00000100:00100000:1.0:1746147180.481924:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511552 00000100:00100000:0.0:1746147180.481924:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511808 00000100:00100000:1.0:1746147180.481982:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11188 00000100:00100000:1.0:1746147180.481989:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463511552:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147180.481993:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11190 00000100:00100000:0.0:1746147180.481999:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463511808:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147180.482024:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482024:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.482042:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 39 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482042:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.482049:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147180.482049:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.482051:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147180.482054:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482057:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482069:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482076:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482080:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147180.482082:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 39 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482082:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147180.482084:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 8/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.482093:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 39 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.482101:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.482107:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466322816:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147180.482108:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 24 pid: 4444 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.482116:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323072:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147180.482242:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482250:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.482257:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323200:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.482586:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092f3e780 going to sleep for 11 seconds 00010000:00010000:0.0:1746147180.482589:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482597:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.482610:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323584:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147180.482638:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.482653:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 17 pid: 11147 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.482660:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323712:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147180.482683:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.482690:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 24 pid: 8481 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.482697:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323840:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.482708:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.482796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.482837:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511424 00000100:00100000:3.0:1746147180.482841:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511424 00000100:00100000:0.0:1746147180.482855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.482869:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511680 00000100:00100000:3.0:1746147180.482871:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511680 00000100:00100000:3.0:1746147180.482891:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11191 00000100:00100000:3.0:1746147180.482897:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463511424:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147180.482899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147180.482922:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.482956:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.482963:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.482970:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7400/0xb4b2209fbdac5210 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b02 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.482975:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.482977:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.482979:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.482996:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7400/0xb4b2209fbdac5210 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b02 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483003:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbd7400/0xb4b2209fbdac5210 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b02 expref: 14 pid: 4444 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.483010:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466323968:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.483060:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483068:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 39 pid: 4445 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.483084:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466324096:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.483110:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.483118:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.483124:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466324224:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.483140:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147180.483152:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463511936 00000100:00100000:3.0:1746147180.483155:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463511936 00000100:00100000:3.0:1746147180.483613:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11192 00000100:00100000:3.0:1746147180.483621:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463511680:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147180.483639:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac53ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.483658:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483665:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483671:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483681:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.483682:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.483684:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac53ec lrc: 6/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.483699:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483706:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.483714:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466324352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.483743:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483751:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 18 pid: 21080 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.483758:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466324480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.483783:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.483791:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 27 pid: 8481 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.483804:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466324736:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.483821:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147180.491306:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463512064 00000100:00100000:1.0:1746147180.491314:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463512064 00010000:00010000:1.0:1746147180.491348:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 25 pid: 4444 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.491375:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5458 00000100:00100000:1.0:1746147180.491381:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463512064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.491393:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.491414:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 25 pid: 4444 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.491424:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466322944:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.491424:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 25 pid: 4444 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.491434:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466323328:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.491437:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.491441:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466323456:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.491445:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a200/0xb4b2209fbdac50ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5a14 expref: 25 pid: 4444 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.491446:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323200:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.491453:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323712:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.491459:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.491463:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.491467:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.491748:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463512064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 366us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.491755:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5458 00000100:00100000:0.0:1746147180.495390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.495456:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463512704 00000100:00100000:1.0:1746147180.495462:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463512704 00000100:00100000:0.0:1746147180.495471:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466323584:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.495495:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ddf000/0xb4b2209fbdac52b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b79 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.495505:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.495522:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5459 00000100:00100000:1.0:1746147180.495528:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463512704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147180.495534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147180.495541:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147180.495563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147180.495564:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ddf000/0xb4b2209fbdac52b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b79 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.495575:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ddf000/0xb4b2209fbdac52b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b79 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.495598:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ddf000/0xb4b2209fbdac52b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b79 expref: 24 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.495616:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.495623:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463513088 00000100:00100000:3.0:1746147180.495627:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463513088 00010000:00010000:3.0:1746147180.495657:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.495667:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463512704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 139us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.495674:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5459 00000100:00100000:3.0:1746147180.495675:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463513216 00000100:00100000:3.0:1746147180.495676:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463513216 00010000:00010000:3.0:1746147180.495688:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 25 pid: 8481 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.495695:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5460 00000100:00100000:1.0:1746147180.495700:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463513088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.495706:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.495716:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.495725:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f199800/0xb4b2209fbdac4e66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e58bd expref: 24 pid: 11147 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.495735:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.495759:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463513088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.496082:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5461 00000100:00100000:3.0:1746147180.496088:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463513216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.496096:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.496108:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 23 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.496120:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 23 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.496131:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a470a600/0xb4b2209fbdac5336 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5be9 expref: 23 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.496145:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.496165:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463513216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.496170:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5461 00000100:00100000:1.0:1746147180.496228:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5460 00000100:00100000:1.0:1746147180.496260:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466322816:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.496273:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.497375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.497406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.497421:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463513344 00000100:00100000:1.0:1746147180.497425:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463513344 00000100:00100000:0.0:1746147180.497425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.497440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147180.497442:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 19 pid: 21080 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.497453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.497458:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463513728 00000100:00100000:1.0:1746147180.497460:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463513728 00010000:00010000:1.0:1746147180.497469:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 24 pid: 17530 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.497469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.497482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.497483:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463512576 00000100:00100000:1.0:1746147180.497485:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463512576 00000100:00100000:0.0:1746147180.497491:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147180.497493:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e812400/0xb4b2209fbdac538a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c36 expref: 21 pid: 11147 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.497499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.497502:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463512448 00000100:00100000:1.0:1746147180.497503:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463512448 00010000:00010000:1.0:1746147180.497511:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 29 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.497518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.497521:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5462 00000100:00100000:1.0:1746147180.497527:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+21:1959:x1830967463513344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.497534:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.497546:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 21 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497554:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 21 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497568:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1515e00/0xb4b2209fbdac4f70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5957 expref: 21 pid: 21080 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.497573:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466324608:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.497577:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.497581:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466324864:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.497599:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5464 00000100:00100000:1.0:1746147180.497600:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+20:1959:x1830967463513344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.497605:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463513728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147180.497606:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5462 00010000:00010000:3.0:1746147180.497612:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147180.497619:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5465 00010000:00010000:3.0:1746147180.497622:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 25 pid: 17530 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.497624:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463512320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.497629:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.497631:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 25 pid: 17530 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497637:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c28 expref: 19 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:3.0:1746147180.497642:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df17400/0xb4b2209fbdac5360 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c13 expref: 25 pid: 17530 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497660:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c28 expref: 19 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:3.0:1746147180.497667:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147180.497671:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df17200/0xb4b2209fbdac539f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c28 expref: 19 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497679:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.497684:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463513728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.497690:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5464 00000100:00100000:1.0:1746147180.497695:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463512320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.497700:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5465 00000100:00100000:3.0:1746147180.497703:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5467 00000100:00100000:3.0:1746147180.497708:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463512192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.497714:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.497720:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbd4400/0xb4b2209fbdac52bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b80 expref: 29 pid: 17530 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.497726:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5468 00010000:00010000:3.0:1746147180.497728:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbd4400/0xb4b2209fbdac52bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b80 expref: 29 pid: 17530 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.497731:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463512448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.497736:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.497739:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbd4400/0xb4b2209fbdac52bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b80 expref: 29 pid: 17530 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.497743:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 29 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.497747:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.497749:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.497751:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 28 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.497753:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.497761:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.497761:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9b600/0xb4b2209fbdac507a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f1 expref: 28 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.497770:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147180.497777:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.497783:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463512448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.497788:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5468 00000100:00100000:3.0:1746147180.497790:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463512192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.497795:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5467 00000100:00100000:1.0:1746147180.497799:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5470 00000100:00100000:1.0:1746147180.497803:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463513472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.497809:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.497812:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.497816:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.497819:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.497823:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.497833:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbd6e00/0xb4b2209fbdac51c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ad1 expref: 23 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.497836:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.497842:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.497842:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147180.497849:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.497853:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463513472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (334us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147180.497855:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f075000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147180.497858:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.497858:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5470 00010000:00010000:3.0:1746147180.497865:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.497873:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.497878:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac53d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147180.497912:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463511296:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15919us (16168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.497919:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11189 00000100:00100000:3.0:1746147180.498676:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f450700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466324992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.498694:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.501918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.502433:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463513856 00000100:00100000:1.0:1746147180.502440:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463513856 00010000:00010000:1.0:1746147180.502470:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 26 pid: 21080 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.502494:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514112 00000100:00100000:1.0:1746147180.502495:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514112 00010000:00010000:1.0:1746147180.502502:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df16200/0xb4b2209fbdac534b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bfe expref: 43 pid: 17530 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.504464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.505142:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514240 00000100:00100000:1.0:1746147180.505149:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514240 00010000:00010000:1.0:1746147180.505175:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9bc00/0xb4b2209fbdac4e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e588c expref: 27 pid: 8481 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.505193:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5471 00000100:00100000:1.0:1746147180.505199:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463513856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.505212:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.505237:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505247:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505268:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbd5200/0xb4b2209fbdac5344 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bf7 expref: 27 pid: 21080 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505282:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505284:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505289:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505301:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505331:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.505367:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463513856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 168us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.505372:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5471 00000100:00100000:1.0:1746147180.505390:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5472 00000100:00100000:1.0:1746147180.505395:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463514112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.505402:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.505414:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df16200/0xb4b2209fbdac534b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bfe expref: 43 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505423:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df16200/0xb4b2209fbdac534b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bfe expref: 43 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505435:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df16200/0xb4b2209fbdac534b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5bfe expref: 43 pid: 17530 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.505442:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505444:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505446:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505452:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505469:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147180.505480:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505488:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505505:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505511:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505519:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505524:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f075e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147180.505528:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505535:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505542:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505553:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac53f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.505589:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463511936:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 21910us (22690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.505595:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11193 00000100:00100000:1.0:1746147180.505616:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5473 00000100:00100000:1.0:1746147180.505621:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463513984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.505627:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.505637:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 42 pid: 4445 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.505655:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 42 pid: 4445 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.505666:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5217 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b10 expref: 42 pid: 4445 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.505674:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505675:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.505678:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505684:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505704:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.505715:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463513984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.505720:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5473 00010000:00010000:1.0:1746147180.505756:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505763:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505774:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505779:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505785:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505790:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df17000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147180.505792:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505798:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505810:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.505815:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df17000/0xb4b2209fbdac53e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.505840:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463511424:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 22944us (23044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.505845:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11191 00000100:00100000:1.0:1746147180.505861:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463514112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 467us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.505866:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5472 00010000:00010000:0.0:1746147180.505918:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505930:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505956:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505962:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505968:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505973:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9b3400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147180.505975:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505981:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505988:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.505993:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac53de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.506032:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463511808:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 24033us (24134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.506038:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11190 00000100:00100000:3.0:1746147180.508075:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463512960:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10176us (10596us total) trans 17179873146 rc 0/0 00000100:00100000:3.0:1746147180.508087:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1445 00002000:00100000:3.0:1746147180.508096:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1773568->2072575) req@ffff88012c9f3100 x1830967463512960/t17179873146(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/448 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.508106:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967463512960 ext(1773568->2072575) 00010000:00010000:3.0:1746147180.508116:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.508131:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.508137:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f3100 00000100:00100000:0.0:1746147180.511367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.511442:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514368 00000100:00100000:3.0:1746147180.511450:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514368 00010000:00010000:3.0:1746147180.511479:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.511506:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5475 00000100:00100000:3.0:1746147180.511511:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463514368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.511524:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.511542:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.511552:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.511573:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a809a00/0xb4b2209fbdac5367 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2072575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c1a expref: 40 pid: 8481 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.511600:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.511602:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.511606:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.511614:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.511635:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147180.511685:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463514368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 173us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.511691:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5475 00010000:00010000:1.0:1746147180.511874:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.511887:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.511907:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.511914:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.511920:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.511929:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e812200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147180.511932:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.512077:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.512085:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.512089:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e812200/0xb4b2209fbdac53d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.512653:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463511552:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 30654us (30774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.512662:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11188 00000100:00100000:3.0:1746147180.514277:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514624 00000100:00100000:3.0:1746147180.514284:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514624 00000100:00100000:3.0:1746147180.514320:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10382 00000100:00100000:3.0:1746147180.514326:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28612:x1830967463514624:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147180.514381:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.514404:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98a00/0xb4b2209fbdac5272 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5b48 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514420:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.514427:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147180.514454:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.514467:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514473:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514478:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514484:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514490:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514496:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 8/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.514526:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514536:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 22 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.514547:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.514665:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514673:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.514680:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325248:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.514714:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514720:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.514727:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325376:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.514759:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 22 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514765:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 22 pid: 23726 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.514781:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325504:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.514818:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.514825:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.514832:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325632:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.514848:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.517707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.517746:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325120:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.517783:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.517791:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325376:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.517793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.517821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.517840:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514880 00000100:00100000:3.0:1746147180.517845:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514880 00000100:00100000:0.0:1746147180.517845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147180.517878:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 320 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.517901:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463514752 00000100:00100000:3.0:1746147180.517904:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463514752 00000100:00100000:1.0:1746147180.517913:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463515264 00010000:00010000:3.0:1746147180.517915:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 24 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.517917:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463515264 00000100:00100000:3.0:1746147180.517930:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5476 00010000:00010000:1.0:1746147180.517930:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 25 pid: 23726 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.517955:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967463514880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147180.517959:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5477 00000100:00100000:1.0:1746147180.517963:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463514752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.517969:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.517970:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.517973:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 25 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.517974:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 320 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.517982:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 25 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.517989:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 320 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.518012:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac4f2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5926 expref: 25 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.518023:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.518024:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac4ecf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5903 expref: 320 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.518026:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.518032:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147180.518033:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.518036:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.518041:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.518064:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463514752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.518070:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5477 00000100:00100000:1.0:1746147180.518082:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5478 00000100:00100000:1.0:1746147180.518087:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463515264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.518093:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.518097:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 24 pid: 23726 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.518134:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 24 pid: 23726 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.518145:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.518148:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.518156:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.518171:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463515264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.518176:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5478 00000100:00100000:3.0:1746147180.518178:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967463514880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 240us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.518184:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5476 00010000:00010000:3.0:1746147180.518211:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd000/0xb4b2209fbdac4de8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e585b expref: 22 pid: 23726 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.518221:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325504:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.518231:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466325632:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.518258:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147180.518919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.519019:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463515392 00000100:00100000:1.0:1746147180.519023:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463515392 00010000:00010000:1.0:1746147180.519036:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.519064:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5479 00000100:00100000:1.0:1746147180.519070:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967463515392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.519077:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.519081:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519089:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519100:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e559e00/0xb4b2209fbdac4dc5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e584d expref: 319 pid: 14049 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519108:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.519111:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.519116:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.519147:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1956:x1830967463515392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.519155:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5479 00000100:00100000:0.0:1746147180.519365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.519399:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463515520 00000100:00100000:1.0:1746147180.519403:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463515520 00010000:00010000:1.0:1746147180.519413:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.519434:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5480 00000100:00100000:1.0:1746147180.519439:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463515520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.519444:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.519448:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519456:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519466:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2b000/0xb4b2209fbdac5088 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e59f8 expref: 22 pid: 14125 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.519474:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.519477:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.519483:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.519490:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.519514:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.519542:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463515520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (177us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147180.519544:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.519547:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5480 00010000:00010000:3.0:1746147180.519555:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000040:00080000:3.0:1746147180.520208:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2860, 88 off237384 00000004:00080000:3.0:1746147180.520216:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507278240ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520269:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2818, 88 off233688 00000004:00080000:3.0:1746147180.520275:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507338028ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520303:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2819, 88 off233776 00000004:00080000:3.0:1746147180.520306:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507369078ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520314:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2861, 88 off237472 00000004:00080000:3.0:1746147180.520317:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507379695ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520351:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2863, 88 off237656 00000004:00080000:3.0:1746147180.520355:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507417588ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520391:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2820, 88 off233864 00000004:00080000:3.0:1746147180.520394:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507457230ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520402:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2821, 88 off233952 00000004:00080000:3.0:1746147180.520404:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507466813ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520411:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2822, 88 off234040 00000004:00080000:3.0:1746147180.520413:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507475743ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520420:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2864, 88 off237744 00000004:00080000:3.0:1746147180.520423:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507486273ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520430:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2823, 88 off234128 00000004:00080000:3.0:1746147180.520432:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507495223ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520439:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2865, 88 off237832 00000004:00080000:3.0:1746147180.520441:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507503806ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520447:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2824, 88 off234216 00000004:00080000:3.0:1746147180.520450:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507513133ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147180.520457:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2866, 88 off237920 00000004:00080000:3.0:1746147180.520460:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507522498ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520466:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2867, 88 off238008 00000004:00080000:3.0:1746147180.520469:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507531423ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520475:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2868, 88 off238096 00000004:00080000:3.0:1746147180.520477:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507539916ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520483:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2869, 88 off238184 00000004:00080000:3.0:1746147180.520486:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567507548396ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147180.520492:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2825, 88 off234304 00000004:00080000:3.0:1746147180.520495:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567507557683ns, next at 537465048041ns, rc = 0 00000004:00010000:3.0:1746147180.539635:0:14048:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f451500 reply state ffff88009e988400 transno 8589944106 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147180.539657:0:14048:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147180.540169:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466325760 00000100:00100000:0.0:1746147180.540175:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466325760 00000100:00100000:0.0:1746147180.540217:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466325888 00000100:00100000:0.0:1746147180.540219:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466325888 00000100:00100000:0.0:1746147180.540234:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466326272 00000100:00100000:0.0:1746147180.540236:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466326272 00000100:00100000:0.0:1746147180.540249:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11194 00000100:00100000:0.0:1746147180.540255:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1830967466325760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540333:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466327296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540358:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540374:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147180.540378:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466326912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540394:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540401:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466327424:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746147180.540407:0:14048:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147180.540413:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.540420:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:28612:x1830967463514624:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 26091us (26205us total) trans 8589944106 rc 0/0 00000100:00100000:1.0:1746147180.540425:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.540427:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10382 00000100:00100000:1.0:1746147180.540439:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540445:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.540456:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540461:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540472:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540478:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540490:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540496:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147180.540499:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.540511:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540517:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.540528:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.540533:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.540544:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147180.540551:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.540551:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327552:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147180.540558:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.540561:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147180.540564:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.540568:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a98c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.540572:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.540576:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466327296 00010000:00010000:3.0:1746147180.540578:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.540578:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466327296 00010000:00010000:3.0:1746147180.540594:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.540596:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147180.540600:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.540603:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a98c00/0xb4b2209fbdac53fa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147180.540792:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3294:x1830967466325760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 537us (738us total) trans 21474840545 rc 0/0 00000100:00100000:0.0:1746147180.540929:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11194 00000100:00100000:0.0:1746147180.540959:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466327552 00000100:00100000:0.0:1746147180.540961:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466327552 00000100:00100000:0.0:1746147180.540972:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11196 00000100:00100000:0.0:1746147180.540976:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466326400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147180.541084:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466326400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (937us total) trans 17179873147 rc 0/0 00000100:00100000:0.0:1746147180.541090:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11196 00000100:00100000:0.0:1746147180.541100:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11197 00000100:00100000:0.0:1746147180.541105:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466326272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147180.541176:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147180.541179:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147180.541181:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.541183:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.541184:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1746147180.541202:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466326272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1026us total) trans 17179873148 rc 0/0 00000100:00100000:0.0:1746147180.541206:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11197 00000100:00100000:0.0:1746147180.541215:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746147180.541219:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3294:x1830967466326784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147180.541288:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147180.541291:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147180.541293:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.541294:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147180.541296:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147180.541313:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3294:x1830967466326784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1112us total) trans 17179873149 rc 0/0 00000100:00100000:0.0:1746147180.541318:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746147180.541328:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11199 00000100:00100000:0.0:1746147180.541332:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3293:x1830967466326912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.541598:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11202 00000100:00100000:1.0:1746147180.541604:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967466326656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.541696:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147180.541699:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.541700:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.541702:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.541703:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147180.541722:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967466326656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (1265us total) trans 17179873152 rc 0/0 00000100:00100000:1.0:1746147180.541727:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11202 00000100:00100000:1.0:1746147180.541736:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11204 00000100:00100000:1.0:1746147180.541741:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3296:x1830967466327680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147180.541812:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1746147180.541814:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.541816:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.541817:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.541819:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:1.0:1746147180.541836:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466327680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1345us total) trans 21474840548 rc 0/0 00000100:00100000:1.0:1746147180.541842:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11204 00000100:00100000:1.0:1746147180.541851:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11206 00000100:00100000:1.0:1746147180.541856:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3296:x1830967466326528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.541923:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147180.541926:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.541928:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.541930:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.541932:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147180.541964:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3296:x1830967466326528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (1434us total) trans 17179873153 rc 0/0 00000100:00100000:1.0:1746147180.541968:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11206 00000100:00100000:1.0:1746147180.541978:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11207 00000100:00100000:1.0:1746147180.541982:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3296:x1830967466327040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.542060:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466327040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1514us total) trans 21474840549 rc 0/0 00000100:00100000:1.0:1746147180.542065:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11207 00000100:00100000:0.0:1746147180.542237:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466326912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 903us (1840us total) trans 21474840550 rc 0/0 00000100:00100000:0.0:1746147180.542242:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11199 00000100:00100000:0.0:1746147180.542253:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11208 00000100:00100000:0.0:1746147180.542259:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466327552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147180.542322:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147180.542325:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147180.542327:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.542328:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147180.542330:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147180.542348:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3296:x1830967466327552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1785us total) trans 21474840551 rc 0/0 00000100:00100000:0.0:1746147180.542352:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11208 00000100:00100000:0.0:1746147180.542363:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11209 00000100:00100000:0.0:1746147180.542368:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3293:x1830967466327296:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147180.542419:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3800/2, rc 0, transno 17179873148 00000100:00100000:3.0:1746147180.542425:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466326272:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147180.542431:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746147180.542432:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2300/2, rc 0, transno 17179873149 00002000:00010000:0.0:1746147180.542433:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00000100:00100000:3.0:1746147180.542435:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466326784:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147180.542435:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.542436:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147180.542438:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:3.0:1746147180.542442:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2a00/2, rc 0, transno 17179873150 00000100:00100000:3.0:1746147180.542444:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466325888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147180.542450:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f0a80/2, rc 0, transno 17179873147 00000100:00100000:3.0:1746147180.542452:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466326400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147180.542456:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3293:x1830967466327296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (2098us total) trans 21474840552 rc 0/0 00000004:00080000:3.0:1746147180.542460:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7cca80/2, rc 0, transno 21474840545 00000100:00100000:0.0:1746147180.542461:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11209 00000100:00100000:3.0:1746147180.542466:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466325760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.542527:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147180.542533:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466327808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.542558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147180.542575:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466327808 00000100:00100000:0.0:1746147180.542579:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466327808 00000100:00100000:0.0:1746147180.542593:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11210 00000100:00100000:0.0:1746147180.542597:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3294:x1830967466327808:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542666:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7ce300/2, rc 0, transno 21474840550 00000100:00100000:1.0:1746147180.542670:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466326912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542678:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01f80/2, rc 0, transno 21474840546 00000100:00100000:1.0:1746147180.542680:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466327424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542686:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02300/2, rc 0, transno 21474840552 00000100:00100000:1.0:1746147180.542689:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466327296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542705:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2680/2, rc 0, transno 17179873154 00000100:00100000:1.0:1746147180.542709:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.542715:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f3b80/2, rc 0, transno 17179873153 00000100:00100000:1.0:1746147180.542717:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.542722:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7cf100/2, rc 0, transno 21474840549 00000100:00100000:1.0:1746147180.542725:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542737:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03b80/2, rc 0, transno 21474840551 00000100:00100000:1.0:1746147180.542739:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542745:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f2d80/2, rc 0, transno 17179873151 00000100:00100000:1.0:1746147180.542747:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.542752:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c9f0e00/2, rc 0, transno 17179873152 00000100:00100000:1.0:1746147180.542755:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466326656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.542761:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7cc000/2, rc 0, transno 21474840547 00000100:00100000:1.0:1746147180.542763:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.542768:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03100/2, rc 0, transno 21474840548 00000100:00100000:1.0:1746147180.542771:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466327680:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147180.542918:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147180.542921:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147180.542923:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147180.542925:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147180.542927:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:0.0:1746147180.543129:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3294:x1830967466327808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 530us (570us total) trans 21474840553 rc 0/0 00000100:00100000:0.0:1746147180.543135:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11210 00000100:00080000:0.0:1746147180.543153:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147180.543157:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746147180.543221:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e13b80/2, rc 0, transno 21474840553 00000100:00100000:3.0:1746147180.543225:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466327808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.545468:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463515648 00000100:00100000:3.0:1746147180.545475:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463515648 00000100:00100000:3.0:1746147180.545512:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10383 00000100:00100000:3.0:1746147180.545518:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+7:28612:x1830967463515648:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147180.545536:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.545560:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c52 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.545615:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.545627:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.545654:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.545657:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147180.545660:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5a400, rc 0) 00000100:00100000:3.0:1746147180.545789:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:28612:x1830967463515648:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 270us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.545795:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10383 00000100:00100000:0.0:1746147180.548994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.549042:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463515776 00000100:00100000:3.0:1746147180.549050:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463515776 00000100:00100000:3.0:1746147180.549093:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10384 00000100:00100000:3.0:1746147180.549100:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:28612:x1830967463515776:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147180.549119:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.549137:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac5408 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c59 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.549223:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.549235:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.549245:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147180.549270:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147180.549275:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147180.549290:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.549311:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac5408 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.549324:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.549332:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.549335:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147180.549338:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5b600, rc 0) 00000100:00100000:3.0:1746147180.549703:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:28612:x1830967463515776:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 602us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.549710:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10384 00000100:00100000:0.0:1746147180.551097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.551229:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463516544 00000100:00100000:0.0:1746147180.551232:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463516544 00000100:00100000:0.0:1746147180.551244:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11212 00000100:00100000:0.0:1746147180.551248:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463516160:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147180.551255:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.551264:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c6e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147180.551278:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x6814176c, atime: 0x6814176b, ctime: 0x6814176c, blocks: 0x821 00010000:00010000:0.0:1746147180.551286:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.551288:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.551295:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.551309:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.551315:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0ef600, rc 0) 00000100:00100000:0.0:1746147180.551343:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463516160:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.551348:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11212 00000100:00100000:0.0:1746147180.551358:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11213 00000100:00100000:1.0:1746147180.551363:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11214 00000100:00100000:0.0:1746147180.551363:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463516416:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147180.551368:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147180.551369:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463516032:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147180.551374:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.551376:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c7c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.551382:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c67 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147180.551386:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4870144, mtime: 0x6814176c, atime: 0x6814176b, ctime: 0x6814176c, blocks: 0x1567 00002000:00010000:1.0:1746147180.551391:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814176b, atime: 0x6814176b, ctime: 0x6814176b, blocks: 0x81d 00010000:00010000:0.0:1746147180.551393:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.551394:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.551397:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.551398:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.551398:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.551401:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.551406:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 17 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.551409:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.551413:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0efe00, rc 0) 00010000:00010000:1.0:1746147180.551416:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e812000, rc 0) 00000100:00100000:3.0:1746147180.551541:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11215 00000100:00100000:3.0:1746147180.551548:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463516288:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147180.551559:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.551568:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f5a200/0xb4b2209fbdac5432 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c75 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147180.551581:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814176a, atime: 0x6814176a, ctime: 0x6814176a, blocks: 0x821 00010000:00010000:3.0:1746147180.551589:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.551590:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.551595:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a200/0xb4b2209fbdac5432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c75 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147180.551664:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463516416:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 299us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.551672:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11213 00000100:00100000:1.0:1746147180.551826:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463516032:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 450us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.551836:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11214 00010000:00010000:3.0:1746147180.551924:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f5a200/0xb4b2209fbdac5432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c75 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.551931:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5a200, rc 0) 00000100:00100000:3.0:1746147180.551981:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463516288:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 433us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.551987:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11215 00000100:00100000:0.0:1746147180.577455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.577605:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463516800 00000100:00100000:3.0:1746147180.577614:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463516800 00000100:00100000:3.0:1746147180.577688:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10385 00000100:00100000:3.0:1746147180.577696:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28615:x1830967463516800:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147180.577721:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.577739:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b400/0xb4b2209fbdac5440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c8a expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.577840:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.577857:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.577867:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.577880:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.577886:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.577891:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.578046:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.578055:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.578062:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.578090:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.578100:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 8 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.578112:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466327936:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.578211:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.580251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.580314:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463516928 00000100:00100000:1.0:1746147180.580321:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463516928 00010000:00010000:1.0:1746147180.580350:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.580435:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466327936:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.580467:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147180.580606:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5481 00000100:00100000:1.0:1746147180.580614:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463516928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.580626:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.580632:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.580653:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.580673:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17a00/0xb4b2209fbdac53c2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c4b expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.580699:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.580704:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.580712:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.580719:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147180.580735:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.581147:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463516928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 533us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.581155:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5481 00010000:00010000:3.0:1746147180.581219:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581225:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147180.581238:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147180.581381:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581387:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581393:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581398:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb62000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.581402:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581407:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581415:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.581417:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147180.581420:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581424:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb62000/0xb4b2209fbdac5455 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581460:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581465:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581469:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581473:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134f5ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.581475:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581479:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581486:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147180.581488:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147180.581490:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581494:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5ba00/0xb4b2209fbdac5447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581502:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581507:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581512:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581515:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134f5a000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.581517:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581521:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581526:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137900) 00010000:00010000:3.0:1746147180.581528:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147180.581529:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581533:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac544e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.581573:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b400/0xb4b2209fbdac5440 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c8a expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.581578:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b400/0xb4b2209fbdac5440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c8a expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.581584:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5b400, rc 0) 00000100:00100000:3.0:1746147180.582639:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28615:x1830967463516800:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4942us (5191us total) trans 8589944107 rc 301/301 00000100:00100000:3.0:1746147180.582657:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10385 00000100:00100000:0.0:1746147180.616846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.617007:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463517184 00000100:00100000:3.0:1746147180.617018:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463517184 00000100:00100000:3.0:1746147180.617093:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10386 00000100:00100000:3.0:1746147180.617104:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28618:x1830967463517184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.617134:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.617158:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63200/0xb4b2209fbdac5463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c91 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.617294:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617309:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617321:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617338:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617344:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617349:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617483:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617491:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617496:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147180.617589:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147180.617698:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617705:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617715:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617719:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb63800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.617723:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617729:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617742:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.617744:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147180.617748:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617752:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63800/0xb4b2209fbdac5478 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617803:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617808:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617813:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617817:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb63400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.617819:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617823:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617832:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147180.617834:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147180.617836:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617840:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63400/0xb4b2209fbdac546a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617849:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617853:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617858:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617862:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb63600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147180.617864:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617869:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617874:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137900) 00010000:00010000:3.0:1746147180.617876:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147180.617878:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617883:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63600/0xb4b2209fbdac5471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147180.617925:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63200/0xb4b2209fbdac5463 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c91 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.617932:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63200/0xb4b2209fbdac5463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c91 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.618099:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63200, rc 0) 00000100:00100000:3.0:1746147180.618171:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28618:x1830967463517184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1067us (1333us total) trans 8589944108 rc 301/301 00000100:00100000:3.0:1746147180.618180:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10386 00000100:00100000:0.0:1746147180.621626:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463517312 00000100:00100000:0.0:1746147180.621634:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463517312 00000100:00100000:0.0:1746147180.621698:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10387 00000100:00100000:0.0:1746147180.621705:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28618:x1830967463517312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147180.621729:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.621747:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5486 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c98 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.621840:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147180.621853:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147180.621867:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147180.621895:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147180.621899:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147180.621915:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147180.621954:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5486 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c98 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.621974:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c98 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.621982:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147180.621984:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147180.621987:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0efc00, rc 0) 00000100:00100000:0.0:1746147180.622034:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28618:x1830967463517312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 330us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.622040:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10387 00000100:00100000:0.0:1746147180.624606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.625618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.625670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.625684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.625711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.625755:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11217 00000100:00100000:1.0:1746147180.625765:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463517440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.625783:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.625801:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5c9f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147180.625811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147180.625822:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.625824:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147180.625827:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463518080 00000100:00100000:3.0:1746147180.625829:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463518080 00010000:00010000:1.0:1746147180.625833:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147180.625845:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11218 00010000:00010000:1.0:1746147180.625847:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147180.625849:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463517568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.625856:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.625857:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e813600, rc 0) 00010000:00010000:3.0:1746147180.625865:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ca6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.625874:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.625875:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.625879:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.625887:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.625894:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63600, rc 0) 00000100:00100000:1.0:1746147180.625899:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463517440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 136us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.625904:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11217 00000100:00100000:3.0:1746147180.625906:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463517568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.625910:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11218 00000100:00100000:3.0:1746147180.625917:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11219 00000100:00100000:1.0:1746147180.625920:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11220 00000100:00100000:3.0:1746147180.625921:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463517696:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147180.625924:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463517824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.625926:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.625929:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.625932:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cad expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.625951:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e812e00/0xb4b2209fbdac54a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cb4 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.625957:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.625958:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.625959:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.625960:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.625961:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.625963:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e812e00/0xb4b2209fbdac54a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cb4 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.625969:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.625971:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e812e00/0xb4b2209fbdac54a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cb4 expref: 24 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.625976:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63400, rc 0) 00010000:00010000:1.0:1746147180.625977:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e812e00, rc 0) 00000100:00100000:3.0:1746147180.625990:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463517696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 68us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.625990:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463517824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.625994:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11219 00000100:00100000:1.0:1746147180.626025:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11220 00000100:00100000:3.0:1746147180.626030:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11221 00000100:00100000:3.0:1746147180.626035:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463518080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.626043:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.626048:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cc2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.626057:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.626058:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.626061:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.626069:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.626075:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63800, rc 0) 00000100:00100000:3.0:1746147180.626088:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463518080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.626093:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11221 00000100:00100000:0.0:1746147180.641244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.641287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.641657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.641875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.641892:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463518592 00000100:00100000:3.0:1746147180.641901:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463518592 00002000:00100000:3.0:1746147180.642469:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009f450a80 x1830967463518592/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.642480:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450a80 with x1830967463518592 ext(1048576->2097151) 00000100:00100000:1.0:1746147180.642481:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463518336 00002000:00010000:3.0:1746147180.642485:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450a80 00000100:00100000:1.0:1746147180.642486:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463518336 00000100:00100000:3.0:1746147180.642505:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463518848 00000100:00100000:3.0:1746147180.642507:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463518848 00002000:00100000:1.0:1746147180.642510:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f450700 x1830967463518336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.642518:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450700 with x1830967463518336 ext(0->1048575) 00002000:00100000:3.0:1746147180.642521:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f450000 x1830967463518848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746147180.642521:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f450700 00002000:00100000:3.0:1746147180.642527:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450000 with x1830967463518848 ext(1048576->2097151) 00002000:00010000:3.0:1746147180.642530:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450000 00000100:00100000:1.0:1746147180.642537:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4168 00000100:00100000:3.0:1746147180.642543:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4169 00000100:00100000:1.0:1746147180.642544:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463518592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147180.642549:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463518336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.644335:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463519104 00000100:00100000:0.0:1746147180.644341:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463519104 00002000:00100000:0.0:1746147180.644366:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880134d02a00 x1830967463519104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.644374:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02a00 with x1830967463519104 ext(1048576->2097151) 00002000:00010000:0.0:1746147180.644379:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d02a00 00000100:00100000:0.0:1746147180.644396:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4171 00000100:00100000:0.0:1746147180.644402:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463519104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.651213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.651543:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463519360 00000100:00100000:1.0:1746147180.651551:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463519360 00000100:00100000:1.0:1746147180.651593:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10388 00000100:00100000:1.0:1746147180.651600:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28620:x1830967463519360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147180.651623:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.651640:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cc9 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.651757:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651769:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651780:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651790:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651796:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651801:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651906:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651913:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.651919:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147180.651926:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147180.652035:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652041:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652046:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652050:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2fe00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.652053:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652059:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652069:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.652073:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147180.652077:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652081:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fe00/0xb4b2209fbdac54d3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652118:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652123:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652127:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652131:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.652134:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652138:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652145:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147180.652147:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147180.652149:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652152:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fa00/0xb4b2209fbdac54c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652161:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652165:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.652170:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.654180:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2fc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.654186:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.654194:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.654207:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f400) 00010000:00010000:1.0:1746147180.654209:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147180.654212:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.654217:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.654274:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc9 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.654281:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc9 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.654288:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea2f800, rc 0) 00000100:00100000:1.0:1746147180.654343:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28620:x1830967463519360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2743us (3139us total) trans 8589944109 rc 301/301 00000100:00100000:1.0:1746147180.654351:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10388 00000100:00100000:0.0:1746147180.657529:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463518592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14974us (16283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147180.657541:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4168 00002000:00100000:0.0:1746147180.657551:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009f450a80 x1830967463518592/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.657562:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450a80 with x1830967463518592 ext(1048576->2097151) 00002000:00010000:0.0:1746147180.657568:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450a80 00000100:00100000:3.0:1746147180.665104:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463518336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22544us (23804us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147180.665116:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4169 00002000:00100000:3.0:1746147180.665127:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f450700 x1830967463518336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.665136:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450700 with x1830967463518336 ext(0->1048575) 00002000:00010000:3.0:1746147180.665142:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f450700 00000100:00100000:0.0:1746147180.668745:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463519104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24329us (26857us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147180.668759:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4171 00002000:00100000:0.0:1746147180.668770:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880134d02a00 x1830967463519104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.668780:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02a00 with x1830967463519104 ext(1048576->2097151) 00002000:00010000:0.0:1746147180.668787:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d02a00 00000100:00100000:0.0:1746147180.670532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.670574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.670600:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463519616 00000100:00100000:0.0:1746147180.670606:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463519616 00000100:00100000:0.0:1746147180.670901:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463519872 00000100:00100000:0.0:1746147180.670903:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463519872 00000100:00100000:1.0:1746147180.670932:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10389 00000100:00100000:1.0:1746147180.670962:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28623:x1830967463519616:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.670986:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.671004:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f600/0xb4b2209fbdac54e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cd0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671115:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671128:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671138:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671150:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671155:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671161:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671273:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671280:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671285:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147180.671293:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147180.671372:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671378:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671384:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671389:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2f400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.671392:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671398:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671407:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.671410:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147180.671414:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671421:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f400/0xb4b2209fbdac54f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671441:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671445:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671449:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671452:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2f800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.671454:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671457:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671462:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147180.671463:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147180.671465:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671469:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f800/0xb4b2209fbdac54e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671474:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671478:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671482:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671486:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea2fc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147180.671488:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671492:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671496:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98ff00) 00010000:00010000:1.0:1746147180.671497:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147180.671499:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671503:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2fc00/0xb4b2209fbdac54ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671535:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f600/0xb4b2209fbdac54e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd0 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671541:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f600/0xb4b2209fbdac54e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd0 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671548:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea2f600, rc 0) 00000100:00100000:1.0:1746147180.671600:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28623:x1830967463519616:12345-192.168.203.36@tcp:101:cat.0 Request processed in 640us (1075us total) trans 8589944110 rc 301/301 00000100:00100000:1.0:1746147180.671606:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10389 00000100:00100000:1.0:1746147180.671620:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10390 00000100:00100000:1.0:1746147180.671626:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28615:x1830967463519872:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147180.671633:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.671636:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147180.671655:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efc00/0xb4b2209fbdac548d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c98 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671663:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.671665:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147180.671670:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f200/0xb4b2209fbdac5504 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cd7 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671691:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671698:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671704:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671710:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 5/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.671733:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671743:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 7 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.671754:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328064:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.671817:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.671829:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 7 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.671836:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.671854:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.674634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.674720:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463520000 00000100:00100000:1.0:1746147180.674728:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463520000 00000100:00100000:3.0:1746147180.675072:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10391 00000100:00100000:3.0:1746147180.675083:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28618:x1830967463520000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.675105:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.675123:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cde expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.675175:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147180.675184:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.675201:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147180.675212:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.675229:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.675232:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147180.675234:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147180.675241:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63a00, rc 0) 00000100:00100000:3.0:1746147180.675282:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28618:x1830967463520000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 202us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.675289:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10391 00000100:00100000:0.0:1746147180.677686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.677963:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328064:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147180.677976:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328192:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.678000:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147180.678433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.678873:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463520512 00000100:00100000:1.0:1746147180.678878:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463520512 00010000:00010000:1.0:1746147180.678912:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:1.0:1746147180.678952:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5482 00000100:00100000:1.0:1746147180.678959:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:1956:x1830967463520512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147180.679051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.679267:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463520384 00000100:00100000:3.0:1746147180.679272:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463520384 00010000:00010000:3.0:1746147180.679286:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.679302:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5483 00000100:00100000:3.0:1746147180.679306:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463520384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.679313:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.679318:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.679327:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.679352:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5b600/0xb4b2209fbdac540f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c59 expref: 9 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.679366:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147180.679372:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147180.679378:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147180.679383:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147180.679396:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.679403:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.679412:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.679421:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:1956:x1830967463520384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.679428:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5483 00010000:00010000:1.0:1746147180.679428:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5a400/0xb4b2209fbdac5401 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c52 expref: 8 pid: 14048 timeout: 667 lvb_type: 0 00010000:00010000:1.0:1746147180.679438:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147180.679441:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.679448:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.679454:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147180.679462:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.679478:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.680171:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+6:1956:x1830967463520512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1212us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.680177:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5482 00000100:00100000:0.0:1746147180.681578:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463520640 00000100:00100000:0.0:1746147180.681584:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463520640 00000100:00100000:0.0:1746147180.681615:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10392 00000100:00100000:0.0:1746147180.681622:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28620:x1830967463520640:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147180.681635:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.681659:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ce5 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.681705:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.681717:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.681728:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147180.681731:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147180.681734:0:14048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.681740:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0efa00, rc 0) 00000100:00100000:0.0:1746147180.681770:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28620:x1830967463520640:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 149us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.681775:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10392 00000100:00100000:1.0:1746147180.683907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.703956:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466328832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.703993:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.704009:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.704020:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.704031:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147180.704034:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466328704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.704045:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.704053:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147180.704063:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.704078:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466328832 00000100:00100000:3.0:1746147180.704084:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466328832 00000100:00100000:3.0:1746147180.704106:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329344 00000100:00100000:3.0:1746147180.704107:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329344 00000100:00100000:3.0:1746147180.704114:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466328704 00000100:00100000:3.0:1746147180.704115:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466328704 00000100:00100000:3.0:1746147180.704123:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329216 00000100:00100000:3.0:1746147180.704124:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329216 00000100:00100000:3.0:1746147180.704133:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11223 00000100:00100000:3.0:1746147180.704138:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967466328832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147180.704296:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:3.0:1746147180.704299:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147180.704301:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:3.0:1746147180.704303:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147180.704304:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:3.0:1746147180.704323:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967466328832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (330us total) trans 21474840554 rc 0/0 00000100:00100000:3.0:1746147180.704328:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11223 00000100:00100000:3.0:1746147180.704336:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11224 00000100:00100000:3.0:1746147180.704340:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967466329344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147180.704401:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147180.704403:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147180.704405:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147180.704407:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147180.704409:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1746147180.704425:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967466329344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (404us total) trans 21474840555 rc 0/0 00000100:00100000:3.0:1746147180.704430:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11224 00000100:00100000:3.0:1746147180.704438:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11225 00000100:00100000:3.0:1746147180.704443:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967466328704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147180.704500:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147180.704502:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147178 -> 1746147178 00002000:00010000:3.0:1746147180.704504:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147178 -> 1746147178 00002000:00010000:3.0:1746147180.704505:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147178 -> 1746147178 00002000:00010000:3.0:1746147180.704507:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147180.704520:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967466328704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (475us total) trans 21474840556 rc 0/0 00000100:00100000:3.0:1746147180.704525:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11225 00000100:00100000:3.0:1746147180.704532:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11226 00000100:00100000:3.0:1746147180.704536:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830967466329216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147180.704586:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147180.704588:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147180.704590:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147180.704591:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147180.704593:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1746147180.704605:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830967466329216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (541us total) trans 21474840557 rc 0/0 00000100:00100000:3.0:1746147180.704608:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11226 00000004:00080000:3.0:1746147180.704658:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e11f80/2, rc 0, transno 21474840556 00000100:00100000:3.0:1746147180.704665:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466328704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147180.704671:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5d180/2, rc 0, transno 21474840557 00000100:00100000:3.0:1746147180.704674:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147180.704679:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e10380/2, rc 0, transno 21474840554 00000100:00100000:3.0:1746147180.704681:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466328832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147180.704686:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5ed80/2, rc 0, transno 21474840555 00000100:00100000:3.0:1746147180.704687:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705346:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466328960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705374:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705388:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705400:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705408:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.705423:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705435:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.705448:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705459:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [1->0] 00000100:00100000:1.0:1746147180.705464:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466328576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705477:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705486:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705499:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705508:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705519:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705528:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.705540:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705549:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.705561:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147180.705580:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466328960 00000100:00100000:1.0:1746147180.705584:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466328960 00000100:00100000:1.0:1746147180.705600:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329472 00000100:00100000:1.0:1746147180.705602:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329472 00000100:00100000:1.0:1746147180.705607:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329984 00000100:00100000:1.0:1746147180.705609:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329984 00000100:00100000:1.0:1746147180.705616:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466330496 00000100:00100000:1.0:1746147180.705617:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466330496 00000100:00100000:1.0:1746147180.705621:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466328576 00000100:00100000:1.0:1746147180.705623:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466328576 00000100:00100000:1.0:1746147180.705627:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329088 00000100:00100000:1.0:1746147180.705628:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329088 00000100:00100000:1.0:1746147180.705632:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329600 00000100:00100000:1.0:1746147180.705633:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329600 00000100:00100000:1.0:1746147180.705638:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466330112 00000100:00100000:1.0:1746147180.705639:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466330112 00000100:00100000:1.0:1746147180.705655:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466330624 00000100:00100000:1.0:1746147180.705656:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466330624 00000100:00100000:1.0:1746147180.705663:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11227 00000100:00100000:1.0:1746147180.705667:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466328960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147180.705781:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967466328960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (407us total) trans 21474840558 rc 0/0 00000100:00100000:1.0:1746147180.705786:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11227 00000100:00100000:1.0:1746147180.705798:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11228 00000100:00100000:1.0:1746147180.705802:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466329472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147180.705871:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1746147180.705874:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.705876:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.705878:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.705879:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:1.0:1746147180.705896:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967466329472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (494us total) trans 21474840559 rc 0/0 00000100:00100000:1.0:1746147180.705901:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11228 00000100:00100000:1.0:1746147180.705909:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11229 00000100:00100000:1.0:1746147180.705913:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466329984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.706046:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147180.706049:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147180.706051:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:1.0:1746147180.706052:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147180.706054:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147180.706072:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466329984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (648us total) trans 17179873155 rc 0/0 00000100:00100000:1.0:1746147180.706080:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11229 00000100:00100000:1.0:1746147180.706090:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11230 00000100:00100000:1.0:1746147180.706094:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466330496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.706162:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147180.706164:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706166:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706167:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706169:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147180.706185:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466330496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (736us total) trans 17179873156 rc 0/0 00000100:00100000:1.0:1746147180.706189:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11230 00000100:00100000:1.0:1746147180.706197:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11231 00000100:00100000:1.0:1746147180.706201:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466328576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147180.706265:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147180.706267:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147179 -> 1746147179 00002000:00010000:1.0:1746147180.706268:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:1.0:1746147180.706270:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147179 -> 1746147179 00002000:00010000:1.0:1746147180.706272:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2041 -> 2041 00000100:00100000:1.0:1746147180.706287:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967466328576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (809us total) trans 21474840560 rc 0/0 00000100:00100000:1.0:1746147180.706291:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11231 00000100:00100000:1.0:1746147180.706300:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11232 00000100:00100000:1.0:1746147180.706304:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466329088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147180.706361:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147180.706363:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.706365:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706367:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.706368:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147180.706384:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967466329088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (884us total) trans 21474840561 rc 0/0 00000100:00100000:1.0:1746147180.706389:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11232 00000100:00100000:1.0:1746147180.706397:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11233 00000100:00100000:1.0:1746147180.706401:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3293:x1830967466329600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147180.706465:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147180.706468:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706470:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706472:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706474:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147180.706490:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3293:x1830967466329600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (969us total) trans 21474840562 rc 0/0 00000100:00100000:1.0:1746147180.706494:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11233 00000100:00100000:1.0:1746147180.706503:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11234 00000100:00100000:1.0:1746147180.706507:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466330112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.706571:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147180.706573:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147180.706575:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706577:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706578:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1746147180.706595:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466330112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1054us total) trans 17179873157 rc 0/0 00000100:00100000:1.0:1746147180.706604:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11234 00000100:00100000:1.0:1746147180.706614:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11235 00000100:00100000:1.0:1746147180.706618:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466330624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147180.706696:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147180.706699:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706700:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147180.706702:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147180.706703:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147180.706721:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466330624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (1158us total) trans 17179873158 rc 0/0 00000100:00100000:1.0:1746147180.706726:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11235 00000004:00080000:1.0:1746147180.706760:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e10700/2, rc 0, transno 21474840560 00000100:00100000:1.0:1746147180.706764:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466328576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.706770:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5ce00/2, rc 0, transno 21474840561 00000100:00100000:1.0:1746147180.706772:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.706777:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c000/2, rc 0, transno 21474840562 00000100:00100000:1.0:1746147180.706779:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.706785:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01c00/2, rc 0, transno 17179873157 00000100:00100000:1.0:1746147180.706788:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.706794:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f733480/2, rc 0, transno 17179873158 00000100:00100000:1.0:1746147180.706797:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.706802:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e12300/2, rc 0, transno 21474840558 00000100:00100000:1.0:1746147180.706804:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466328960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.706810:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5dc00/2, rc 0, transno 21474840559 00000100:00100000:1.0:1746147180.706812:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329472:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147180.706817:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00e00/2, rc 0, transno 17179873155 00000100:00100000:1.0:1746147180.706819:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466329984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147180.706824:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f731880/2, rc 0, transno 17179873156 00000100:00100000:1.0:1746147180.706826:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466330496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.707227:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.707254:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.707268:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466330368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.707279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.707288:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147180.707292:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.707303:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.707309:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466330240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147180.707320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147180.707332:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329856 00000100:00100000:3.0:1746147180.707336:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329856 00000100:00100000:3.0:1746147180.707350:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466330368 00000100:00100000:3.0:1746147180.707352:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466330368 00000100:00100000:3.0:1746147180.707358:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466329728 00000100:00100000:3.0:1746147180.707360:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466329728 00000100:00100000:3.0:1746147180.707366:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466330240 00000100:00100000:3.0:1746147180.707367:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466330240 00000100:00100000:3.0:1746147180.707375:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11236 00000100:00100000:3.0:1746147180.707378:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967466329856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147180.707452:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147180.707455:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147180.707456:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:3.0:1746147180.707458:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147180.707460:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147180.707481:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466329856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (226us total) trans 17179873159 rc 0/0 00000100:00100000:3.0:1746147180.707486:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11236 00000100:00100000:3.0:1746147180.707496:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11237 00000100:00100000:3.0:1746147180.707499:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967466330368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147180.707565:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147180.707568:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147180.707570:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147180.707571:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147180.707573:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147180.707591:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466330368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (310us total) trans 17179873160 rc 0/0 00000100:00100000:3.0:1746147180.707596:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11237 00000100:00100000:3.0:1746147180.707604:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11238 00000100:00100000:3.0:1746147180.707609:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967466329728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147180.707694:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147180.707696:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147179 -> 1746147179 00002000:00010000:3.0:1746147180.707698:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:3.0:1746147180.707699:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147179 -> 1746147179 00002000:00010000:3.0:1746147180.707701:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746147180.707719:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466329728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (415us total) trans 17179873161 rc 0/0 00000100:00100000:3.0:1746147180.707724:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11238 00000100:00100000:3.0:1746147180.707733:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11239 00000100:00100000:3.0:1746147180.707737:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967466330240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.708188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.709318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.709461:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466330240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1722us (2138us total) trans 17179873162 rc 0/0 00000100:00100000:3.0:1746147180.709468:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11239 00000004:00080000:3.0:1746147180.709520:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00000/2, rc 0, transno 17179873161 00000100:00100000:3.0:1746147180.709526:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147180.709535:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03800/2, rc 0, transno 17179873162 00000100:00100000:3.0:1746147180.709538:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466330240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147180.709545:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00a80/2, rc 0, transno 17179873159 00000100:00100000:3.0:1746147180.709547:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466329856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147180.709553:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f730a80/2, rc 0, transno 17179873160 00000100:00100000:3.0:1746147180.709556:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466330368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147180.709804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.710476:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328448:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147180.710797:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521152 00000100:00100000:1.0:1746147180.710801:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521152 00000100:00100000:1.0:1746147180.710820:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4087 00000100:00100000:1.0:1746147180.710824:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28618:x1830967463521152:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147180.710872:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28618:x1830967463521152:12345-192.168.203.36@tcp:49:cat.0 Request processed in 47us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.710877:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4087 00000100:00100000:3.0:1746147180.711018:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466328320:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147180.711056:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f200/0xb4b2209fbdac5504 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 9 pid: 16361 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147180.711083:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.711100:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea2f000, rc 0) 00000100:00100000:3.0:1746147180.711120:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28615:x1830967463519872:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 39495us (40546us total) trans 8589944112 rc 0/0 00000100:00100000:3.0:1746147180.711126:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10390 00000100:00100000:3.0:1746147180.715240:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521408 00000100:00100000:3.0:1746147180.715247:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521408 00000100:00100000:3.0:1746147180.715289:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11240 00000100:00100000:3.0:1746147180.715295:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463521408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.715312:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.715328:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cfa expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.715354:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.715356:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.715365:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.715380:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 25 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.715391:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5a000, rc 0) 00000100:00100000:0.0:1746147180.715537:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521280 00000100:00100000:0.0:1746147180.715541:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521280 00000100:00100000:0.0:1746147180.715562:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11241 00000100:00100000:0.0:1746147180.715567:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28620:x1830967463521280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147180.715574:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147180.715584:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5cf3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.715600:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.715613:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.715618:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.715620:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.715622:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3760128->4059135] (req 3760128->4059135) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.715664:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 24 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.715677:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 24 pid: 8478 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.715689:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466330752:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.720395:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463521408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5085us (5492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.720408:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11240 00000100:00100000:1.0:1746147180.735000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735130:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521536 00000100:00100000:1.0:1746147180.735137:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521536 00000100:00100000:1.0:1746147180.735177:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521664 00000100:00100000:1.0:1746147180.735179:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521664 00000100:00100000:1.0:1746147180.735191:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521792 00000100:00100000:1.0:1746147180.735194:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521792 00000100:00100000:3.0:1746147180.735200:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463521920 00000100:00100000:3.0:1746147180.735206:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463521920 00000100:00100000:1.0:1746147180.735206:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463522048 00000100:00100000:1.0:1746147180.735208:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463522048 00000100:00100000:1.0:1746147180.735219:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11242 00000100:00100000:1.0:1746147180.735226:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463521536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.735244:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147180.735260:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11243 00010000:00010000:1.0:1746147180.735261:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d01 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147180.735266:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463521664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.735273:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.735282:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d08 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.735284:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735286:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.735295:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.735296:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735296:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.735301:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735311:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.735312:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735321:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0a200, rc 0) 00000100:00100000:1.0:1746147180.735360:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967463521536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 134us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.735365:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11242 00000100:00100000:1.0:1746147180.735380:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11244 00000100:00100000:1.0:1746147180.735385:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463521792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.735393:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.735402:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d0f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.735414:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735416:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735420:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735428:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735435:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0be00, rc 0) 00000100:00100000:1.0:1746147180.735448:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463521792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.735453:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11244 00000100:00100000:1.0:1746147180.735461:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11245 00000100:00100000:1.0:1746147180.735466:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463522048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.735471:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.735476:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d1d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.735484:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735492:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5551 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d1d expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735500:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d1d expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735511:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0ae00, rc 0) 00000100:00100000:1.0:1746147180.735525:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463522048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 59us (414us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147180.735532:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11245 00000100:00100000:1.0:1746147180.735541:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11246 00000100:00100000:1.0:1746147180.735545:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463521920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147180.735550:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147180.735556:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d16 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.735564:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735565:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.735568:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735575:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147180.735580:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0a000, rc 0) 00000100:00100000:1.0:1746147180.735593:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463521920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 47us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.735598:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11246 00000100:00100000:1.0:1746147180.735635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.735728:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463522432 00000100:00100000:1.0:1746147180.735731:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463522432 00002000:00100000:1.0:1746147180.735757:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009f7cd880 x1830967463522432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.735767:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd880 with x1830967463522432 ext(1048576->2097151) 00002000:00010000:1.0:1746147180.735772:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cd880 00000100:00100000:1.0:1746147180.735786:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4172 00000100:00100000:1.0:1746147180.735790:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463522432:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147180.735908:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5b400, rc 0) 00000100:00100000:3.0:1746147180.735931:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463521664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 665us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.735956:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11243 00010000:00010000:0.0:1746147180.736617:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147180.736689:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 13 pid: 6881 timeout: 667 lvb_type: 1 00000100:00100000:0.0:1746147180.736706:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f732680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466330880:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.736809:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.744282:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f733b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466330752:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147180.746843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.746995:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463522560 00000100:00100000:1.0:1746147180.747002:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463522560 00010000:00010000:1.0:1746147180.747037:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 27 pid: 8478 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.747304:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5484 00000100:00100000:1.0:1746147180.747312:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463522560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.747325:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.747348:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 27 pid: 8478 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.747360:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 27 pid: 8478 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.747382:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63800/0xb4b2209fbdac54b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cc2 expref: 27 pid: 8478 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.747409:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147180.747468:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463522560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 156us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.747475:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5484 00000100:00100000:1.0:1746147180.748313:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463522432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12520us (12605us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.748326:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4172 00002000:00100000:1.0:1746147180.748335:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009f7cd880 x1830967463522432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.748344:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd880 with x1830967463522432 ext(1048576->2097151) 00002000:00010000:1.0:1746147180.748348:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cd880 00000100:00100000:0.0:1746147180.749097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.749160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.749214:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463522816 00000100:00100000:3.0:1746147180.749221:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463522816 00010000:00010000:3.0:1746147180.749244:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 14 pid: 6881 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.749266:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5485 00000100:00100000:3.0:1746147180.749271:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463522816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147180.749281:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147180.749298:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 14 pid: 6881 timeout: 667 lvb_type: 1 00010000:00010000:3.0:1746147180.749309:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 14 pid: 6881 timeout: 667 lvb_type: 1 00010000:00010000:3.0:1746147180.749327:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.749328:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147180.749334:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.749342:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.749373:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147180.749383:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466331136:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147180.749446:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00010000:00010000:1.0:1746147180.760259:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3a00/0xb4b2209fbdac5439 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c83 expref: 14 pid: 6881 timeout: 667 lvb_type: 1 00000100:00100000:1.0:1746147180.760279:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f732680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466330880:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147180.760347:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.760361:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb62200, rc 0) 00000100:00100000:1.0:1746147180.760419:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:28620:x1830967463521280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 44849us (45288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147180.760428:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11241 00000100:00100000:3.0:1746147180.760680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.760711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.762490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.762525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.762539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.762540:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463523072 00000100:00100000:1.0:1746147180.762546:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463523072 00010000:00010000:1.0:1746147180.762568:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 27 pid: 21080 timeout: 667 lvb_type: 1 00000100:00100000:3.0:1746147180.762573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.762595:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5488 00000100:00100000:1.0:1746147180.762601:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463523072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147180.762611:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147180.762628:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 28 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.762638:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 28 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.762664:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac554a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d0f expref: 28 pid: 21080 timeout: 667 lvb_type: 1 00010000:00010000:1.0:1746147180.762673:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.762674:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147180.762681:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.762688:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147180.762714:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147180.762725:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466331520:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147180.762766:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147180.762785:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4174 00000100:00100000:1.0:1746147180.762790:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463523712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.763196:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4175 00000100:00100000:0.0:1746147180.763203:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463523840:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147180.766875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.766925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.766955:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463524480 00000100:00100000:3.0:1746147180.766958:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463524480 00002000:00100000:3.0:1746147180.766980:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3760128->3764223) req@ffff8800a5ba2680 x1830967463524480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.766989:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2680 with x1830967463524480 ext(3760128->3764223) 00002000:00010000:3.0:1746147180.766994:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba2680 00000100:00100000:3.0:1746147180.767022:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4177 00000100:00100000:3.0:1746147180.767028:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463524480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147180.767145:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463524480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 116us (219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147180.767151:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4177 00002000:00100000:3.0:1746147180.767157:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3760128->3764223) req@ffff8800a5ba2680 x1830967463524480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.767164:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2680 with x1830967463524480 ext(3760128->3764223) 00002000:00010000:3.0:1746147180.767166:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba2680 00000100:00100000:0.0:1746147180.770662:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466331520:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147180.770687:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147180.770716:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463523072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8114us (8225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147180.770727:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5488 00000100:00100000:0.0:1746147180.772243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.784489:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463523712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21687us (21936us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.784502:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4174 00002000:00100000:1.0:1746147180.784514:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a5ba3100 x1830967463523712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.784524:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3100 with x1830967463523712 ext(1048576->2097151) 00002000:00010000:1.0:1746147180.784530:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3100 00000100:00100000:0.0:1746147180.792781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.793220:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463524224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 26196us (26355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147180.793228:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4176 00002000:00100000:3.0:1746147180.793233:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a5ba3480 x1830967463524224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.793240:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967463524224 ext(1048576->2097151) 00002000:00010000:3.0:1746147180.793244:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3480 00000100:00100000:0.0:1746147180.800321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.800384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.800461:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463525248 00000100:00100000:3.0:1746147180.800468:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463525248 00002000:00100000:3.0:1746147180.800512:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1765376->1769471) req@ffff88009f731180 x1830967463525248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.800522:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967463525248 ext(1765376->1769471) 00002000:00010000:3.0:1746147180.800527:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:3.0:1746147180.800560:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4180 00000100:00100000:3.0:1746147180.800568:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463525248:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147180.800737:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463525504 00000100:00100000:1.0:1746147180.800742:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463525504 00000100:00100000:3.0:1746147180.800761:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463525248:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 193us (449us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147180.800768:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4180 00002000:00100000:3.0:1746147180.800773:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1765376->1769471) req@ffff88009f731180 x1830967463525248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147180.800785:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4089 00000100:00100000:1.0:1746147180.800791:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28620:x1830967463525504:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147180.801040:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28620:x1830967463525504:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 249us (655us total) trans 8589944113 rc 0/0 00000100:00100000:1.0:1746147180.801047:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4089 00002000:00100000:3.0:1746147180.802281:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967463525248 ext(1765376->1769471) 00002000:00010000:3.0:1746147180.802287:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:0.0:1746147180.802960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.803852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.803919:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463525888 00000100:00100000:3.0:1746147180.803926:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463525888 00002000:00100000:3.0:1746147180.803982:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1093631) req@ffff88009f732300 x1830967463525888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.803991:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732300 with x1830967463525888 ext(1048576->1093631) 00002000:00010000:3.0:1746147180.803996:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732300 00000100:00100000:3.0:1746147180.804012:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4181 00000100:00100000:3.0:1746147180.804020:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463525888:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147180.807523:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463525888:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 3501us (3668us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1746147180.807532:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4181 00002000:00100000:3.0:1746147180.807541:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1093631) req@ffff88009f732300 x1830967463525888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 45056/45056 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.807550:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732300 with x1830967463525888 ext(1048576->1093631) 00010000:00010000:3.0:1746147180.807557:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 24 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.807569:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 24 pid: 17548 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.807577:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f732300 00000100:00100000:0.0:1746147180.808319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.808808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.809235:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463526400 00000100:00100000:3.0:1746147180.809239:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463526400 00002000:00100000:3.0:1746147180.809263:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1769472->2097151) req@ffff88009f733b80 x1830967463526400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.809271:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830967463526400 ext(1769472->2097151) 00010000:00010000:3.0:1746147180.809278:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 24 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.809288:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 24 pid: 17548 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.809294:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733b80 00000100:00100000:3.0:1746147180.809306:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1446 00000100:00100000:3.0:1746147180.809310:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463526400:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147180.812167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.812298:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463526528 00000100:00100000:0.0:1746147180.812307:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463526528 00002000:00100000:0.0:1746147180.812347:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1093632->1769471) req@ffff88009f7cf800 x1830967463526528/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.812358:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf800 with x1830967463526528 ext(1093632->1769471) 00010000:00010000:0.0:1746147180.812366:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 26 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.812385:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 26 pid: 17548 timeout: 667 lvb_type: 0 00002000:00010000:0.0:1746147180.812393:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cf800 00000100:00100000:0.0:1746147180.812418:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1447 00000100:00100000:0.0:1746147180.812424:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463526528:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147180.813885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.814929:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463526400:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 5614us (6117us total) trans 0 rc 327680/327680 00000100:00100000:3.0:1746147180.815295:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1446 00002000:00100000:3.0:1746147180.815304:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1769472->2097151) req@ffff88009f733b80 x1830967463526400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 327680/327680 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.815312:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830967463526400 ext(1769472->2097151) 00010000:00010000:3.0:1746147180.815318:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.815329:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.815339:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f733b80 00000100:00100000:0.0:1746147180.826809:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463526528:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14247us (14515us total) trans 21474840563 rc 0/0 00000100:00100000:0.0:1746147180.826824:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1447 00002000:00100000:0.0:1746147180.826835:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1093632->1769471) req@ffff88009f7cf800 x1830967463526528/t21474840563(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/448 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.826845:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf800 with x1830967463526528 ext(1093632->1769471) 00010000:00010000:0.0:1746147180.826855:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.826872:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00002000:00010000:0.0:1746147180.826879:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cf800 00000100:00100000:1.0:1746147180.835472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.836153:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463526784 00000100:00100000:0.0:1746147180.836237:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463526784 00010000:00010000:0.0:1746147180.836278:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00000100:00100000:0.0:1746147180.836324:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5489 00000100:00100000:0.0:1746147180.837028:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463526784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147180.837046:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147180.837068:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147178 -> 1746147180 00002000:00010000:0.0:1746147180.837070:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147178 -> 1746147180 00010000:00010000:0.0:1746147180.837076:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.837088:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.837109:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e036000/0xb4b2209fbdac555f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d24 expref: 27 pid: 17548 timeout: 667 lvb_type: 0 00010000:00010000:0.0:1746147180.838271:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.838275:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.838286:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.838294:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.838305:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.838306:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147180.838309:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.838319:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147180.838350:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.838360:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466331776:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147180.839314:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147180.839325:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466331904:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147180.839354:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147180.845099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.845982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.846509:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463527296 00000100:00100000:3.0:1746147180.846514:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463527296 00002000:00100000:3.0:1746147180.846538:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fae300 x1830967463527296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.846547:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967463527296 ext(1048576->2097151) 00002000:00010000:3.0:1746147180.846550:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:3.0:1746147180.846575:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4183 00000100:00100000:3.0:1746147180.846581:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463527296:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147180.860418:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463527296:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13827us (14427us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147180.860430:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4183 00002000:00100000:3.0:1746147180.860441:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fae300 x1830967463527296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.860450:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967463527296 ext(1048576->2097151) 00002000:00010000:3.0:1746147180.860456:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:0.0:1746147180.874046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.877888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.877915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.877965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.878614:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463527808 00000100:00100000:1.0:1746147180.878623:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463527808 00002000:00100000:1.0:1746147180.878670:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4fadc00 x1830967463527808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.878678:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967463527808 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.878682:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:1.0:1746147180.878725:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463528064 00000100:00100000:1.0:1746147180.878728:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463528064 00002000:00100000:1.0:1746147180.878739:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4fad880 x1830967463528064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 504/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.878745:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad880 with x1830967463528064 ext(3145728->4194303) 00002000:00010000:1.0:1746147180.878747:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fad880 00000100:00100000:1.0:1746147180.878761:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463527936 00000100:00100000:1.0:1746147180.878762:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463527936 00002000:00100000:1.0:1746147180.878771:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a4fad500 x1830967463527936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.878776:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad500 with x1830967463527936 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.878778:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fad500 00000100:00100000:1.0:1746147180.879072:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4184 00000100:00100000:1.0:1746147180.879080:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463527808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147180.882986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.883011:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463528192 00000100:00100000:0.0:1746147180.883018:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463528192 00002000:00100000:0.0:1746147180.883053:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a4fac000 x1830967463528192/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.883063:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967463528192 ext(3145728->4194303) 00002000:00010000:0.0:1746147180.883069:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac000 00000100:00100000:0.0:1746147180.883094:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4187 00000100:00100000:0.0:1746147180.883103:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463528192:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147180.896400:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463527808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17312us (18505us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.896412:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4184 00002000:00100000:1.0:1746147180.896422:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4fadc00 x1830967463527808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.896430:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadc00 with x1830967463527808 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.896434:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fadc00 00000100:00100000:0.0:1746147180.909295:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463528704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20464us (21561us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147180.909302:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4188 00002000:00100000:0.0:1746147180.909307:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f36a300 x1830967463528704/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147180.909314:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36a300 with x1830967463528704 ext(2097152->3145727) 00002000:00010000:0.0:1746147180.909317:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f36a300 00000100:00100000:0.0:1746147180.913750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.913809:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.913904:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463529088 00000100:00100000:3.0:1746147180.913912:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463529088 00000100:00100000:3.0:1746147180.913983:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11251 00000100:00100000:3.0:1746147180.913990:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28618:x1830967463529088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.914007:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.914025:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d40 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.914056:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.914063:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147180.914065:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147180.914069:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.915242:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.915254:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 41 pid: 6881 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.915267:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466332160:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147180.915352:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147180.919269:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466332160:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147180.919304:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147180.919321:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075e00, rc 0) 00000100:00100000:3.0:1746147180.919563:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28618:x1830967463529088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5572us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147180.919572:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11251 00000100:00100000:0.0:1746147180.920924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.921031:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463529216 00000100:00100000:3.0:1746147180.921038:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463529216 00002000:00100000:3.0:1746147180.921072:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3760128->4059135) req@ffff8800a4fad180 x1830967463529216/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.921082:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463529216 ext(3760128->4059135) 00010000:00010000:3.0:1746147180.921089:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.921102:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 42 pid: 6881 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.921109:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4fad180 00000100:00100000:3.0:1746147180.921135:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1448 00000100:00100000:3.0:1746147180.921142:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463529216:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147180.925474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.925690:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463529216:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4547us (4768us total) trans 17179873163 rc 0/0 00000100:00100000:3.0:1746147180.925698:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1448 00002000:00100000:3.0:1746147180.925706:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3760128->4059135) req@ffff8800a4fad180 x1830967463529216/t17179873163(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:556/0 lens 488/448 e 0 to 0 dl 1746147191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.925713:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463529216 ext(3760128->4059135) 00010000:00010000:3.0:1746147180.925719:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 46 pid: 6881 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.925730:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 46 pid: 6881 timeout: 667 lvb_type: 0 00002000:00010000:3.0:1746147180.925735:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4fad180 00000100:00100000:0.0:1746147180.929217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.929263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.929334:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463529600 00000100:00100000:3.0:1746147180.929340:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463529600 00000100:00100000:3.0:1746147180.929369:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11253 00000100:00100000:3.0:1746147180.929375:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967463529600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147180.929387:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147180.929401:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5589 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d4e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147180.929439:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466332416:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147180.929623:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147180.931402:0:6881:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a5ba1f80 x1830967466332416) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 46 pid: 6881 timeout: 667 lvb_type: 0 00010000:00010000:3.0:1746147180.931431:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb62200/0xb4b2209fbdac5535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3760128->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cf3 expref: 46 pid: 6881 timeout: 667 lvb_type: 0 00000100:00100000:3.0:1746147180.931462:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466332416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147180.931486:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5589 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d4e expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.931496:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a9200/0xb4b2209fbdac5589 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d4e expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147180.931503:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6a9200, rc 0) 00000100:00100000:3.0:1746147180.931549:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463529600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2173us (2285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147180.931559:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11253 00000100:00100000:0.0:1746147180.941800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.941844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147180.941899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147180.942069:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463530112 00000100:00100000:1.0:1746147180.942078:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463530112 00002000:00100000:1.0:1746147180.942111:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e977480 x1830967463530112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.942119:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967463530112 ext(3145728->4194303) 00002000:00010000:1.0:1746147180.942123:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977480 00000100:00100000:1.0:1746147180.942157:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4190 00000100:00100000:1.0:1746147180.942165:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463529856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147180.942180:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4191 00000100:00100000:3.0:1746147180.942195:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463530112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147180.958141:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463529856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15970us (16345us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147180.958150:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4190 00002000:00100000:1.0:1746147180.958158:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008e975f80 x1830967463529856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147180.958164:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e975f80 with x1830967463529856 ext(2097152->3145727) 00002000:00010000:1.0:1746147180.958168:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e975f80 00000100:00100000:3.0:1746147180.960883:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463530112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18684us (19027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147180.960896:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4191 00002000:00100000:3.0:1746147180.960907:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e977480 x1830967463530112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.960916:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967463530112 ext(3145728->4194303) 00002000:00010000:3.0:1746147180.960921:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e977480 00000100:00100000:0.0:1746147180.969350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147180.970872:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463530624 00000100:00100000:3.0:1746147180.970883:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463530624 00002000:00100000:3.0:1746147180.970927:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e974000 x1830967463530624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1746147191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.971018:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967463530624 ext(4194304->4870143) 00002000:00010000:3.0:1746147180.971023:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974000 00000100:00100000:3.0:1746147180.971602:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4193 00000100:00100000:3.0:1746147180.971612:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463530624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147180.980072:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463530624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8368us (10636us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147180.980084:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4193 00002000:00100000:3.0:1746147180.980095:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e974000 x1830967463530624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:556/0 lens 488/440 e 0 to 0 dl 1746147191 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147180.980111:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974000 with x1830967463530624 ext(4194304->4870143) 00002000:00010000:3.0:1746147180.980117:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974000 00000100:00100000:0.0:1746147180.986602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.029070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.029390:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463531136 00000100:00100000:3.0:1746147181.029399:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463531136 00000100:00100000:3.0:1746147181.029490:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10394 00000100:00100000:3.0:1746147181.029497:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28630:x1830967463531136:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.029520:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.029539:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d55 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.029658:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029670:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029682:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029693:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029698:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029702:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029798:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029808:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029813:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147181.029819:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147181.029892:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029897:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029902:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029907:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.029910:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029915:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029925:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.029928:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147181.029931:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.029956:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55a5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030232:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030242:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030247:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030251:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0a800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.030253:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030258:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030265:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147181.030267:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.030269:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030273:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac5597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030280:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030285:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030290:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030293:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0b800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.030295:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030303:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030308:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137000) 00010000:00010000:3.0:1746147181.030310:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.030311:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030316:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac559e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.030349:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5590 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d55 expref: 306 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.030356:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d55 expref: 306 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.030363:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0aa00, rc 0) 00000100:00100000:3.0:1746147181.030586:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28630:x1830967463531136:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1087us (1524us total) trans 8589944116 rc 301/301 00000100:00100000:3.0:1746147181.030593:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10394 00000100:00100000:0.0:1746147181.038132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.038249:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463531392 00000100:00100000:3.0:1746147181.038258:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463531392 00000100:00100000:3.0:1746147181.038316:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10395 00000100:00100000:3.0:1746147181.038323:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28632:x1830967463531392:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.038350:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.038371:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d5c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.038489:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038502:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038512:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038525:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038530:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038535:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038655:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038663:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038668:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147181.038677:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147181.038755:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038761:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038770:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038775:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0a400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.038778:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038784:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038794:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.038796:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147181.038800:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038804:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55c8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038823:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038828:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038833:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038837:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0ae00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.038839:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038844:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038852:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147181.038854:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.038856:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038860:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac55ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038867:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038872:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038876:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038880:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0ac00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.038882:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038887:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038891:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137600) 00010000:00010000:3.0:1746147181.038893:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.038895:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038899:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ac00/0xb4b2209fbdac55c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147181.038929:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d5c expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.038966:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d5c expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.038974:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0be00, rc 0) 00000100:00100000:3.0:1746147181.039032:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28632:x1830967463531392:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 709us (911us total) trans 8589944117 rc 301/301 00000100:00100000:3.0:1746147181.039039:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10395 00000100:00100000:0.0:1746147181.052864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.053010:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463531520 00000100:00100000:3.0:1746147181.053019:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463531520 00000100:00100000:3.0:1746147181.053074:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11254 00000100:00100000:3.0:1746147181.053080:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28630:x1830967463531520:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.053099:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.053119:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d63 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053147:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053156:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053161:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.053163:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.053167:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1335296->1687551] (req 1335296->1687551) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053199:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053211:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 25 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.053222:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466332672:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.053324:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.053332:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.053340:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466332800:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.053357:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.063712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.063829:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466332672:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147181.063839:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466332800:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147181.063871:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1335296->1687551] (req 1335296->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.063887:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0be00, rc 0) 00000100:00100000:0.0:1746147181.063969:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28630:x1830967463531520:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10888us (11114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.063977:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11254 00000100:00100000:3.0:1746147181.064372:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463531776 00000100:00100000:3.0:1746147181.064379:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463531776 00000100:00100000:3.0:1746147181.064424:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10396 00000100:00100000:3.0:1746147181.064430:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28635:x1830967463531776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.064450:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.064466:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac55dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d6a expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.064569:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064580:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064590:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064600:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064605:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064610:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064711:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064718:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.064723:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147181.064730:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147181.068816:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068831:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068838:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068852:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0a400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.068856:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068863:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068878:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.068881:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147181.068884:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068888:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a400/0xb4b2209fbdac55f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068921:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068926:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068930:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068933:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.068946:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068950:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068955:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147181.068957:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.068960:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068964:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ba00/0xb4b2209fbdac55e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068971:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068975:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068979:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068983:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0b400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.068984:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068988:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068992:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137000) 00010000:00010000:3.0:1746147181.068994:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.068995:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.068999:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b400/0xb4b2209fbdac55eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.069046:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac55dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d6a expref: 307 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.069052:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a800/0xb4b2209fbdac55dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d6a expref: 307 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.069059:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0a800, rc 0) 00000100:00100000:3.0:1746147181.069119:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28635:x1830967463531776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4688us (5416us total) trans 8589944118 rc 301/301 00000100:00100000:3.0:1746147181.069128:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10396 00000100:00100000:3.0:1746147181.073084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.073101:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463531904 00000100:00100000:3.0:1746147181.073104:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463531904 00010000:00010000:3.0:1746147181.073132:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.073151:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5491 00000100:00100000:3.0:1746147181.073156:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463531904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.073166:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.073185:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.073195:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.073218:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e037000/0xb4b2209fbdac556d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d32 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.073232:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746147181.073652:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147181.073674:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463532288 00000100:00100000:0.0:1746147181.073677:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463532288 00010000:00010000:0.0:1746147181.073693:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.073710:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5492 00000100:00100000:0.0:1746147181.073714:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463532288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.073721:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147181.073730:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.073738:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.073749:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e037c00/0xb4b2209fbdac5566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d2b expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.073766:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.073768:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.073775:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.073782:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.073812:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147181.073823:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466332928:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.074665:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463531904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1505us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.074675:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5491 00000100:00100000:0.0:1746147181.074754:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.077374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.077424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.077452:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463532672 00000100:00100000:1.0:1746147181.077459:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463532672 00000100:00100000:1.0:1746147181.077493:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11255 00000100:00100000:1.0:1746147181.077499:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463532672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147181.077516:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.077534:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea2ea00/0xb4b2209fbdac5600 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5d71 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.077554:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.077556:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.077564:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea2ea00/0xb4b2209fbdac5600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d71 expref: 44 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.077579:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea2ea00/0xb4b2209fbdac5600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d71 expref: 44 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.077589:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea2ea00, rc 0) 00000100:00100000:1.0:1746147181.077623:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463532672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 124us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.077632:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11255 00000100:00100000:0.0:1746147181.078119:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466332928:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147181.078142:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.078166:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463532288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4450us (5082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.078174:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5492 00000100:00100000:3.0:1746147181.079245:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463532544 00000100:00100000:3.0:1746147181.079252:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463532544 00002000:00100000:3.0:1746147181.079286:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1339391) req@ffff88009f7cdc00 x1830967463532544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.079296:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cdc00 with x1830967463532544 ext(1335296->1339391) 00002000:00010000:3.0:1746147181.079301:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cdc00 00000100:00100000:3.0:1746147181.079330:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4194 00000100:00100000:3.0:1746147181.079337:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463532544:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147181.079490:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463532544:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 154us (2121us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147181.079495:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4194 00002000:00100000:3.0:1746147181.079500:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1339391) req@ffff88009f7cdc00 x1830967463532544/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.079506:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cdc00 with x1830967463532544 ext(1335296->1339391) 00002000:00010000:3.0:1746147181.079509:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cdc00 00000100:00100000:0.0:1746147181.087569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.087616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.087695:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463533184 00000100:00100000:3.0:1746147181.087699:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463533184 00002000:00100000:3.0:1746147181.087716:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1683456->1687551) req@ffff88008e974e00 x1830967463533184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.087724:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967463533184 ext(1683456->1687551) 00002000:00010000:3.0:1746147181.087727:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:3.0:1746147181.088023:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4196 00000100:00100000:3.0:1746147181.088029:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463533184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147181.088127:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463533184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 98us (509us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147181.088132:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4196 00002000:00100000:3.0:1746147181.088137:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1683456->1687551) req@ffff88008e974e00 x1830967463533184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.088143:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967463533184 ext(1683456->1687551) 00002000:00010000:3.0:1746147181.088146:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:0.0:1746147181.093892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.097164:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.126387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.126435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.127444:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4199 00000100:00100000:0.0:1746147181.127453:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967463534080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.143650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1746147181.144004:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147181.153515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.156595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.157869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.157906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.158008:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463534848 00000100:00100000:3.0:1746147181.158012:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463534848 00010000:00010000:3.0:1746147181.158028:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.158043:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5494 00000100:00100000:3.0:1746147181.158048:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463534848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.158055:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.158065:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.158074:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.158087:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac557b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d40 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.158101:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.158103:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.158110:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.158118:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.158148:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.158159:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466333312:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.158213:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.160561:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466333312:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.160578:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.160608:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463534848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2558us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.160617:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5494 00000100:00100000:0.0:1746147181.161418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.164373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.170206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.175867:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466333696:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147181.175880:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466333824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147181.175887:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466333952:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147181.175927:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->3559423] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.175959:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bb200, rc 0) 00000100:00100000:0.0:1746147181.176004:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28632:x1830967463535360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5674us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.176013:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11260 00000100:00100000:0.0:1746147181.176591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.178002:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463535488 00000100:00100000:3.0:1746147181.178010:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463535488 00010000:00010000:3.0:1746147181.178057:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 15 pid: 8481 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.178094:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5495 00000100:00100000:3.0:1746147181.178101:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463535488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.178113:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.178136:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 15 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.178153:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 15 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.178176:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac5424 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c7c expref: 15 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.178193:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.178236:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463535488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.178242:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5495 00000100:00080000:0.0:1746147181.178301:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147181.188904:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463535616 00000100:00100000:1.0:1746147181.188913:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463535616 00010000:00010000:1.0:1746147181.188961:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 668 lvb_type: 1 00000100:00100000:1.0:1746147181.188987:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463535744 00000100:00100000:1.0:1746147181.188990:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463535744 00010000:00010000:1.0:1746147181.189001:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3000/0xb4b2209fbdac54b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cbb expref: 26 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:1.0:1746147181.189017:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5496 00000100:00100000:1.0:1746147181.189024:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463535616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147181.189035:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.189058:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189068:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189092:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac5558 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d16 expref: 27 pid: 21080 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189110:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147181.189151:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463535616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.189161:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5496 00000100:00100000:1.0:1746147181.189178:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5497 00000100:00100000:1.0:1746147181.189183:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463535744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147181.189189:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.189195:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3000/0xb4b2209fbdac54b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cbb expref: 26 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189204:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3000/0xb4b2209fbdac54b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cbb expref: 26 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189215:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3000/0xb4b2209fbdac54b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cbb expref: 26 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.189224:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.189226:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.189232:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.189240:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.189268:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.189279:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334080:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147181.189323:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.193137:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334080:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147181.193162:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147181.193219:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463535744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4034us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.193230:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5497 00000100:00100000:0.0:1746147181.200598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.203586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.204625:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463536256 00000100:00100000:1.0:1746147181.204633:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463536256 00000100:00100000:0.0:1746147181.222470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.226570:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463536640 00000100:00100000:3.0:1746147181.226578:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463536640 00000100:00100000:3.0:1746147181.226614:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10398 00000100:00100000:3.0:1746147181.226620:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28640:x1830967463536640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.226648:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.226664:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac564d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5da2 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.226745:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.226970:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.226980:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147181.227004:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147181.227009:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147181.227021:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.227039:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac564d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.227063:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.227070:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.227073:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147181.227077:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0aa00, rc 0) 00000100:00100000:3.0:1746147181.227966:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28640:x1830967463536640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1343us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.227974:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10398 00000100:00100000:0.0:1746147181.233969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.240810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.253586:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463537024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12349us (12775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147181.253599:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4202 00002000:00100000:3.0:1746147181.253614:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009e5e3100 x1830967463537024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.253624:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3100 with x1830967463537024 ext(0->1048575) 00002000:00010000:3.0:1746147181.253630:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3100 00000100:00100000:0.0:1746147181.270734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.279115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.279411:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463537280 00000100:00100000:3.0:1746147181.279421:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463537280 00002000:00100000:3.0:1746147181.279467:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1687551) req@ffff88009e5e3480 x1830967463537280/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.279478:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3480 with x1830967463537280 ext(1335296->1687551) 00010000:00010000:3.0:1746147181.279488:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.279502:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.279509:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e5e3480 00000100:00100000:3.0:1746147181.279525:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1449 00000100:00100000:3.0:1746147181.279531:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463537280:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147181.285288:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463537280:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5747us (6174us total) trans 21474840564 rc 0/0 00000100:00100000:3.0:1746147181.285299:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1449 00002000:00100000:3.0:1746147181.285309:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1687551) req@ffff88009e5e3480 x1830967463537280/t21474840564(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.285319:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3480 with x1830967463537280 ext(1335296->1687551) 00010000:00010000:3.0:1746147181.285328:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.285343:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.285350:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e5e3480 00000100:00100000:1.0:1746147181.294022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.294560:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463537408 00000100:00100000:0.0:1746147181.294568:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463537408 00010000:00010000:0.0:1746147181.294602:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.294648:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5498 00000100:00100000:0.0:1746147181.294656:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463537408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.294670:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147181.294693:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.294706:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.294728:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac55d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1687551) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d63 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.294745:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.294747:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.294754:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.294763:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.294803:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147181.294816:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334464:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147181.296440:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.296471:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334464:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147181.296490:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.298797:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463537408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4132us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.298812:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5498 00000100:00100000:0.0:1746147181.306102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.306211:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463537664 00000100:00100000:3.0:1746147181.306221:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463537664 00002000:00100000:3.0:1746147181.306264:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a5a0f480 x1830967463537664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.306280:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f480 with x1830967463537664 ext(1048576->2097151) 00002000:00010000:3.0:1746147181.306285:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0f480 00000100:00100000:3.0:1746147181.306303:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4203 00000100:00100000:3.0:1746147181.306309:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463537664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.322276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.326432:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463537920 00000100:00100000:3.0:1746147181.326445:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463537920 00000100:00100000:3.0:1746147181.326515:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10399 00000100:00100000:3.0:1746147181.326524:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:28643:x1830967463537920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.326698:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.326717:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5db7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.326855:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.326868:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.326878:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.326891:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.326896:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.326900:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327077:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327086:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327092:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147181.327101:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147181.327184:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327190:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327196:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327201:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0a000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.327205:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327211:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327220:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.327223:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147181.327226:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327230:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0a000/0xb4b2209fbdac567e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327262:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327267:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327271:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327275:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0be00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.327278:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327282:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327288:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147181.327290:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.327292:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327296:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0be00/0xb4b2209fbdac5670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327303:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327308:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327312:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327317:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc0b800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147181.327319:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327323:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327328:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137900) 00010000:00010000:3.0:1746147181.327330:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147181.327331:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327335:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0b800/0xb4b2209fbdac5677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.327367:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5669 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db7 expref: 310 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.327374:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0ae00/0xb4b2209fbdac5669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db7 expref: 310 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.327380:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc0ae00, rc 0) 00000100:00100000:3.0:1746147181.327429:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28643:x1830967463537920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 906us (5163us total) trans 8589944123 rc 301/301 00000100:00100000:3.0:1746147181.327435:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10399 00000100:00100000:0.0:1746147181.331672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.336455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.336801:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463538176 00000100:00100000:3.0:1746147181.336808:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463538176 00002000:00100000:3.0:1746147181.336848:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3559423) req@ffff8800a5a0c000 x1830967463538176/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.336857:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967463538176 ext(3145728->3559423) 00010000:00010000:3.0:1746147181.336864:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.336877:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 26 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.336883:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0c000 00000100:00100000:3.0:1746147181.336915:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1450 00000100:00100000:3.0:1746147181.336922:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463538176:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147181.338070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.338102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.338129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.338155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.338171:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463538432 00000100:00100000:0.0:1746147181.338175:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463538432 00002000:00100000:0.0:1746147181.338195:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a5a0c380 x1830967463538432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.338203:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c380 with x1830967463538432 ext(2097152->3145727) 00010000:00010000:0.0:1746147181.338209:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.338220:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:0.0:1746147181.338226:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0c380 00000100:00100000:0.0:1746147181.338236:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463538688 00000100:00100000:0.0:1746147181.338238:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463538688 00002000:00100000:0.0:1746147181.338247:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3559424->4194303) req@ffff8800a5a0df80 x1830967463538688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.338253:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0df80 with x1830967463538688 ext(3559424->4194303) 00010000:00010000:0.0:1746147181.338256:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.338264:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:0.0:1746147181.338269:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0df80 00000100:00100000:0.0:1746147181.338290:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463538944 00000100:00100000:0.0:1746147181.338293:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463538944 00002000:00100000:0.0:1746147181.338305:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3547135) req@ffff8800a5a0e680 x1830967463538944/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 504/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.338311:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e680 with x1830967463538944 ext(2097152->3547135) 00002000:00010000:0.0:1746147181.338314:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0e680 00000100:00100000:0.0:1746147181.338322:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463539200 00000100:00100000:0.0:1746147181.338324:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463539200 00002000:00100000:0.0:1746147181.338331:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3547136->4194303) req@ffff8800a5a0d880 x1830967463539200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.338342:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967463539200 ext(3547136->4194303) 00002000:00010000:0.0:1746147181.338345:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:0.0:1746147181.338354:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1452 00000100:00100000:0.0:1746147181.338359:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463538688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.338515:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4204 00000100:00100000:1.0:1746147181.338523:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463538944:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.339794:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4205 00000100:00100000:1.0:1746147181.339804:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463539200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147181.349681:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1958:x1830967463538176:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12747us (13223us total) trans 21474840565 rc 0/0 00000100:00100000:3.0:1746147181.349693:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1450 00002000:00100000:3.0:1746147181.349703:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3559423) req@ffff8800a5a0c000 x1830967463538176/t21474840565(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.349712:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0c000 with x1830967463538176 ext(3145728->3559423) 00010000:00010000:3.0:1746147181.349722:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.349738:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.349745:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0c000 00000100:00100000:1.0:1746147181.355312:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463538944:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16778us (17170us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147181.355326:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4204 00002000:00100000:1.0:1746147181.355338:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3547135) req@ffff8800a5a0e680 x1830967463538944/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 504/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.355349:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0e680 with x1830967463538944 ext(2097152->3547135) 00002000:00010000:1.0:1746147181.355356:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0e680 00000100:00100000:1.0:1746147181.356482:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463539200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16679us (18324us total) trans 0 rc 647168/647168 00000100:00100000:1.0:1746147181.356489:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4205 00002000:00100000:1.0:1746147181.356495:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3547136->4194303) req@ffff8800a5a0d880 x1830967463539200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.356507:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d880 with x1830967463539200 ext(3547136->4194303) 00002000:00010000:1.0:1746147181.356511:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0d880 00000100:00100000:3.0:1746147181.358571:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463538688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20204us (20461us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746147181.358581:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1452 00002000:00100000:3.0:1746147181.358590:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3559424->4194303) req@ffff8800a5a0df80 x1830967463538688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.358599:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0df80 with x1830967463538688 ext(3559424->4194303) 00010000:00010000:3.0:1746147181.358608:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 30 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.358622:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb200/0xb4b2209fbdac5623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d94 expref: 30 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.358628:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0df80 00000100:00100000:0.0:1746147181.374916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.376327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.382390:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334720:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.382405:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466334848:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.382430:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.382487:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463539712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4638us (6160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.382498:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5499 00000100:00100000:0.0:1746147181.383799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.388636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147181.390134:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a5a0fb80 x1830967463540224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.390144:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967463540224 ext(3145728->4194303) 00002000:00010000:3.0:1746147181.390150:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:3.0:1746147181.390182:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4207 00000100:00100000:3.0:1746147181.390189:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463540224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.390287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.402113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.402205:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463540736 00000100:00100000:1.0:1746147181.402214:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463540736 00000100:00100000:1.0:1746147181.402268:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4095 00000100:00100000:1.0:1746147181.402275:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28643:x1830967463540736:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147181.402510:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:28643:x1830967463540736:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 235us (406us total) trans 8589944125 rc 0/0 00000100:00100000:1.0:1746147181.402517:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4095 00000100:00100000:0.0:1746147181.403344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.403759:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463540224:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13569us (15132us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147181.403767:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4207 00002000:00100000:0.0:1746147181.403776:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a5a0fb80 x1830967463540224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.403785:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0fb80 with x1830967463540224 ext(3145728->4194303) 00002000:00010000:0.0:1746147181.403790:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0fb80 00000100:00100000:0.0:1746147181.410233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.412000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.412041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.412063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.412080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.412094:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463541632 00000100:00100000:0.0:1746147181.412099:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463541632 00000100:00100000:0.0:1746147181.412120:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11266 00000100:00100000:0.0:1746147181.412125:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463541632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.412135:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.412145:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa5f000/0xb4b2209fbdac56e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5de1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.412160:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.412166:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa5f000/0xb4b2209fbdac56e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5de1 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.412175:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa5f000/0xb4b2209fbdac56e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5de1 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.412185:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa5f000, rc 0) 00000100:00100000:0.0:1746147181.412203:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463541632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (122us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147181.412208:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11266 00000100:00100000:0.0:1746147181.412252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.412338:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463541760 00000100:00100000:1.0:1746147181.412342:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463541760 00000100:00100000:1.0:1746147181.412363:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11267 00000100:00100000:1.0:1746147181.412368:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463541760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147181.412375:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.412384:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4600/0xb4b2209fbdac56ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5de8 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.412399:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4600/0xb4b2209fbdac56ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5de8 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.412407:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4600/0xb4b2209fbdac56ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5de8 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.412417:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e4600, rc 0) 00000100:00100000:1.0:1746147181.412435:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463541760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 68us (183us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147181.412440:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11267 00000100:00100000:3.0:1746147181.412521:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463540992 00000100:00100000:3.0:1746147181.412524:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463540992 00010000:00010000:3.0:1746147181.412542:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 27 pid: 8478 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.412570:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463541120 00000100:00100000:3.0:1746147181.412572:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463541120 00010000:00010000:3.0:1746147181.412592:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 43 pid: 4445 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.412604:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463541504 00000100:00100000:3.0:1746147181.412606:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463541504 00000100:00100000:1.0:1746147181.412624:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5500 00010000:00010000:3.0:1746147181.412627:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 13 pid: 8481 timeout: 668 lvb_type: 1 00000100:00100000:1.0:1746147181.412630:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463540992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147181.412647:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147181.412649:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5501 00000100:00100000:3.0:1746147181.412655:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463541120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.412662:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.412666:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 27 pid: 8478 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.412670:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 43 pid: 4445 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.412675:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 27 pid: 8478 timeout: 668 lvb_type: 1 00000100:00080000:0.0:1746147181.412821:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147181.412836:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5502 00000100:00100000:0.0:1746147181.412843:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463541504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.412850:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.413206:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 43 pid: 4445 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.413222:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63400/0xb4b2209fbdac54a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cad expref: 27 pid: 8478 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.413226:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5b400/0xb4b2209fbdac5543 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d08 expref: 43 pid: 4445 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.413239:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147181.413246:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.413261:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967463541120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 606us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.413264:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463540992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 634us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.413266:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5501 00000100:00100000:1.0:1746147181.413270:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5500 00010000:00010000:0.0:1746147181.413306:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 13 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:0.0:1746147181.413315:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 13 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:0.0:1746147181.413332:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0ef600/0xb4b2209fbdac541d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c6e expref: 13 pid: 8481 timeout: 668 lvb_type: 1 00010000:00010000:0.0:1746147181.413341:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.413342:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.413349:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.413357:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.413383:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147181.413393:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466335360:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147181.413442:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.415455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.415512:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463542016 00000100:00100000:1.0:1746147181.415518:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463542016 00000100:00100000:1.0:1746147181.415559:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4096 00000100:00100000:1.0:1746147181.415565:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:28648:x1830967463542016:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147181.415749:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28648:x1830967463542016:12345-192.168.203.36@tcp:35:cat.0 Request processed in 183us (295us total) trans 8589944127 rc 0/0 00000100:00100000:1.0:1746147181.415754:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4096 00000100:00100000:0.0:1746147181.416386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.416405:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463542272 00000100:00100000:1.0:1746147181.416409:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463542272 00002000:00100000:1.0:1746147181.416433:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1097728->1101823) req@ffff88008e134380 x1830967463542272/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.416442:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134380 with x1830967463542272 ext(1097728->1101823) 00002000:00010000:1.0:1746147181.416445:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134380 00000100:00100000:1.0:1746147181.416456:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4209 00000100:00100000:1.0:1746147181.416461:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463542272:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.416596:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463542272:12345-192.168.203.36@tcp:3:cat.0 Request processed in 134us (209us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147181.416602:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4209 00002000:00100000:1.0:1746147181.416607:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1097728->1101823) req@ffff88008e134380 x1830967463542272/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.416614:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134380 with x1830967463542272 ext(1097728->1101823) 00002000:00010000:1.0:1746147181.416617:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134380 00000100:00100000:0.0:1746147181.417375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.417456:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463542528 00000100:00100000:1.0:1746147181.417459:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463542528 00002000:00100000:1.0:1746147181.417475:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e135f80 x1830967463542528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.417483:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135f80 with x1830967463542528 ext(4194304->4870143) 00002000:00010000:1.0:1746147181.417486:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135f80 00000100:00100000:1.0:1746147181.417495:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4210 00000100:00100000:1.0:1746147181.417500:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463542528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.420179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.420764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.420999:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463542656 00000100:00100000:3.0:1746147181.421003:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463542656 00000100:00100000:3.0:1746147181.421027:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11268 00000100:00100000:3.0:1746147181.421033:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463542784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.421050:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.421067:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5df6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.421089:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.421090:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.421099:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.421114:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.421124:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772600, rc 0) 00000100:00100000:3.0:1746147181.421163:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463542784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 131us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.421169:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11268 00000100:00100000:3.0:1746147181.421186:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11269 00000100:00100000:3.0:1746147181.421191:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463542656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.421198:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.421213:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4772800/0xb4b2209fbdac56fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5def expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.421250:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466335488:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147181.421303:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.422455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.423019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.423319:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463543168 00000100:00100000:0.0:1746147181.423323:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463543168 00000100:00100000:0.0:1746147181.423345:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11270 00000100:00100000:0.0:1746147181.423350:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463543168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.423360:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.423372:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa5fc00/0xb4b2209fbdac5703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5dfd expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.423396:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa5fc00/0xb4b2209fbdac5703 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dfd expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.423405:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa5fc00/0xb4b2209fbdac5703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dfd expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.423413:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa5fc00, rc 0) 00000100:00100000:0.0:1746147181.423438:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463543168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (419us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147181.423444:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11270 00002000:00010000:3.0:1746147181.424101:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147180 -> 1746147181 00002000:00010000:3.0:1746147181.424108:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147179 -> 1746147181 00002000:00010000:3.0:1746147181.424110:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147180 -> 1746147181 00000100:00100000:3.0:1746147181.424131:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466335488:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147181.424137:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463542528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6634us (6760us total) trans 0 rc 675840/675840 00010000:00010000:3.0:1746147181.424159:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4772800/0xb4b2209fbdac56fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5def expref: 43 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.424172:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772800/0xb4b2209fbdac56fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5def expref: 43 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.424187:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772800, rc 0) 00000100:00100000:3.0:1746147181.424228:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463542656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3036us (3464us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.424235:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11269 00000100:00100000:1.0:1746147181.424351:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4210 00002000:00100000:1.0:1746147181.424358:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e135f80 x1830967463542528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.424366:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135f80 with x1830967463542528 ext(4194304->4870143) 00000100:00100000:0.0:1746147181.424366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147181.424370:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135f80 00000100:00100000:0.0:1746147181.425379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.427468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.432485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.433747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.433833:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463543936 00000100:00100000:1.0:1746147181.433836:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463543936 00000100:00100000:1.0:1746147181.433856:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11274 00000100:00100000:1.0:1746147181.433860:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463543936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147181.433867:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.433874:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4e00/0xb4b2209fbdac571f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e19 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.433889:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4e00/0xb4b2209fbdac571f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e19 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.433897:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e4e00/0xb4b2209fbdac571f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e19 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.433908:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e4e00, rc 0) 00000100:00100000:1.0:1746147181.433933:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463543936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 72us (185us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147181.433954:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11274 00000100:00100000:0.0:1746147181.441335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.441371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.441446:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463544064 00000100:00100000:1.0:1746147181.441456:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463544064 00002000:00100000:1.0:1746147181.441492:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1097728->1556479) req@ffff88008e134a80 x1830967463544064/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.441499:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463544064 ext(1097728->1556479) 00010000:00010000:1.0:1746147181.441506:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 25 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.441518:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 25 pid: 17548 timeout: 668 lvb_type: 0 00002000:00010000:1.0:1746147181.441524:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e134a80 00000100:00100000:1.0:1746147181.441548:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1453 00000100:00100000:1.0:1746147181.441555:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463544064:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147181.442030:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463544320 00000100:00100000:3.0:1746147181.442033:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463544320 00000100:00100000:3.0:1746147181.442057:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4098 00000100:00100000:3.0:1746147181.442062:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28640:x1830967463544320:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147181.442180:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28640:x1830967463544320:12345-192.168.203.36@tcp:35:cat.0 Request processed in 117us (808us total) trans 8589944129 rc 0/0 00000100:00100000:3.0:1746147181.442184:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4098 00000100:00100000:1.0:1746147181.451371:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463544064:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9810us (10037us total) trans 17179873164 rc 0/0 00000100:00100000:1.0:1746147181.451380:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1453 00002000:00100000:1.0:1746147181.451391:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41d:0x0] (1097728->1556479) req@ffff88008e134a80 x1830967463544064/t17179873164(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.451399:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463544064 ext(1097728->1556479) 00010000:00010000:1.0:1746147181.451407:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 27 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.451421:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba600/0xb4b2209fbdac56bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dd3 expref: 27 pid: 17548 timeout: 668 lvb_type: 0 00002000:00010000:1.0:1746147181.451426:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e134a80 00000100:00100000:0.0:1746147181.454391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.462666:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466335872:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147181.462668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147181.462685:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.462703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.462726:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463544448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8179us (8341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.462735:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5503 00000100:00100000:1.0:1746147181.462757:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463544832 00000100:00100000:1.0:1746147181.462764:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463544832 00000100:00100000:3.0:1746147181.462772:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463544960 00000100:00100000:3.0:1746147181.462775:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463544960 00002000:00100000:3.0:1746147181.462797:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008e136d80 x1830967463544960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.462797:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e137480 x1830967463544832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.462805:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137480 with x1830967463544832 ext(1048576->2097151) 00002000:00100000:3.0:1746147181.462806:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136d80 with x1830967463544960 ext(1048576->2097151) 00002000:00010000:3.0:1746147181.462809:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e136d80 00002000:00010000:1.0:1746147181.462809:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137480 00000100:00100000:1.0:1746147181.462830:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4212 00000100:00100000:3.0:1746147181.462840:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4213 00000100:00100000:3.0:1746147181.462846:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463544960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.462849:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463544832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.475803:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463544832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12957us (13134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147181.475814:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4212 00002000:00100000:1.0:1746147181.475825:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e137480 x1830967463544832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.475833:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137480 with x1830967463544832 ext(1048576->2097151) 00002000:00010000:1.0:1746147181.475838:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137480 00000100:00100000:3.0:1746147181.477344:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463544960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14492us (14635us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147181.477353:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4213 00002000:00100000:3.0:1746147181.477361:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008e136d80 x1830967463544960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.477369:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136d80 with x1830967463544960 ext(1048576->2097151) 00002000:00010000:3.0:1746147181.477374:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e136d80 00000100:00100000:0.0:1746147181.482697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.483600:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463545088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 146us (910us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147181.483610:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11275 00000100:00100000:0.0:1746147181.483868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.483882:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463545216 00000100:00100000:0.0:1746147181.483886:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463545216 00000100:00100000:0.0:1746147181.483904:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11276 00000100:00100000:0.0:1746147181.483908:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463545216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.483915:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.483924:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df16e00/0xb4b2209fbdac572d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e27 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147181.484404:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e683480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466336000:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147181.484479:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147181.488273:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e683480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466336000:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147181.488304:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df16e00/0xb4b2209fbdac572d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e27 expref: 44 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.488324:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df16e00/0xb4b2209fbdac572d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e27 expref: 44 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.488333:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16e00, rc 0) 00000100:00100000:2.0:1746147181.488389:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463545216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4479us (4520us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147181.488397:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11276 00000100:00100000:0.0:1746147181.497969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.498256:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463545472 00000100:00100000:3.0:1746147181.498266:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463545472 00002000:00100000:3.0:1746147181.498308:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e683100 x1830967463545472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 504/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.498317:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683100 with x1830967463545472 ext(2097152->3145727) 00002000:00010000:3.0:1746147181.498321:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e683100 00000100:00100000:3.0:1746147181.498350:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4214 00000100:00100000:3.0:1746147181.498358:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463545472:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147181.514214:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463545472:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15848us (16276us total) trans 0 rc 1011712/1011712 00000100:00100000:3.0:1746147181.514223:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4214 00002000:00100000:3.0:1746147181.514235:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e683100 x1830967463545472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 504/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.514242:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683100 with x1830967463545472 ext(2097152->3145727) 00002000:00010000:3.0:1746147181.514247:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e683100 00000100:00100000:0.0:1746147181.519686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.519776:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463545600 00000100:00100000:2.0:1746147181.519786:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463545600 00000100:00100000:2.0:1746147181.519837:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11277 00000100:00100000:2.0:1746147181.519845:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:28648:x1830967463545600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.519862:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.519880:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e2e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.519908:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.519915:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.519916:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.519919:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 44 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.519965:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.519976:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 25 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.519985:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466336128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.520048:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.521973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.522060:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463545728 00000100:00100000:3.0:1746147181.522067:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463545728 00002000:00100000:3.0:1746147181.522105:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2744320->3145727) req@ffff88009e681500 x1830967463545728/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.522113:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967463545728 ext(2744320->3145727) 00010000:00010000:3.0:1746147181.522121:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.522132:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 26 pid: 17548 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.522137:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e681500 00000100:00100000:2.0:1746147181.522138:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466336128:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.522151:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1454 00000100:00100000:3.0:1746147181.522158:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463545728:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147181.522162:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 44 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.522173:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e3e00, rc 0) 00000100:00100000:2.0:1746147181.522200:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28648:x1830967463545600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2356us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.522206:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11277 00000100:00100000:3.0:1746147181.525829:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463545728:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3662us (3851us total) trans 17179873165 rc 0/0 00000100:00100000:3.0:1746147181.525839:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1454 00002000:00100000:3.0:1746147181.528375:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2744320->3145727) req@ffff88009e681500 x1830967463545728/t17179873165(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.528391:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967463545728 ext(2744320->3145727) 00010000:00010000:3.0:1746147181.528404:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.528418:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.528425:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e681500 00000100:00100000:0.0:1746147181.531525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.531700:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463545856 00000100:00100000:3.0:1746147181.531710:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463545856 00010000:00010000:3.0:1746147181.531743:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.531775:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5504 00000100:00100000:3.0:1746147181.531785:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463545856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.531797:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.531819:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.531829:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.531850:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bbe00/0xb4b2209fbdac5607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d78 expref: 28 pid: 17548 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.531882:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.531884:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.531890:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 43 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.531897:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 43 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.531924:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 43 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.531933:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466336256:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.533411:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.536086:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466336256:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.536105:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.536315:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463545856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4528us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.536325:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5504 00000100:00100000:0.0:1746147181.539765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.541057:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463546112 00000100:00100000:2.0:1746147181.541068:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463546112 00002000:00100000:2.0:1746147181.541107:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e680e00 x1830967463546112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.541117:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680e00 with x1830967463546112 ext(2097152->3145727) 00002000:00010000:2.0:1746147181.541121:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680e00 00000100:00100000:2.0:1746147181.541319:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4215 00000100:00100000:2.0:1746147181.541327:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463546112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.551288:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463546112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9952us (11521us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147181.551299:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4215 00002000:00100000:0.0:1746147181.551309:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e680e00 x1830967463546112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.551317:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680e00 with x1830967463546112 ext(2097152->3145727) 00002000:00010000:0.0:1746147181.551322:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680e00 00000100:00100000:0.0:1746147181.556530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.556612:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463546368 00000100:00100000:1.0:1746147181.556621:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463546368 00000100:00100000:1.0:1746147181.556688:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4099 00000100:00100000:1.0:1746147181.556696:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+6:28612:x1830967463546368:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147181.556877:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28612:x1830967463546368:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 181us (355us total) trans 8589944130 rc 0/0 00000100:00100000:1.0:1746147181.556884:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4099 00000100:00080000:0.0:1746147181.556958:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147181.561220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.561301:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463546624 00000100:00100000:1.0:1746147181.561310:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463546624 00000100:00100000:1.0:1746147181.561800:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4100 00000100:00100000:1.0:1746147181.561810:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28612:x1830967463546624:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147181.562016:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28612:x1830967463546624:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 207us (802us total) trans 8589944131 rc 0/0 00000100:00100000:1.0:1746147181.562023:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4100 00000100:00100000:0.0:1746147181.564863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.564969:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463546752 00000100:00100000:2.0:1746147181.564978:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463546752 00000100:00100000:2.0:1746147181.565027:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11278 00000100:00100000:2.0:1746147181.565034:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28648:x1830967463546752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.565050:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.565064:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e35 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.565086:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.565087:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.565093:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.565106:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.565115:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e2e00, rc 0) 00000100:00100000:2.0:1746147181.565148:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28648:x1830967463546752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.565154:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11278 00000100:00100000:0.0:1746147181.573107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.573519:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547008 00000100:00100000:2.0:1746147181.573529:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547008 00000100:00100000:2.0:1746147181.573580:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10402 00000100:00100000:2.0:1746147181.573589:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28655:x1830967463547008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.573608:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.573623:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3600/0xb4b2209fbdac5742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e3c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.573722:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573733:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573742:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573750:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573755:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573759:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573843:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3000/0xb4b2209fbdac5757 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573851:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3000/0xb4b2209fbdac5757 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573856:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3000/0xb4b2209fbdac5757 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147181.573863:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147181.573927:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573932:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573965:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573970:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a64e3800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147181.573973:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573978:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573986:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147181.573988:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147181.573992:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.573996:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3800/0xb4b2209fbdac5749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574021:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574025:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574029:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574032:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a64e3200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147181.574034:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574037:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574045:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76e00) 00010000:00010000:2.0:1746147181.574047:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147181.574049:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574052:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3200/0xb4b2209fbdac5750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147181.574079:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3600/0xb4b2209fbdac5742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e3c expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.574088:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3000/0xb4b2209fbdac5757 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e3c expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.574093:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147181.574095:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147181.574096:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e3000, rc 0) 00000100:00100000:2.0:1746147181.574135:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28655:x1830967463547008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 547us (1034us total) trans 8589944132 rc 0/0 00000100:00100000:2.0:1746147181.574140:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10402 00000100:00100000:0.0:1746147181.578186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.578220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.578243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.578272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.578286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.578296:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547648 00000100:00100000:3.0:1746147181.578307:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547648 00000100:00100000:0.0:1746147181.578313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.578339:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547776 00000100:00100000:0.0:1746147181.578342:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547776 00000100:00100000:3.0:1746147181.578355:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 579 00000100:00100000:0.0:1746147181.578360:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547904 00000100:00100000:0.0:1746147181.578361:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547904 00000100:00100000:3.0:1746147181.578362:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463547648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147181.578369:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548032 00000100:00100000:0.0:1746147181.578371:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548032 00010000:00010000:3.0:1746147181.578375:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147181.578382:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11279 00000100:00100000:1.0:1746147181.578391:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463547776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.578394:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e3000/0xb4b2209fbdac5757 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e3c expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.578403:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.578413:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.578417:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147181.578418:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e43 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.578435:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.578436:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.578443:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147181.578452:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463547648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147181.578456:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147181.578458:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 579 00010000:00010000:1.0:1746147181.578464:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e5600, rc 0) 00000100:00100000:1.0:1746147181.578483:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463547776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.578530:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11280 00000100:00100000:3.0:1746147181.578536:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11281 00000100:00100000:0.0:1746147181.578537:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463547904:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147181.578540:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11279 00000100:00100000:3.0:1746147181.578542:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463548032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.578545:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.578548:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.578553:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df17000/0xb4b2209fbdac576c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e4a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.578554:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e51 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.578556:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547392 00000100:00100000:1.0:1746147181.578559:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547392 00010000:00010000:3.0:1746147181.578564:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.578565:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.578569:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.578570:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df17000/0xb4b2209fbdac576c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e4a expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746147181.578577:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e681c00 x1830967463547392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147181.578577:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df17000/0xb4b2209fbdac576c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e4a expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.578578:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.578584:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772400, rc 0) 00010000:00010000:0.0:1746147181.578587:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17000, rc 0) 00002000:00100000:1.0:1746147181.578591:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463547392 ext(3145728->4194303) 00002000:00010000:1.0:1746147181.578594:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681c00 00000100:00100000:3.0:1746147181.578599:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463548032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.578603:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463547904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 67us (316us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.578604:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11281 00000100:00100000:1.0:1746147181.578606:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463547520 00000100:00100000:1.0:1746147181.578607:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463547520 00000100:00100000:0.0:1746147181.578608:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11280 00002000:00100000:1.0:1746147181.578617:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e682680 x1830967463547520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.578622:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682680 with x1830967463547520 ext(3145728->4194303) 00002000:00010000:1.0:1746147181.578625:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682680 00000100:00100000:1.0:1746147181.578656:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4216 00000100:00100000:1.0:1746147181.578661:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463547392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.578664:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4217 00000100:00100000:0.0:1746147181.578670:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463547520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.595894:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463547520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17215us (17664us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147181.595905:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4217 00002000:00100000:2.0:1746147181.595916:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e682680 x1830967463547520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.595924:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682680 with x1830967463547520 ext(3145728->4194303) 00002000:00010000:2.0:1746147181.595929:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682680 00000100:00100000:1.0:1746147181.598588:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463547392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19916us (20399us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147181.598599:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4216 00002000:00100000:1.0:1746147181.598611:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e681c00 x1830967463547392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.598620:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463547392 ext(3145728->4194303) 00002000:00010000:1.0:1746147181.598625:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681c00 00000100:00100000:0.0:1746147181.604685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.604747:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548160 00000100:00100000:3.0:1746147181.604757:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548160 00000100:00100000:3.0:1746147181.604807:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11282 00000100:00100000:3.0:1746147181.604815:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463548160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.604831:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.604844:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773000/0xb4b2209fbdac577a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e58 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.604868:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773000/0xb4b2209fbdac577a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e58 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.604877:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773000/0xb4b2209fbdac577a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e58 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.604888:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773000, rc 0) 00000100:00100000:3.0:1746147181.604924:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463548160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 109us (245us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.604929:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11282 00000100:00100000:0.0:1746147181.608829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.608898:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548416 00000100:00100000:1.0:1746147181.608907:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548416 00002000:00100000:1.0:1746147181.608994:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009050aa00 x1830967463548416/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.609004:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050aa00 with x1830967463548416 ext(4194304->4870143) 00002000:00010000:1.0:1746147181.609008:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050aa00 00000100:00100000:1.0:1746147181.609040:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4218 00000100:00100000:1.0:1746147181.609047:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463548416:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.611001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.611049:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548672 00000100:00100000:2.0:1746147181.611057:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548672 00002000:00100000:2.0:1746147181.611085:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009050ad80 x1830967463548672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.611094:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050ad80 with x1830967463548672 ext(1048576->2097151) 00002000:00010000:2.0:1746147181.611099:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050ad80 00000100:00100000:2.0:1746147181.611117:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4219 00000100:00100000:2.0:1746147181.611123:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463548672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147181.616550:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463548416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7496us (7721us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147181.616560:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4218 00002000:00100000:1.0:1746147181.616572:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009050aa00 x1830967463548416/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.616581:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050aa00 with x1830967463548416 ext(4194304->4870143) 00002000:00010000:1.0:1746147181.616585:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050aa00 00000100:00100000:0.0:1746147181.619378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.619461:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548800 00000100:00100000:3.0:1746147181.619469:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548800 00000100:00100000:3.0:1746147181.619503:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11283 00000100:00100000:3.0:1746147181.619510:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463548800:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147181.619525:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463548672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8401us (8528us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147181.619532:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4219 00002000:00100000:2.0:1746147181.619541:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009050ad80 x1830967463548672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.619548:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050ad80 with x1830967463548672 ext(1048576->2097151) 00002000:00010000:2.0:1746147181.619553:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050ad80 00010000:00010000:3.0:1746147181.619733:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.619748:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773200/0xb4b2209fbdac5781 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e5f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.619773:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773200/0xb4b2209fbdac5781 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e5f expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.619781:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773200/0xb4b2209fbdac5781 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e5f expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.619794:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773200, rc 0) 00000100:00100000:3.0:1746147181.619812:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463548800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 303us (440us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.619817:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11283 00000100:00100000:0.0:1746147181.624025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.624348:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463548928 00000100:00100000:3.0:1746147181.624358:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463548928 00000100:00100000:3.0:1746147181.624395:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11284 00000100:00100000:3.0:1746147181.624401:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463548928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.624417:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.624429:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac5788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e66 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.624453:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac5788 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e66 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.624462:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac5788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e66 expref: 31 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.624470:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773400, rc 0) 00000100:00100000:3.0:1746147181.624507:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463548928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 105us (489us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.624512:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11284 00000100:00100000:1.0:1746147181.628782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.628844:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549184 00000100:00100000:0.0:1746147181.628853:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549184 00000100:00100000:0.0:1746147181.628924:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10403 00000100:00100000:0.0:1746147181.628930:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28657:x1830967463549184:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147181.628959:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.628972:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c600/0xb4b2209fbdac578f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e6d expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.629051:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629060:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629068:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629076:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629080:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629084:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629157:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629163:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629167:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147181.629173:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147181.629242:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629248:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629252:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629257:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a750c800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.629260:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629266:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629275:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147181.629277:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.629280:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629284:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c800/0xb4b2209fbdac5796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629608:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629613:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629617:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629620:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a750ca00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.629622:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629625:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629631:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48700) 00010000:00010000:0.0:1746147181.629632:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.629634:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.629646:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750ca00/0xb4b2209fbdac579d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.630125:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750c600/0xb4b2209fbdac578f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.630149:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 314 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.630154:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147181.630157:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147181.630158:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a750cc00, rc 0) 00000100:00100000:2.0:1746147181.630540:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:28657:x1830967463549184:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1607us (1762us total) trans 8589944133 rc 0/0 00000100:00100000:2.0:1746147181.630549:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10403 00000100:00100000:0.0:1746147181.632684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.632739:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549312 00000100:00100000:1.0:1746147181.632748:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549312 00000100:00100000:1.0:1746147181.632793:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11285 00000100:00100000:1.0:1746147181.632802:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28655:x1830967463549312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147181.632817:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.632833:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e74 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.632856:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.632861:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147181.632862:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147181.632865:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.632893:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.632902:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.632911:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466336384:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147181.633016:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.639616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.639723:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466336384:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147181.639748:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.639762:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e5c00, rc 0) 00000100:00100000:1.0:1746147181.639799:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28655:x1830967463549312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6999us (7123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.639807:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11285 00000100:00100000:2.0:1746147181.639892:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549440 00000100:00100000:2.0:1746147181.639899:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549440 00002000:00100000:2.0:1746147181.639930:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3067904->3104767) req@ffff880090508700 x1830967463549440/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.639961:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967463549440 ext(3067904->3104767) 00010000:00010000:2.0:1746147181.639967:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 30 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.639977:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 30 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:2.0:1746147181.639982:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090508700 00000100:00100000:2.0:1746147181.639996:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1455 00000100:00100000:2.0:1746147181.640002:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463549440:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147181.643810:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463549440:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3801us (4195us total) trans 21474840566 rc 0/0 00000100:00100000:2.0:1746147181.643821:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1455 00002000:00100000:2.0:1746147181.643832:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3067904->3104767) req@ffff880090508700 x1830967463549440/t21474840566(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.643841:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967463549440 ext(3067904->3104767) 00010000:00010000:2.0:1746147181.643849:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.643865:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00002000:00010000:2.0:1746147181.643871:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090508700 00000100:00100000:0.0:1746147181.649464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.651151:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549568 00000100:00100000:2.0:1746147181.651161:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549568 00010000:00010000:2.0:1746147181.651196:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.651782:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5505 00000100:00100000:2.0:1746147181.651790:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463549568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.651803:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147181.651818:0:16058:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147179 -> 1746147181 00010000:00010000:2.0:1746147181.651823:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.651834:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.651853:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bbc00/0xb4b2209fbdac568c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3104767) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dbe expref: 32 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.653074:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.653078:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.653087:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.653103:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.653137:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147181.653148:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466336512:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147181.653235:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.657719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.657930:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549824 00000100:00100000:2.0:1746147181.657964:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549824 00000100:00100000:2.0:1746147181.658008:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10404 00000100:00100000:2.0:1746147181.658016:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28659:x1830967463549824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147181.658039:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.658055:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac57b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e7b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.658129:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.658142:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.658148:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.658153:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 313 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.658159:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.658187:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 313 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.658197:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.658207:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336640:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.661756:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.661772:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 19 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.661783:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336768:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.662428:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466336512:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.662444:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.662470:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463549568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10681us (13013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.662478:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5505 00010000:00010000:2.0:1746147181.662567:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.662575:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.662582:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336896:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.662621:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.663983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.664864:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463549952 00000100:00100000:2.0:1746147181.664872:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463549952 00000100:00100000:2.0:1746147181.665064:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11286 00000100:00100000:2.0:1746147181.665071:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28657:x1830967463549952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147181.665086:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.665099:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e82 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.665122:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.665129:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.665134:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.665135:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.665137:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 45 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.665157:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.665165:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 28 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:2.0:1746147181.665173:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466337024:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.665603:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.665615:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.665622:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466337152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.665651:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.667079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.667133:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463550080 00000100:00100000:3.0:1746147181.667140:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463550080 00010000:00010000:3.0:1746147181.667162:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 314 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.667180:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5506 00000100:00100000:3.0:1746147181.667186:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1958:x1830967463550080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.667195:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.667199:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 314 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.667208:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 314 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.667226:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.667230:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.667237:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.667241:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147181.668185:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a750cc00/0xb4b2209fbdac57a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e6d expref: 314 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.668492:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1958:x1830967463550080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1305us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.668499:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5506 00000100:00100000:2.0:1746147181.668811:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336640:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.670874:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336768:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.670886:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466336896:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.670913:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147181.670999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.671123:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466337024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.671131:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466337152:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.671149:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 45 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.671163:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9ba200, rc 0) 00000100:00100000:3.0:1746147181.671213:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+45:28657:x1830967463549952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6142us (7233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.671220:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11286 00000100:00100000:0.0:1746147181.671316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.671336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.671439:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463550720 00000100:00100000:1.0:1746147181.671444:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463550720 00002000:00100000:1.0:1746147181.671477:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090508a80 x1830967463550720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.671484:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967463550720 ext(3145728->4194303) 00010000:00010000:1.0:1746147181.671489:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 29 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.671502:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 29 pid: 4444 timeout: 668 lvb_type: 1 00002000:00010000:1.0:1746147181.671508:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090508a80 00000100:00100000:1.0:1746147181.671519:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463550464 00000100:00100000:1.0:1746147181.671521:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463550464 00002000:00100000:1.0:1746147181.671528:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090508380 x1830967463550464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.671534:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508380 with x1830967463550464 ext(2097152->3145727) 00010000:00010000:1.0:1746147181.671537:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 30 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.671543:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 30 pid: 4444 timeout: 668 lvb_type: 1 00002000:00010000:1.0:1746147181.671547:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090508380 00000100:00100000:1.0:1746147181.671552:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551104 00000100:00100000:1.0:1746147181.671553:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551104 00002000:00100000:1.0:1746147181.671560:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009050b100 x1830967463551104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.671565:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050b100 with x1830967463551104 ext(2097152->3145727) 00002000:00010000:1.0:1746147181.671568:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050b100 00000100:00100000:1.0:1746147181.671574:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1456 00000100:00100000:1.0:1746147181.671579:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463550720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.672006:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1457 00000100:00100000:2.0:1746147181.672012:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463550464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147181.672179:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4220 00000100:00100000:3.0:1746147181.672187:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463551104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.672797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.672814:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463550592 00000100:00100000:0.0:1746147181.672819:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463550592 00010000:00010000:0.0:1746147181.672837:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.672852:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5507 00000100:00100000:0.0:1746147181.672857:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1959:x1830967463550592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.672866:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147181.672870:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.672879:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.672894:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e037400/0xb4b2209fbdac5527 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cec expref: 313 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.672908:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147181.672912:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.672918:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.672922:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.672963:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1959:x1830967463550592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.672971:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5507 00000100:00100000:0.0:1746147181.673001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.673011:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551232 00000100:00100000:0.0:1746147181.673014:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551232 00010000:00010000:0.0:1746147181.673024:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.673037:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5508 00000100:00100000:0.0:1746147181.673041:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967463551232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.673048:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147181.673058:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673064:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673075:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3e00/0xb4b2209fbdac5734 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e2e expref: 45 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673084:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.673098:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463551232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.673102:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5508 00000100:00100000:0.0:1746147181.673177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.673189:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463550976 00000100:00100000:0.0:1746147181.673191:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463550976 00010000:00010000:0.0:1746147181.673202:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 20 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.673212:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5509 00000100:00100000:0.0:1746147181.673215:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463550976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.673221:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147181.673223:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 20 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673229:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 20 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673238:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc0aa00/0xb4b2209fbdac5654 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5da2 expref: 20 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.673248:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147181.673250:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.673255:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.673260:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.673277:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.673291:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463550976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.673295:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5509 00010000:00010000:3.0:1746147181.673497:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.673504:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147181.673519:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147181.673617:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efe00/0xb4b2209fbdac57b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.673631:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.673647:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.673650:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147181.673652:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0ef600, rc 0) 00000100:00100000:3.0:1746147181.673670:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28659:x1830967463549824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15655us (15961us total) trans 8589944134 rc 0/0 00000100:00100000:3.0:1746147181.673676:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10404 00000100:00100000:2.0:1746147181.678712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.678807:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551360 00000100:00100000:3.0:1746147181.678816:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551360 00000100:00100000:3.0:1746147181.678858:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10405 00000100:00100000:3.0:1746147181.678865:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28661:x1830967463551360:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147181.678886:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.678900:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773800/0xb4b2209fbdac57d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e89 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.678974:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.678984:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.678992:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679001:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679005:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679010:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679096:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679104:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.679111:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.679135:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.679143:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 18 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.679152:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466337280:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.679209:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.684080:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466337280:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147181.684101:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147181.684184:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463551104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11996us (12844us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147181.684193:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4220 00002000:00100000:3.0:1746147181.687056:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009050b100 x1830967463551104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.687068:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050b100 with x1830967463551104 ext(2097152->3145727) 00002000:00010000:3.0:1746147181.687074:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050b100 00000100:00100000:0.0:1746147181.691363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.691488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.691556:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551616 00000100:00100000:3.0:1746147181.691565:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551616 00000100:00100000:3.0:1746147181.691604:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11287 00000100:00100000:3.0:1746147181.691613:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28655:x1830967463551616:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.691630:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.691656:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e90 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.691689:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.691692:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.691698:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.691710:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.691719:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773000, rc 0) 00000100:00100000:3.0:1746147181.691759:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+34:28655:x1830967463551616:12345-192.168.203.36@tcp:101:cat.0 Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.691765:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11287 00000100:00100000:2.0:1746147181.692074:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551488 00000100:00100000:2.0:1746147181.692078:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551488 00000100:00100000:3.0:1746147181.692088:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1957:x1830967463550464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20076us (20771us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147181.692094:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1457 00010000:00010000:2.0:1746147181.692096:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 19 pid: 14125 timeout: 668 lvb_type: 0 00002000:00100000:3.0:1746147181.692101:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090508380 x1830967463550464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.692109:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508380 with x1830967463550464 ext(2097152->3145727) 00010000:00010000:3.0:1746147181.692114:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.692122:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:2.0:1746147181.692124:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5510 00002000:00010000:3.0:1746147181.692128:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090508380 00000100:00100000:2.0:1746147181.692129:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463551488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.692138:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147181.692142:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 19 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.692149:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 19 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.692163:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ef600/0xb4b2209fbdac57c0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e7b expref: 19 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.692177:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147181.692181:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.692187:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.692193:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.692206:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147181.692222:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463551488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.692227:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5510 00010000:00010000:0.0:1746147181.692391:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692398:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147181.692429:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:0.0:1746147181.692432:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147181.692665:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692676:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692686:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692693:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692699:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692705:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4773a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.692708:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692713:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692726:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147181.692729:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.692731:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692735:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773a00/0xb4b2209fbdac57dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692762:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692768:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692772:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692776:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4773c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.692778:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692783:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692791:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137600) 00010000:00010000:0.0:1746147181.692793:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.692795:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692799:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac57e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.692832:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773800/0xb4b2209fbdac57d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.692845:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.692851:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147181.692852:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147181.692854:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773e00, rc 0) 00000100:00100000:0.0:1746147181.692911:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28661:x1830967463551360:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 14045us (14205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.692918:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10405 00000100:00100000:1.0:1746147181.702237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.702263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.702280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.702346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.702366:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551872 00000100:00100000:1.0:1746147181.702373:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551872 00000100:00100000:1.0:1746147181.702406:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463552128 00000100:00100000:1.0:1746147181.702407:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463552128 00000100:00100000:1.0:1746147181.702417:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463551744 00000100:00100000:1.0:1746147181.702418:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463551744 00000100:00100000:0.0:1746147181.702423:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463550720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30841us (31423us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147181.702426:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463552000 00000100:00100000:1.0:1746147181.702427:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463552000 00000100:00100000:0.0:1746147181.702432:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1456 00000100:00100000:1.0:1746147181.702437:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11288 00000100:00100000:1.0:1746147181.702442:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463551872:12345-192.168.203.36@tcp:101:mirror_io.0 00002000:00100000:0.0:1746147181.702442:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090508a80 x1830967463550720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.702449:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967463550720 ext(3145728->4194303) 00010000:00010000:1.0:1746147181.702453:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.702456:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 30 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.702464:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e9e expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.702467:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 30 pid: 4444 timeout: 668 lvb_type: 1 00002000:00010000:0.0:1746147181.702472:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090508a80 00010000:00010000:1.0:1746147181.702480:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.702482:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.702488:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147181.702498:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11289 00010000:00010000:1.0:1746147181.702502:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147181.702503:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463552128:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147181.702510:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d01400, rc 0) 00010000:00010000:0.0:1746147181.702511:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.702518:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df16800/0xb4b2209fbdac57ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5eac expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.702524:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463551872:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 83us (296us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147181.702528:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147181.702529:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11288 00010000:00010000:0.0:1746147181.702534:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df16800/0xb4b2209fbdac57ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eac expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147181.702538:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11290 00000100:00100000:1.0:1746147181.702542:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463551744:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147181.702542:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df16800/0xb4b2209fbdac57ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eac expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147181.702546:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.702551:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5e97 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.702551:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16800, rc 0) 00010000:00010000:1.0:1746147181.702558:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.702559:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.702563:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147181.702563:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463552128:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 61us (299us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147181.702568:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11289 00010000:00010000:1.0:1746147181.702571:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147181.702576:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11291 00010000:00010000:1.0:1746147181.702577:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d00c00, rc 0) 00000100:00100000:0.0:1746147181.702580:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463552000:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147181.702585:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147181.702587:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463551744:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 45us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.702591:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11290 00010000:00010000:0.0:1746147181.702591:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ea5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.702599:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.702600:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.702604:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.702612:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.702618:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16a00, rc 0) 00000100:00100000:0.0:1746147181.702706:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463552000:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.702710:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11291 00000100:00100000:2.0:1746147181.704492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.704527:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463552384 00000100:00100000:0.0:1746147181.704535:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463552384 00002000:00100000:0.0:1746147181.704564:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f36b480 x1830967463552384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.704572:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b480 with x1830967463552384 ext(2097152->3145727) 00002000:00010000:0.0:1746147181.704576:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f36b480 00000100:00100000:0.0:1746147181.704600:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4221 00000100:00100000:0.0:1746147181.704606:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463552384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147181.712996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.713088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.713434:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463552768 00000100:00100000:3.0:1746147181.713443:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463552768 00010000:00010000:3.0:1746147181.713474:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.713501:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5511 00000100:00100000:3.0:1746147181.713507:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1959:x1830967463552768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.713519:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.713534:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.713544:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.713563:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4772400/0xb4b2209fbdac5773 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e51 expref: 32 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.713578:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.713580:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.713585:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.713592:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.713618:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.713634:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466337408:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.713716:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.713892:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463552640 00000100:00100000:1.0:1746147181.713897:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463552640 00000100:00100000:1.0:1746147181.713931:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10406 00000100:00100000:1.0:1746147181.713954:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28661:x1830967463552640:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147181.713967:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.713978:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01800/0xb4b2209fbdac5814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5eb3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.714048:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.714058:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.714063:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.714078:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.714087:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 10 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.714095:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466337536:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147181.714129:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.716921:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463552384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12305us (12424us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147181.716931:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4221 00002000:00100000:1.0:1746147181.717166:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f36b480 x1830967463552384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.717175:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b480 with x1830967463552384 ext(2097152->3145727) 00002000:00010000:1.0:1746147181.717180:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f36b480 00000100:00100000:0.0:1746147181.720206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.720224:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553024 00000100:00100000:1.0:1746147181.720228:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466337536:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147181.720230:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553024 00010000:00010000:1.0:1746147181.720247:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.720325:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 11 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:0.0:1746147181.720355:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5512 00000100:00100000:0.0:1746147181.720362:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463553024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147181.720375:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147181.720473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.720488:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553152 00000100:00100000:1.0:1746147181.720491:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553152 00002000:00100000:1.0:1746147181.720515:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3895296->3899391) req@ffff88012e2bb480 x1830967463553152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.720522:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967463553152 ext(3895296->3899391) 00002000:00010000:1.0:1746147181.720526:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00000100:00100000:1.0:1746147181.720547:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4222 00000100:00100000:1.0:1746147181.720552:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463553152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147181.720595:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466337408:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.720606:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.720648:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463552768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7130us (7548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.720654:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5511 00000100:00100000:1.0:1746147181.720678:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463553152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 125us (205us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147181.720684:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4222 00002000:00100000:1.0:1746147181.720688:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3895296->3899391) req@ffff88012e2bb480 x1830967463553152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.720694:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967463553152 ext(3895296->3899391) 00002000:00010000:1.0:1746147181.720696:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00010000:00010000:0.0:1746147181.720928:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 11 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.720951:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 11 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.720967:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4773e00/0xb4b2209fbdac57ea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e89 expref: 11 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.720987:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147181.720991:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.720999:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.721005:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.721066:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.721073:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147181.721086:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147181.721183:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01800/0xb4b2209fbdac5814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eb3 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.721204:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147181.721225:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463553024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 863us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.721230:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5512 00010000:00010000:1.0:1746147181.721998:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eb3 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.722005:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147181.722008:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147181.722010:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d01a00, rc 0) 00000100:00100000:1.0:1746147181.722040:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:28661:x1830967463552640:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8104us (9052us total) trans 8589944135 rc 0/0 00000100:00100000:1.0:1746147181.722045:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10406 00000100:00100000:0.0:1746147181.729876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.731299:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553280 00000100:00100000:2.0:1746147181.731309:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553280 00000100:00100000:2.0:1746147181.732881:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11292 00000100:00100000:2.0:1746147181.732892:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28655:x1830967463553280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.732913:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.732950:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5eba expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.732982:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.732989:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.732991:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.732994:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.733025:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.733037:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 43 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.733048:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466337664:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147181.733520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.733617:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553408 00000100:00100000:3.0:1746147181.733628:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553408 00000100:00100000:3.0:1746147181.733696:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11293 00000100:00100000:3.0:1746147181.733703:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28657:x1830967463553408:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.733718:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.733732:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ec1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733762:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733769:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.733775:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733785:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733791:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147181.733792:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147181.733795:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4280319] (req 4194304->4280319) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733820:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733830:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.733840:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466337792:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.733932:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.733958:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 28 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.734129:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.734724:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466337920:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.734763:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.734774:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 15 pid: 17548 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.734781:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338048:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.734800:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.734807:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.734814:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338176:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.734818:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466337664:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.734827:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96480 going to sleep for 11 seconds 00010000:00010000:2.0:1746147181.734842:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.734855:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d080c00, rc 0) 00000100:00100000:2.0:1746147181.734882:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28655:x1830967463553280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1994us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.734890:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11292 00000100:00100000:0.0:1746147181.739388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.739471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.739550:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466337792:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.739563:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466337920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.739571:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338048:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147181.740285:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553664 00000100:00100000:1.0:1746147181.740293:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553664 00000100:00100000:1.0:1746147181.740347:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10407 00000100:00100000:1.0:1746147181.740354:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:28661:x1830967463553664:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147181.740379:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147181.740382:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147181.740407:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01a00/0xb4b2209fbdac581b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eb3 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.740444:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147181.740448:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147181.740461:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01e00/0xb4b2209fbdac5837 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ec8 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.740552:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740567:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740575:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740585:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740590:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740595:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740600:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d01200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147181.740604:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740609:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.740615:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147181.741956:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147181.741963:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.741970:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01200/0xb4b2209fbdac583e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147181.742012:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01e00/0xb4b2209fbdac5837 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec8 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.742024:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d01e00/0xb4b2209fbdac5837 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec8 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.742031:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d01e00, rc 0) 00000100:00100000:1.0:1746147181.742490:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28661:x1830967463553664:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2135us (3110us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147181.742499:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10407 00000100:00100000:0.0:1746147181.742809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.742834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.742892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.742934:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338176:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.743006:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4280319] (req 4194304->4280319) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.743022:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772800, rc 0) 00000100:00100000:3.0:1746147181.743066:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28657:x1830967463553408:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9363us (9547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.743077:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11293 00000100:00100000:1.0:1746147181.743091:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553920 00000100:00100000:1.0:1746147181.743098:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553920 00000100:00100000:3.0:1746147181.743108:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554048 00000100:00100000:3.0:1746147181.743113:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554048 00010000:00010000:1.0:1746147181.743121:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.743131:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 668 lvb_type: 1 00000100:00100000:1.0:1746147181.743149:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554176 00000100:00100000:1.0:1746147181.743151:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554176 00010000:00010000:1.0:1746147181.743160:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.743163:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5513 00000100:00100000:3.0:1746147181.743171:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463553920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147181.743174:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5514 00000100:00100000:1.0:1746147181.743180:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463554048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.743183:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.743190:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.743200:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.743204:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.743210:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.743245:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5515 00000100:00100000:2.0:1746147181.743252:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463554176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.743257:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.743389:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.743413:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df16a00/0xb4b2209fbdac580d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ea5 expref: 16 pid: 17548 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.743426:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147181.743449:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463554048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 269us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.743454:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5514 00010000:00010000:3.0:1746147181.743597:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bac00/0xb4b2209fbdac56b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5dcc expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.743599:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.743608:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.743620:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e2e00/0xb4b2209fbdac573b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e35 expref: 32 pid: 11147 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.743626:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.743654:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463553920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 484us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.743661:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5513 00010000:00010000:2.0:1746147181.744209:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147181.744232:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463554176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 980us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.744238:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5515 00000100:00100000:2.0:1746147181.744261:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463553792 00000100:00100000:2.0:1746147181.744265:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463553792 00002000:00100000:2.0:1746147181.744295:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3895296->4194303) req@ffff8800a56b4380 x1830967463553792/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.744303:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4380 with x1830967463553792 ext(3895296->4194303) 00010000:00010000:2.0:1746147181.744310:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 44 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.744323:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 44 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:2.0:1746147181.744329:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b4380 00000100:00100000:2.0:1746147181.744345:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1458 00000100:00100000:2.0:1746147181.744350:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463553792:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147181.746403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.746472:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554432 00000100:00100000:3.0:1746147181.746480:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554432 00000100:00100000:3.0:1746147181.746977:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4101 00000100:00100000:3.0:1746147181.746985:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:28661:x1830967463554432:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147181.747177:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:28661:x1830967463554432:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 192us (779us total) trans 8589944136 rc 0/0 00000100:00100000:3.0:1746147181.747183:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4101 00000100:00100000:2.0:1746147181.758420:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1959:x1830967463553792:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14058us (18937us total) trans 17179873166 rc 0/0 00000100:00100000:2.0:1746147181.758434:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1458 00002000:00100000:2.0:1746147181.758446:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3895296->4194303) req@ffff8800a56b4380 x1830967463553792/t17179873166(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.758456:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4380 with x1830967463553792 ext(3895296->4194303) 00010000:00010000:2.0:1746147181.758466:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.758479:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:2.0:1746147181.758485:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b4380 00000100:00100000:0.0:1746147181.763559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.764006:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554560 00000100:00100000:2.0:1746147181.764015:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554560 00000100:00100000:0.0:1746147181.764078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147181.764236:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.764400:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554688 00000100:00100000:2.0:1746147181.764403:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554688 00010000:00010000:2.0:1746147181.764415:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.764434:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5516 00000100:00100000:2.0:1746147181.764440:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463554560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.764451:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147181.764473:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.764483:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.764503:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e5c00/0xb4b2209fbdac57b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e74 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.764518:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.764520:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.764527:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.764534:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.764563:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147181.764574:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466338304:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147181.764655:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.764681:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5517 00000100:00100000:3.0:1746147181.764690:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463554688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.764698:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.764713:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.764721:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.764734:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba200/0xb4b2209fbdac57c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e82 expref: 46 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.764748:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.764749:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.764754:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.764760:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.764778:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.764790:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466338432:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.764813:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147181.766755:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466338304:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147181.766778:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147181.766822:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463554560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2380us (3276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.766832:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5516 00000100:00100000:0.0:1746147181.767121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.767329:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466338432:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.767341:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.767362:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967463554688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2674us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.767367:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5517 00000100:00100000:2.0:1746147181.767432:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463554944 00000100:00100000:2.0:1746147181.767437:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463554944 00002000:00100000:2.0:1746147181.767591:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4276224->4280319) req@ffff8800a56b4e00 x1830967463554944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.767601:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463554944 ext(4276224->4280319) 00002000:00010000:2.0:1746147181.767606:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:2.0:1746147181.767628:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4223 00000100:00100000:2.0:1746147181.768175:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463554944:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147181.768538:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463554944:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 902us (1416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147181.768544:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4223 00002000:00100000:2.0:1746147181.768550:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4276224->4280319) req@ffff8800a56b4e00 x1830967463554944/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.768556:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463554944 ext(4276224->4280319) 00002000:00010000:2.0:1746147181.768559:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:0.0:1746147181.770268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.770370:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555200 00000100:00100000:1.0:1746147181.770377:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555200 00000100:00100000:1.0:1746147181.770423:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4102 00000100:00100000:1.0:1746147181.770430:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28657:x1830967463555200:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147181.770654:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+313:28657:x1830967463555200:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 223us (389us total) trans 8589944137 rc 0/0 00000100:00100000:1.0:1746147181.770661:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4102 00000100:00100000:0.0:1746147181.779984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.780049:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555456 00000100:00100000:2.0:1746147181.780058:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555456 00002000:00100000:2.0:1746147181.780105:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a56b4000 x1830967463555456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.780116:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4000 with x1830967463555456 ext(3145728->4194303) 00002000:00010000:2.0:1746147181.780122:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b4000 00000100:00100000:2.0:1746147181.780152:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4224 00000100:00100000:2.0:1746147181.780160:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463555456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.790311:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463555456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10136us (10364us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147181.790325:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4224 00002000:00100000:2.0:1746147181.790339:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a56b4000 x1830967463555456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.790348:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4000 with x1830967463555456 ext(3145728->4194303) 00002000:00010000:2.0:1746147181.790355:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b4000 00000100:00100000:0.0:1746147181.799460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.799544:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555584 00000100:00100000:3.0:1746147181.799552:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555584 00000100:00100000:3.0:1746147181.800241:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11294 00000100:00100000:3.0:1746147181.800250:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463555584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.800269:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.800288:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac5845 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ecf expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.800340:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338560:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147181.800751:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.802996:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338560:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147181.803031:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac5845 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ecf expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.803044:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773c00/0xb4b2209fbdac5845 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ecf expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.803076:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773c00, rc 0) 00000100:00100000:3.0:1746147181.803125:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463555584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2877us (3678us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.803133:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11294 00000100:00100000:0.0:1746147181.807521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.807616:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555712 00000100:00100000:3.0:1746147181.807625:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555712 00000100:00100000:3.0:1746147181.808031:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11295 00000100:00100000:3.0:1746147181.808042:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28655:x1830967463555712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.808061:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.808078:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ed6 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.808107:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.808114:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147181.808116:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147181.808120:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.808148:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.808159:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.808176:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338688:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.808584:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.812908:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338688:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.812959:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.812977:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772400, rc 0) 00000100:00100000:3.0:1746147181.813026:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28655:x1830967463555712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4985us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.813034:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11295 00010000:00010000:2.0:1746147181.813298:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147181.814292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.814342:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555840 00000100:00100000:0.0:1746147181.814350:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555840 00002000:00100000:0.0:1746147181.814386:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4280319) req@ffff88009f368000 x1830967463555840/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147181.814395:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368000 with x1830967463555840 ext(4194304->4280319) 00010000:00010000:0.0:1746147181.814403:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:0.0:1746147181.814415:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:0.0:1746147181.814422:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f368000 00000100:00100000:0.0:1746147181.814572:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1459 00000100:00100000:0.0:1746147181.814579:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463555840:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147181.819673:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463555840:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 5084us (5373us total) trans 21474840567 rc 0/0 00000100:00100000:2.0:1746147181.819687:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1459 00002000:00100000:2.0:1746147181.819698:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4280319) req@ffff88009f368000 x1830967463555840/t21474840567(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.819707:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368000 with x1830967463555840 ext(4194304->4280319) 00010000:00010000:2.0:1746147181.819716:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.819730:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:2.0:1746147181.819737:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f368000 00000100:00100000:0.0:1746147181.821434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.822272:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463555968 00000100:00100000:3.0:1746147181.822280:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463555968 00010000:00010000:3.0:1746147181.822315:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.822351:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5518 00000100:00100000:3.0:1746147181.822358:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463555968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.822372:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.822391:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.822403:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.822429:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772800/0xb4b2209fbdac5830 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ec1 expref: 33 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.822455:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.822457:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.822465:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.822472:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.822503:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.822514:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466338816:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.822589:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147181.824140:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466338816:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147181.824158:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147181.824452:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463555968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2092us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.824462:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5518 00000100:00100000:0.0:1746147181.828263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.828331:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556224 00000100:00100000:2.0:1746147181.828340:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556224 00002000:00100000:2.0:1746147181.828389:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009a80ca80 x1830967463556224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.828400:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ca80 with x1830967463556224 ext(4194304->4870143) 00002000:00010000:2.0:1746147181.828405:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80ca80 00000100:00100000:2.0:1746147181.828441:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4225 00000100:00100000:2.0:1746147181.828448:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463556224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.834614:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463556224:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6156us (6408us total) trans 0 rc 675840/675840 00000100:00100000:2.0:1746147181.834627:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4225 00002000:00100000:2.0:1746147181.834650:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009a80ca80 x1830967463556224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.834659:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ca80 with x1830967463556224 ext(4194304->4870143) 00002000:00010000:2.0:1746147181.834664:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80ca80 00000100:00100000:0.0:1746147181.848027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.848067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.848184:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556608 00000100:00100000:3.0:1746147181.848196:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556608 00000100:00100000:3.0:1746147181.848260:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11296 00000100:00100000:3.0:1746147181.848267:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28659:x1830967463556608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147181.848290:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.848307:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5edd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.848337:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.848346:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.848353:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 31 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.848359:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147181.848359:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556480 00010000:00010000:3.0:1746147181.848361:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147181.848366:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556480 00000100:00100000:1.0:1746147181.848405:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4103 00000100:00100000:1.0:1746147181.848411:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28655:x1830967463556480:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147181.848570:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28655:x1830967463556480:12345-192.168.203.36@tcp:35:cat.0 Request processed in 158us (501us total) trans 8589944138 rc 0/0 00000100:00100000:1.0:1746147181.848576:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4103 00010000:00010000:3.0:1746147181.849229:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.849328:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 31 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.849342:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 31 pid: 8478 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.849355:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338944:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.849454:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.850132:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 14 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:3.0:1746147181.850142:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339072:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.850194:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.850202:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.850210:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339200:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.850229:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.854052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.854107:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466338944:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.854120:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147181.854129:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339200:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.854157:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.854171:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772c00, rc 0) 00000100:00100000:3.0:1746147181.854227:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28659:x1830967463556608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5960us (6207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.854233:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11296 00000100:00100000:2.0:1746147181.855401:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556736 00000100:00100000:2.0:1746147181.855410:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556736 00000100:00100000:0.0:1746147181.855432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147181.855440:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 15 pid: 4444 timeout: 668 lvb_type: 1 00000100:00100000:0.0:1746147181.855469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.855476:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556992 00000100:00100000:2.0:1746147181.855479:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556992 00000100:00100000:3.0:1746147181.855486:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463556864 00010000:00010000:2.0:1746147181.855490:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.855492:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463556864 00010000:00010000:3.0:1746147181.855509:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 32 pid: 8478 timeout: 668 lvb_type: 1 00000100:00100000:2.0:1746147181.855511:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5519 00000100:00100000:2.0:1746147181.855517:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463556736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.855528:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147181.855533:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5520 00000100:00100000:3.0:1746147181.855543:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463556992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.855545:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 15 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:2.0:1746147181.855554:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 15 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.855556:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147181.855571:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d01400/0xb4b2209fbdac57f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e9e expref: 15 pid: 4444 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.855573:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.855574:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5521 00010000:00010000:3.0:1746147181.855583:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.855583:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463556864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.855590:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147181.855594:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.855601:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb400/0xb4b2209fbdac5662 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5db0 expref: 29 pid: 6881 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.855604:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 32 pid: 8478 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.855614:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 32 pid: 8478 timeout: 668 lvb_type: 1 00010000:00010000:3.0:1746147181.855620:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147181.855626:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772600/0xb4b2209fbdac56f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5df6 expref: 32 pid: 8478 timeout: 668 lvb_type: 1 00010000:00010000:1.0:1746147181.855779:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.855781:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.855788:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.855794:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.855832:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.855843:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466339328:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147181.856610:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463556992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1067us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.856618:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5520 00000100:00100000:1.0:1746147181.856623:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147181.856709:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463556736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1191us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.856715:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5519 00000100:00100000:2.0:1746147181.862585:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466339328:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147181.862604:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147181.862655:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463556864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7072us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.862668:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5521 00000100:00100000:0.0:1746147181.862767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.862806:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463557248 00000100:00100000:2.0:1746147181.862812:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463557248 00002000:00100000:2.0:1746147181.862847:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1949696->1953791) req@ffff88009a80e300 x1830967463557248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.862855:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463557248 ext(1949696->1953791) 00002000:00010000:2.0:1746147181.862858:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:2.0:1746147181.863365:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4226 00000100:00100000:2.0:1746147181.863373:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463557248:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147181.863501:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463557248:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 128us (734us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147181.863506:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4226 00002000:00100000:2.0:1746147181.863511:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1949696->1953791) req@ffff88009a80e300 x1830967463557248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.863518:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463557248 ext(1949696->1953791) 00002000:00010000:2.0:1746147181.863521:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:0.0:1746147181.868912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.869037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.869105:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463557376 00000100:00100000:0.0:1746147181.869105:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463557632 00000100:00100000:3.0:1746147181.869113:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463557376 00000100:00100000:0.0:1746147181.869113:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463557632 00000100:00100000:0.0:1746147181.869258:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10408 00000100:00100000:0.0:1746147181.869265:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+313:28669:x1830967463557632:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147181.869283:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11297 00000100:00100000:3.0:1746147181.869288:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28659:x1830967463557376:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147181.869288:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.869295:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.869302:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16200/0xb4b2209fbdac585a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5eeb expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.869303:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ee4 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.869325:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.869331:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.869333:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147181.869335:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.869359:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.869369:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.869379:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147181.869379:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869387:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869395:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869403:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869407:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869411:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147181.869442:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147181.869578:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869585:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.869595:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147181.869602:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147181.870836:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870845:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870850:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870854:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df16400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.870857:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870861:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870870:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147181.870873:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.870875:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870880:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16400/0xb4b2209fbdac5868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870902:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870906:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870914:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870917:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df16600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147181.870919:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870923:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870928:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48e00) 00010000:00010000:0.0:1746147181.870930:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147181.870932:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870950:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16600/0xb4b2209fbdac586f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147181.870992:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df16200/0xb4b2209fbdac585a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 316 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.871003:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.871008:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147181.871010:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147181.871012:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df17e00, rc 0) 00000100:00100000:0.0:1746147181.871061:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:28669:x1830967463557632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1795us (2023us total) trans 8589944139 rc 0/0 00000100:00100000:0.0:1746147181.871067:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10408 00000100:00100000:3.0:1746147181.871590:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339456:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147181.871611:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147181.871622:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773600, rc 0) 00000100:00100000:3.0:1746147181.871661:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28659:x1830967463557376:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2371us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147181.871667:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11297 00000100:00100000:0.0:1746147181.873012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.874247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.874302:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558016 00000100:00100000:1.0:1746147181.874302:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463557888 00000100:00100000:2.0:1746147181.874311:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558016 00000100:00100000:1.0:1746147181.874311:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463557888 00010000:00010000:2.0:1746147181.874341:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.874345:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4104 00000100:00100000:1.0:1746147181.874352:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+315:28669:x1830967463557888:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147181.874368:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5522 00000100:00100000:2.0:1746147181.874372:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463558016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147181.874384:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147181.874401:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.874410:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.874425:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772400/0xb4b2209fbdac584c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ed6 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:2.0:1746147181.874438:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.874440:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.874445:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.874451:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.874475:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147181.874484:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466339584:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147181.874499:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28669:x1830967463557888:12345-192.168.203.36@tcp:35:cat.0 Request processed in 148us (1630us total) trans 8589944140 rc 0/0 00000100:00100000:1.0:1746147181.874506:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4104 00000100:00100000:2.0:1746147181.874525:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.881006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.881093:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466339584:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147181.881110:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147181.881157:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463558016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6783us (6912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.881165:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5522 00000100:00100000:3.0:1746147181.881247:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558144 00000100:00100000:3.0:1746147181.881254:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558144 00000100:00100000:3.0:1746147181.881287:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11298 00000100:00100000:3.0:1746147181.881293:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463558144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147181.881308:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147181.881322:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4772a00/0xb4b2209fbdac5884 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ef2 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147181.881367:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147181.881374:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.881418:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147181.881464:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558272 00000100:00100000:2.0:1746147181.881471:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558272 00000100:00100000:2.0:1746147181.881496:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11299 00000100:00100000:2.0:1746147181.881502:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463558272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.881508:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.881515:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1800/0xb4b2209fbdac588b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ef9 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147181.881536:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466339840:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147181.881758:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.881983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.882084:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558400 00000100:00100000:2.0:1746147181.882088:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558400 00000100:00100000:2.0:1746147181.882108:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11300 00000100:00100000:2.0:1746147181.882113:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967463558400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.882120:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.882130:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f00 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.882142:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.882143:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147181.882150:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 46 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.882162:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 46 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.882170:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e1000, rc 0) 00000100:00100000:2.0:1746147181.882189:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463558400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.882195:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11300 00000100:00100000:0.0:1746147181.888431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:3.0:1746147181.888538:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147180 -> 1746147181 00002000:00010000:3.0:1746147181.888542:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147180 -> 1746147181 00002000:00010000:3.0:1746147181.888544:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147180 -> 1746147181 00000100:00100000:3.0:1746147181.888561:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466339712:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147181.888588:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772a00/0xb4b2209fbdac5884 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ef2 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.888600:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772a00/0xb4b2209fbdac5884 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ef2 expref: 34 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147181.888616:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4772a00, rc 0) 00000100:00100000:2.0:1746147181.888730:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466339840:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147181.888744:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1800/0xb4b2209fbdac588b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ef9 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147181.888752:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1800/0xb4b2209fbdac588b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ef9 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147181.888964:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558656 00000100:00100000:1.0:1746147181.888971:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558656 00002000:00100000:1.0:1746147181.889004:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2727936->2732031) req@ffff88008e5c8380 x1830967463558656/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.889011:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967463558656 ext(2727936->2732031) 00002000:00010000:1.0:1746147181.889015:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8380 00000100:00100000:1.0:1746147181.889035:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4227 00000100:00100000:1.0:1746147181.889041:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463558656:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147181.891074:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463558144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9772us (10066us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147181.891083:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11298 00000100:00100000:1.0:1746147181.891481:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463558656:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 2437us (3055us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147181.891488:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4227 00002000:00100000:1.0:1746147181.891496:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2727936->2732031) req@ffff88008e5c8380 x1830967463558656/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.891504:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8380 with x1830967463558656 ext(2727936->2732031) 00002000:00010000:1.0:1746147181.891508:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8380 00010000:00010000:2.0:1746147181.891802:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e1800, rc 0) 00000100:00100000:2.0:1746147181.891852:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463558272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10350us (10478us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147181.891857:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11299 00000100:00100000:0.0:1746147181.896755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.896806:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463558912 00000100:00100000:1.0:1746147181.896814:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463558912 00000100:00100000:1.0:1746147181.896860:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4105 00000100:00100000:1.0:1746147181.896867:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28659:x1830967463558912:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147181.897106:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28659:x1830967463558912:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 239us (359us total) trans 8589944141 rc 0/0 00000100:00100000:1.0:1746147181.897114:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4105 00000100:00100000:0.0:1746147181.903411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.903477:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559040 00000100:00100000:2.0:1746147181.903485:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559040 00000100:00100000:2.0:1746147181.903539:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11301 00000100:00100000:2.0:1746147181.903548:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28669:x1830967463559040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.903567:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.903581:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f07 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.903606:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.903613:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.903614:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.903617:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.903674:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.903684:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 27 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.903694:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466339968:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.903780:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147181.905992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.906078:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466339968:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.906100:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.906115:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e1a00, rc 0) 00000100:00100000:2.0:1746147181.906147:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28669:x1830967463559040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2600us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.906154:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11301 00000100:00100000:1.0:1746147181.906223:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559168 00000100:00100000:1.0:1746147181.906229:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559168 00002000:00100000:1.0:1746147181.906259:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1949696->2097151) req@ffff88008e5caa00 x1830967463559168/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.906266:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967463559168 ext(1949696->2097151) 00010000:00010000:1.0:1746147181.906272:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.906281:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:1.0:1746147181.906287:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5caa00 00000100:00100000:1.0:1746147181.906367:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1460 00000100:00100000:1.0:1746147181.906374:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463559168:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147181.906899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.907608:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559424 00000100:00100000:2.0:1746147181.907615:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559424 00000100:00100000:2.0:1746147181.907653:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10409 00000100:00100000:2.0:1746147181.907659:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28671:x1830967463559424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147181.907678:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.907690:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1c00/0xb4b2209fbdac58a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f0e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.907765:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.907776:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.907782:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.907806:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.907814:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 317 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.907823:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466340096:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.909511:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.911930:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463559168:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 5548us (5935us total) trans 21474840568 rc 0/0 00000100:00100000:1.0:1746147181.911958:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1460 00002000:00100000:1.0:1746147181.911970:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1949696->2097151) req@ffff88008e5caa00 x1830967463559168/t21474840568(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.911978:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967463559168 ext(1949696->2097151) 00010000:00010000:1.0:1746147181.911988:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.912003:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:1.0:1746147181.912009:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5caa00 00000100:00100000:0.0:1746147181.912607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.912613:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466340096:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.912643:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147181.912906:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559552 00000100:00100000:3.0:1746147181.912913:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559552 00010000:00010000:3.0:1746147181.912954:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 318 pid: 14125 timeout: 668 lvb_type: 0 00000100:00100000:3.0:1746147181.912980:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5523 00000100:00100000:3.0:1746147181.912987:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1957:x1830967463559552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147181.912999:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147181.913004:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 318 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.913013:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 318 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.913030:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df17e00/0xb4b2209fbdac5876 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eeb expref: 318 pid: 14125 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.913055:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147181.913059:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.913065:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.913070:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147181.913090:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147181.913110:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147181.913116:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967463559552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (510us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147181.913116:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147181.913121:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5523 00000004:00200000:2.0:1746147181.913130:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147181.913289:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1c00/0xb4b2209fbdac58a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 318 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.913668:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 317 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.913675:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147181.913677:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147181.913680:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e1e00, rc 0) 00000100:00100000:2.0:1746147181.914068:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28671:x1830967463559424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6407us (7168us total) trans 8589944142 rc 0/0 00000100:00100000:2.0:1746147181.914074:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10409 00000100:00100000:0.0:1746147181.914308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.914453:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559680 00000100:00100000:1.0:1746147181.914458:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559680 00010000:00010000:1.0:1746147181.914475:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.914501:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5524 00000100:00100000:1.0:1746147181.914506:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463559680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147181.914514:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.914528:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.914535:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.914548:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4772c00/0xb4b2209fbdac5853 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5edd expref: 30 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.914560:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.914562:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.914567:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.914577:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.914600:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.914609:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466340224:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147181.914666:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e7073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.917917:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466340224:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147181.917974:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147181.918008:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463559680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3500us (3699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.918017:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5524 00000100:00100000:0.0:1746147181.921367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.921570:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463559936 00000100:00100000:1.0:1746147181.921579:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463559936 00002000:00100000:1.0:1746147181.921615:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5cb100 x1830967463559936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147181.921624:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967463559936 ext(1048576->2097151) 00002000:00010000:1.0:1746147181.921629:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5cb100 00000100:00100000:1.0:1746147181.922403:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4228 00000100:00100000:1.0:1746147181.922416:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463559936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.936323:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463559936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13898us (14952us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147181.936335:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4228 00002000:00100000:2.0:1746147181.936351:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5cb100 x1830967463559936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.936360:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cb100 with x1830967463559936 ext(1048576->2097151) 00002000:00010000:2.0:1746147181.936366:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5cb100 00000100:00100000:0.0:1746147181.943905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.944151:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463560064 00000100:00100000:2.0:1746147181.944161:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463560064 00000100:00100000:2.0:1746147181.944236:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11302 00000100:00100000:2.0:1746147181.944247:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28669:x1830967463560064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.944267:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.944285:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f15 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.944315:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.944322:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.944324:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147181.944327:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.944358:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.944370:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 28 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:2.0:1746147181.944382:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340352:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147181.945190:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147181.947704:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340352:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147181.947729:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.947747:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811a00, rc 0) 00000100:00100000:2.0:1746147181.947792:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:28669:x1830967463560064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3547us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147181.947800:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11302 00000100:00100000:0.0:1746147181.948105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.948187:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463560192 00000100:00100000:3.0:1746147181.948194:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463560192 00002000:00100000:3.0:1746147181.948223:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2732031) req@ffff88008e5c9c00 x1830967463560192/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.948231:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9c00 with x1830967463560192 ext(2097152->2732031) 00010000:00010000:3.0:1746147181.948237:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.948246:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 29 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.948252:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9c00 00000100:00100000:3.0:1746147181.948264:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1461 00000100:00100000:3.0:1746147181.948269:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463560192:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147181.955580:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463560192:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7302us (7468us total) trans 21474840569 rc 0/0 00000100:00100000:3.0:1746147181.955589:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1461 00002000:00100000:3.0:1746147181.955599:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2732031) req@ffff88008e5c9c00 x1830967463560192/t21474840569(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:557/0 lens 488/448 e 0 to 0 dl 1746147192 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.955607:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9c00 with x1830967463560192 ext(2097152->2732031) 00010000:00010000:3.0:1746147181.955615:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:3.0:1746147181.955628:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00002000:00010000:3.0:1746147181.955643:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9c00 00000100:00100000:2.0:1746147181.963754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147181.963812:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463560320 00000100:00100000:1.0:1746147181.963822:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463560320 00010000:00010000:1.0:1746147181.963860:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00000100:00100000:1.0:1746147181.963906:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5525 00000100:00100000:1.0:1746147181.963916:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463560320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147181.963931:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147181.963979:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.963992:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.964013:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773600/0xb4b2209fbdac5861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ee4 expref: 31 pid: 8481 timeout: 668 lvb_type: 0 00010000:00010000:1.0:1746147181.964031:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.964034:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147181.964041:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.964049:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147181.964083:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147181.964096:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466340480:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147181.964180:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e7073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147181.968785:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466340480:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147181.968802:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147181.968892:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463560320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4977us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147181.968902:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5525 00000100:00100000:0.0:1746147181.982169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.982257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.982284:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463561600 00000100:00100000:2.0:1746147181.982293:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463561600 00000100:00100000:2.0:1746147181.982342:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10410 00000100:00100000:2.0:1746147181.982351:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28675:x1830967463561600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147181.982372:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147181.982392:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811c00/0xb4b2209fbdac58bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f1c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.982482:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982492:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982500:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982511:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982515:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982520:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982604:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982611:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982616:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147181.982623:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147181.982697:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982714:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982719:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982723:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e811e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147181.982726:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982731:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982740:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147181.982742:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147181.982744:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982748:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811e00/0xb4b2209fbdac58c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982770:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982774:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982778:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982781:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e811600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147181.982783:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982788:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982793:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76e00) 00010000:00010000:2.0:1746147181.982794:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147181.982796:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982800:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811600/0xb4b2209fbdac58ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147181.982828:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811c00/0xb4b2209fbdac58bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 23 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.982839:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 22 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147181.982844:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147181.982845:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147181.982847:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811400, rc 0) 00000100:00100000:2.0:1746147181.982884:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28675:x1830967463561600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 534us (628us total) trans 8589944143 rc 0/0 00000100:00100000:2.0:1746147181.982890:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10410 00000100:00100000:2.0:1746147181.984040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147181.984230:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463560704 00000100:00100000:3.0:1746147181.984238:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463560704 00002000:00100000:3.0:1746147181.984274:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c8e00 x1830967463560704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147181.984281:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967463560704 ext(2097152->3145727) 00002000:00010000:3.0:1746147181.984285:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:3.0:1746147181.984310:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4229 00000100:00100000:3.0:1746147181.984318:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463560704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.985086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.985117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147181.985148:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463560832 00000100:00100000:2.0:1746147181.985152:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463560832 00002000:00100000:2.0:1746147181.985170:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f368700 x1830967463560832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.985177:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368700 with x1830967463560832 ext(3145728->4194303) 00002000:00010000:2.0:1746147181.985180:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368700 00000100:00100000:2.0:1746147181.985190:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463561216 00000100:00100000:2.0:1746147181.985192:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463561216 00002000:00100000:2.0:1746147181.985201:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f369180 x1830967463561216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.985206:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369180 with x1830967463561216 ext(3145728->4194303) 00002000:00010000:2.0:1746147181.985209:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f369180 00000100:00100000:2.0:1746147181.985217:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463561088 00000100:00100000:2.0:1746147181.985218:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463561088 00002000:00100000:2.0:1746147181.985225:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f7ce680 x1830967463561088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1746147192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147181.985230:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce680 with x1830967463561088 ext(2097152->3145727) 00002000:00010000:2.0:1746147181.985233:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7ce680 00000100:00100000:2.0:1746147181.985241:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4230 00000100:00100000:2.0:1746147181.985246:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463560832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147181.985851:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4231 00000100:00100000:3.0:1746147181.985858:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1959:x1830967463561216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.986182:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4232 00000100:00100000:2.0:1746147181.986188:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1959:x1830967463561088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147181.987498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.989234:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463561728 00000100:00100000:0.0:1746147181.989247:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463561728 00000100:00100000:0.0:1746147181.989299:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11303 00000100:00100000:0.0:1746147181.989307:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463561728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.989325:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.989339:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f23 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.989359:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.989361:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.989368:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.989386:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.989396:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16800, rc 0) 00000100:00100000:0.0:1746147181.989441:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463561728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 134us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.989447:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11303 00000100:00100000:2.0:1746147181.989578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147181.989629:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463561856 00000100:00100000:0.0:1746147181.989632:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463561856 00000100:00100000:0.0:1746147181.989668:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11304 00000100:00100000:0.0:1746147181.989673:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463561856:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147181.989680:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147181.989686:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f2a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147181.989696:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.989697:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147181.989702:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.989710:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147181.989718:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16000, rc 0) 00000100:00100000:0.0:1746147181.991062:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1957:x1830967463561856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1384us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147181.991070:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11304 00000100:00100000:2.0:1746147182.007466:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463560832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22212us (23421us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.007477:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4230 00002000:00100000:2.0:1746147182.007489:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f368700 x1830967463560832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.007497:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368700 with x1830967463560832 ext(3145728->4194303) 00002000:00010000:2.0:1746147182.007502:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368700 00000100:00100000:0.0:1746147182.008774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.009103:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562112 00000100:00100000:2.0:1746147182.009111:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562112 00002000:00100000:2.0:1746147182.009146:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5c9f80 x1830967463562112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.009154:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9f80 with x1830967463562112 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.009159:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9f80 00000100:00100000:1.0:1746147182.010112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.010705:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4233 00000100:00100000:0.0:1746147182.010716:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1959:x1830967463562112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.013109:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562240 00000100:00100000:0.0:1746147182.013119:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562240 00000100:00100000:0.0:1746147182.013177:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11305 00000100:00100000:0.0:1746147182.013185:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28671:x1830967463562240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147182.013199:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.013212:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f31 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.013235:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.013242:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.013249:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.013250:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.013253:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1335296->2052095] (req 1335296->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.013278:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.013291:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 33 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.013300:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340608:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147182.013366:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.013374:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 36 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.013381:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340736:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147182.013404:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00080000:0.0:1746147182.013416:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147182.019362:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340736:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.021659:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1959:x1830967463561216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 35793us (36566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.021672:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4231 00002000:00100000:1.0:1746147182.021684:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f369180 x1830967463561216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.021693:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369180 with x1830967463561216 ext(3145728->4194303) 00002000:00010000:1.0:1746147182.021698:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f369180 00000100:00100000:1.0:1746147182.027533:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463560704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 43208us (45366us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.027543:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4229 00002000:00100000:1.0:1746147182.027554:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c8e00 x1830967463560704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.027562:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967463560704 ext(2097152->3145727) 00002000:00010000:1.0:1746147182.027567:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:0.0:1746147182.031509:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340608:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147182.031541:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1335296->2052095] (req 1335296->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.031557:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df16e00, rc 0) 00000100:00100000:0.0:1746147182.032350:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28671:x1830967463562240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 19163us (22237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.032359:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11305 00000100:00100000:0.0:1746147182.032417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.032578:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562368 00000100:00100000:1.0:1746147182.032585:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562368 00010000:00010000:1.0:1746147182.032606:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.032629:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5526 00000100:00100000:1.0:1746147182.032645:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463562368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.032657:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.032671:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.032679:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.032698:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e1a00/0xb4b2209fbdac5899 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f07 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.032709:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.032728:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463562368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.032733:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5526 00000100:00100000:0.0:1746147182.033500:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1959:x1830967463561088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 47311us (48381us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147182.033506:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4232 00002000:00100000:0.0:1746147182.033513:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f7ce680 x1830967463561088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:557/0 lens 488/440 e 0 to 0 dl 1746147192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.033520:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce680 with x1830967463561088 ext(2097152->3145727) 00002000:00010000:0.0:1746147182.033523:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7ce680 00000100:00100000:1.0:1746147182.033737:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1959:x1830967463562112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23023us (24966us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.033744:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4233 00002000:00100000:1.0:1746147182.033748:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5c9f80 x1830967463562112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.033755:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9f80 with x1830967463562112 ext(1048576->2097151) 00010000:00010000:1.0:1746147182.033761:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:1.0:1746147182.033771:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00002000:00010000:1.0:1746147182.033776:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9f80 00000100:00100000:0.0:1746147182.049356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.049425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.049450:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562624 00000100:00100000:0.0:1746147182.049459:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562624 00010000:00010000:0.0:1746147182.049487:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.049511:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5527 00000100:00100000:0.0:1746147182.049517:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1958:x1830967463562624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.049529:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.049546:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.049556:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.049575:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df16800/0xb4b2209fbdac58df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f23 expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.049593:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.049595:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.049600:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.049607:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.049630:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.049651:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466340864:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147182.049706:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.049725:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562496 00000100:00100000:0.0:1746147182.049727:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562496 00000100:00100000:0.0:1746147182.051099:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11306 00000100:00100000:2.0:1746147182.052674:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463562496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.052690:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.052703:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e810400/0xb4b2209fbdac58f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f38 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.052742:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340992:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.052809:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.054708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.054728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.054773:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463562880 00000100:00100000:0.0:1746147182.054781:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463562880 00002000:00100000:0.0:1746147182.054811:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f047800 x1830967463562880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.054819:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047800 with x1830967463562880 ext(2097152->3145727) 00002000:00010000:0.0:1746147182.054822:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047800 00000100:00100000:3.0:1746147182.054826:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466340992:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147182.054835:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463563136 00000100:00100000:0.0:1746147182.054836:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463563136 00002000:00100000:0.0:1746147182.054844:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f045880 x1830967463563136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147182.054848:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e810400/0xb4b2209fbdac58f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f38 expref: 34 pid: 17548 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746147182.054850:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967463563136 ext(3145728->4194303) 00002000:00010000:0.0:1746147182.054852:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045880 00010000:00010000:3.0:1746147182.054859:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e810400/0xb4b2209fbdac58f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f38 expref: 34 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147182.054860:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4234 00000100:00100000:0.0:1746147182.054866:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463562880:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147182.054868:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e810400, rc 0) 00000100:00100000:3.0:1746147182.054910:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463562496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3802us (5560us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147182.054917:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11306 00000100:00100000:0.0:1746147182.056016:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4235 00000100:00100000:0.0:1746147182.056024:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463563136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.059758:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466340864:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147182.059777:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.059814:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1958:x1830967463562624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10296us (10388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.059824:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5527 00000100:00100000:0.0:1746147182.064271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.064292:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463563392 00000100:00100000:0.0:1746147182.064301:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463563392 00002000:00100000:0.0:1746147182.064337:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1339391) req@ffff88009f044e00 x1830967463563392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.064346:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044e00 with x1830967463563392 ext(1335296->1339391) 00002000:00010000:0.0:1746147182.064351:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044e00 00000100:00100000:0.0:1746147182.064369:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4236 00000100:00100000:0.0:1746147182.064376:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463563392:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147182.064501:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463563392:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 125us (235us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147182.064507:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4236 00002000:00100000:0.0:1746147182.064512:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1335296->1339391) req@ffff88009f044e00 x1830967463563392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.064519:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044e00 with x1830967463563392 ext(1335296->1339391) 00002000:00010000:0.0:1746147182.064522:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044e00 00000100:00100000:2.0:1746147182.065431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.066459:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463563648 00000100:00100000:0.0:1746147182.066465:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463563648 00002000:00100000:0.0:1746147182.066492:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880090509c00 x1830967463563648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.066500:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509c00 with x1830967463563648 ext(4194304->4870143) 00002000:00010000:0.0:1746147182.066503:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509c00 00000100:00100000:0.0:1746147182.066518:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4237 00000100:00100000:0.0:1746147182.066524:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463563648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.070064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.071212:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463563776 00000100:00100000:0.0:1746147182.071423:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463563776 00000100:00100000:0.0:1746147182.072591:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10411 00000100:00100000:0.0:1746147182.072601:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:28676:x1830967463563776:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147182.072619:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.072644:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7800/0xb4b2209fbdac58fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f3f expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.072694:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072704:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072714:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072723:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072729:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072734:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072818:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072827:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 316 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.072833:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.072859:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 316 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.072869:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 316 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.072879:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466341120:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147182.073625:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.076011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.076304:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463563136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20278us (21572us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.076313:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4235 00002000:00100000:2.0:1746147182.076323:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f045880 x1830967463563136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.076332:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967463563136 ext(3145728->4194303) 00002000:00010000:2.0:1746147182.076336:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045880 00000100:00100000:2.0:1746147182.076355:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564032 00000100:00100000:2.0:1746147182.076361:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564032 00002000:00100000:2.0:1746147182.076381:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (2048000->2052095) req@ffff88012e2bbb80 x1830967463564032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.076387:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967463564032 ext(2048000->2052095) 00002000:00010000:2.0:1746147182.076389:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bbb80 00000100:00100000:2.0:1746147182.076400:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4238 00000100:00100000:2.0:1746147182.076406:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463564032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.076525:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463564032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 119us (522us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147182.076530:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4238 00002000:00100000:2.0:1746147182.076534:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (2048000->2052095) req@ffff88012e2bbb80 x1830967463564032/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.076540:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967463564032 ext(2048000->2052095) 00002000:00010000:2.0:1746147182.076542:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bbb80 00000100:00100000:1.0:1746147182.081629:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463563648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15096us (17081us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147182.081648:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4237 00002000:00100000:1.0:1746147182.081658:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880090509c00 x1830967463563648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.081666:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509c00 with x1830967463563648 ext(4194304->4870143) 00002000:00010000:1.0:1746147182.081670:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509c00 00000100:00100000:0.0:1746147182.081825:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466341120:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147182.081849:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147182.083345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.083367:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564160 00000100:00100000:1.0:1746147182.083373:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564160 00010000:00010000:1.0:1746147182.083407:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 317 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.083429:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5528 00000100:00100000:1.0:1746147182.083437:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1957:x1830967463564160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.083449:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.083454:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 317 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.083464:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 317 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.083483:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e1e00/0xb4b2209fbdac58a7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f0e expref: 317 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.083494:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.083499:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083506:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083512:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083527:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.083554:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1957:x1830967463564160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.083560:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5528 00000100:00080000:1.0:1746147182.083582:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147182.083593:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083598:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147182.083649:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147182.083652:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147182.083665:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083673:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083680:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083684:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083689:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083694:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0d6800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.083697:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083702:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083708:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147182.083711:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.083713:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083716:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d6800/0xb4b2209fbdac5902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083724:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083729:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083733:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083736:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0d7600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.083737:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083741:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083746:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48d00) 00010000:00010000:1.0:1746147182.083747:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.083749:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083753:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7600/0xb4b2209fbdac5909 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.083776:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d7800/0xb4b2209fbdac58fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.083786:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.083791:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.083792:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147182.083794:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e810600, rc 0) 00000100:00100000:1.0:1746147182.083815:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:28676:x1830967463563776:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 11217us (13758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.083821:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10411 00000100:00100000:1.0:1746147182.083894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.084101:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564416 00000100:00100000:2.0:1746147182.084106:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564416 00000100:00100000:2.0:1746147182.084129:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4106 00000100:00100000:2.0:1746147182.084135:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28671:x1830967463564416:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147182.084250:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28671:x1830967463564416:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 116us (355us total) trans 8589944144 rc 0/0 00000100:00100000:2.0:1746147182.084255:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4106 00000100:00100000:1.0:1746147182.085268:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463562880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30400us (30564us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.085275:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4234 00002000:00100000:1.0:1746147182.085281:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f047800 x1830967463562880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.085288:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047800 with x1830967463562880 ext(2097152->3145727) 00002000:00010000:1.0:1746147182.085291:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047800 00000100:00100000:1.0:1746147182.095612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.095644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.095668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.095693:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564544 00000100:00100000:1.0:1746147182.095701:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564544 00000100:00100000:1.0:1746147182.095734:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564672 00000100:00100000:1.0:1746147182.095736:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564672 00000100:00100000:1.0:1746147182.095745:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564800 00000100:00100000:1.0:1746147182.095746:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564800 00000100:00100000:1.0:1746147182.095759:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11307 00000100:00100000:1.0:1746147182.095766:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463564544:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147182.095782:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.095795:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a400/0xb4b2209fbdac5917 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f46 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.095839:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341248:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147182.095897:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.095912:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11308 00000100:00100000:1.0:1746147182.095917:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463564672:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147182.095924:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147182.095929:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11309 00010000:00010000:1.0:1746147182.095930:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f4d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.095950:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463564800:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147182.095955:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.095957:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.095959:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.095964:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.095968:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f54 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.095976:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.095979:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.095980:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.095984:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2b800, rc 0) 00010000:00010000:3.0:1746147182.095986:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.095995:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.096001:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1b800, rc 0) 00000100:00100000:1.0:1746147182.096006:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463564672:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.096012:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11308 00000100:00100000:3.0:1746147182.096018:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463564800:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.096023:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11309 00000100:00100000:0.0:1746147182.102930:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341248:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147182.102974:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a400/0xb4b2209fbdac5917 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f46 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.102989:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2a400/0xb4b2209fbdac5917 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f46 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.102998:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2a400, rc 0) 00000100:00100000:0.0:1746147182.103034:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463564544:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7268us (7428us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147182.103042:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11307 00000100:00100000:1.0:1746147182.106083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.106119:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463564928 00000100:00100000:0.0:1746147182.106127:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463564928 00000100:00100000:0.0:1746147182.106158:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11310 00000100:00100000:0.0:1746147182.106165:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463564928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.106178:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.106190:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e811c00/0xb4b2209fbdac592c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f5b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.106229:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341376:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147182.106276:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.111682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.113230:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463565184 00000100:00100000:1.0:1746147182.113240:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463565184 00000100:00100000:1.0:1746147182.114652:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341376:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147182.114682:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e811c00/0xb4b2209fbdac592c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f5b expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.114695:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e811c00/0xb4b2209fbdac592c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f5b expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.114709:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811c00, rc 0) 00000100:00100000:1.0:1746147182.114755:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463564928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8589us (8676us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147182.114763:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11310 00000100:00100000:1.0:1746147182.114884:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10412 00000100:00100000:1.0:1746147182.114890:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:28676:x1830967463565184:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147182.114904:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.114917:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2bc00/0xb4b2209fbdac5933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f62 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.115004:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.115015:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.115021:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.115058:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.115068:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 12 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.115077:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466341504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.115118:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.117930:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466341504:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.117969:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147182.119280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.119303:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463565312 00000100:00100000:1.0:1746147182.119309:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463565312 00010000:00010000:1.0:1746147182.119336:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.119360:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5529 00000100:00100000:1.0:1746147182.119367:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463565312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.119378:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.119383:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.119392:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.119413:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810600/0xb4b2209fbdac5910 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f3f expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.119422:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.119426:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.119433:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.119438:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.119452:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.119487:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463565312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.119496:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5529 00000100:00100000:1.0:1746147182.120342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.120362:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463565568 00000100:00100000:1.0:1746147182.120366:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463565568 00002000:00100000:1.0:1746147182.120390:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a56b7100 x1830967463565568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.120398:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7100 with x1830967463565568 ext(4194304->4870143) 00002000:00010000:1.0:1746147182.120401:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b7100 00000100:00100000:1.0:1746147182.120414:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4239 00000100:00100000:1.0:1746147182.120419:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463565568:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147182.120698:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.120705:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147182.120718:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.120834:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2bc00/0xb4b2209fbdac5933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f62 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.120854:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f62 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.120860:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.120862:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147182.120865:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2ac00, rc 0) 00000100:00100000:2.0:1746147182.120891:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:28676:x1830967463565184:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6001us (9218us total) trans 8589944145 rc 0/0 00000100:00100000:2.0:1746147182.120897:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10412 00000100:00100000:0.0:1746147182.126771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.126876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.127104:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463565824 00000100:00100000:1.0:1746147182.127113:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463565824 00000100:00100000:2.0:1746147182.127127:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566080 00000100:00100000:2.0:1746147182.127131:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566080 00000100:00100000:2.0:1746147182.127161:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10413 00000100:00100000:1.0:1746147182.127167:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10414 00000100:00100000:2.0:1746147182.127168:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:28676:x1830967463566080:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147182.127172:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28680:x1830967463565824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.127186:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.127186:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.127189:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147182.127199:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33c00/0xb4b2209fbdac5948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f69 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.127207:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac593a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f62 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.127225:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.127228:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147182.127234:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2600/0xb4b2209fbdac594f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f70 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.127272:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127277:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.127281:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127285:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.127287:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127291:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.127297:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147182.127299:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147182.127302:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.127307:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127373:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2600/0xb4b2209fbdac594f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.127375:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.127384:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.127390:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127397:0:14125:0:(ldlm_lockd.c:1458:ldlm_handle_enqueue()) ### save blocking bits 4 in granted lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.127406:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.127412:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.127418:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.127420:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147182.127422:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.127428:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e2800, rc 0) 00010000:00010000:1.0:1746147182.127430:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.127438:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 13 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.127448:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466341632:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.127464:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:28676:x1830967463566080:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 295us (587us total) trans 8589944146 rc 0/0 00000100:00100000:2.0:1746147182.127469:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10413 00000100:00100000:1.0:1746147182.127499:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00080000:1.0:1746147182.127511:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147182.127775:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463565568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7355us (7434us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147182.127782:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4239 00002000:00100000:1.0:1746147182.127793:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a56b7100 x1830967463565568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.127807:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7100 with x1830967463565568 ext(4194304->4870143) 00002000:00010000:1.0:1746147182.127811:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b7100 00000100:00100000:1.0:1746147182.129650:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466341632:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.129665:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147182.130907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.130975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.130995:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566336 00000100:00100000:0.0:1746147182.130995:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566208 00000100:00100000:1.0:1746147182.131001:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566336 00000100:00100000:0.0:1746147182.131001:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566208 00010000:00010000:1.0:1746147182.131026:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 14 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.131032:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10415 00000100:00100000:0.0:1746147182.131039:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:28676:x1830967463566208:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147182.131042:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5530 00000100:00100000:1.0:1746147182.131046:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463566336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.131055:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.131056:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.131060:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 14 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.131066:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810800/0xb4b2209fbdac5979 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f77 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.131068:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 14 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.131080:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64e2800/0xb4b2209fbdac595d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f70 expref: 15 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.131091:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.131095:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.131104:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.131110:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.131533:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810800/0xb4b2209fbdac5979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f77 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.131544:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810800/0xb4b2209fbdac5979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f77 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.131560:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147182.131562:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147182.131564:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e810800, rc 0) 00010000:00010000:1.0:1746147182.131593:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.131597:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:28676:x1830967463566208:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 559us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.131603:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10415 00000100:00100000:1.0:1746147182.131846:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463566336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 798us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.131853:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5530 00010000:00010000:0.0:1746147182.132130:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132137:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147182.132148:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000100:00100000:1.0:1746147182.132287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147182.132293:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132299:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00000100:00100000:1.0:1746147182.132304:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566464 00010000:00010000:0.0:1746147182.132304:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00000100:00100000:1.0:1746147182.132307:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566464 00010000:00010000:0.0:1746147182.132310:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131045800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147182.132313:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132319:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132326:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:1.0:1746147182.132327:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11311 00010000:00010000:0.0:1746147182.132328:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147182.132331:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:1.0:1746147182.132333:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463566464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.132335:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131045800/0xb4b2209fbdac5972 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.132340:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.132345:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147182.132349:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094450a00/0xb4b2209fbdac5987 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f7e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.132349:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132354:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132357:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e33e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147182.132359:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132363:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132368:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147182.132370:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147182.132372:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132377:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33e00/0xb4b2209fbdac5956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:1.0:1746147182.132381:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341760:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147182.132386:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132390:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132395:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132398:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e33600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147182.132400:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132404:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132409:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f800) 00010000:00010000:0.0:1746147182.132410:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147182.132413:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147182.132417:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33600/0xb4b2209fbdac5964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:1.0:1746147182.132428:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00010000:00010000:0.0:1746147182.132445:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33c00/0xb4b2209fbdac5948 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f69 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.132451:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33c00/0xb4b2209fbdac5948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f69 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.132457:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33c00, rc 0) 00000100:00100000:0.0:1746147182.132478:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28680:x1830967463565824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5306us (5715us total) trans 8589944147 rc 301/301 00000100:00100000:0.0:1746147182.132483:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10414 00000100:00100000:1.0:1746147182.134031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.134048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.134073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.134086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.134091:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566592 00000100:00100000:3.0:1746147182.134100:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566592 00000100:00100000:1.0:1746147182.134111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.134125:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566720 00000100:00100000:3.0:1746147182.134126:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566720 00000100:00100000:1.0:1746147182.134127:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566848 00000100:00100000:1.0:1746147182.134130:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566848 00000100:00100000:3.0:1746147182.134136:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463566976 00000100:00100000:3.0:1746147182.134138:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463566976 00000100:00100000:1.0:1746147182.134146:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567104 00000100:00100000:1.0:1746147182.134148:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567104 00000100:00100000:1.0:1746147182.134157:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11312 00000100:00100000:1.0:1746147182.134164:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463566592:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147182.134191:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.134203:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.134211:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11313 00010000:00010000:1.0:1746147182.134211:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.134217:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463566720:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147182.134217:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 32 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134222:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.134223:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.134225:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134237:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.134247:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 32 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134248:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134257:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 32 pid: 8480 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.134260:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134266:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147182.134267:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466341888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.134270:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.134271:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.134273:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134287:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134294:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 29 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.134301:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.134325:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 32 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134329:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 45 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134332:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 32 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.134336:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 45 pid: 21080 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.134339:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466342144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.134343:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342272:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.134363:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134366:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134372:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.134378:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342528:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.134392:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.134408:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11314 00000100:00100000:3.0:1746147182.134413:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463566848:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147182.134420:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.134427:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.134428:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466342400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.134437:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134442:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147182.134445:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab300 going to sleep for 11 seconds 00010000:00010000:3.0:1746147182.134448:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134454:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.134455:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.134457:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.134460:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11315 00000100:00100000:1.0:1746147182.134465:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463567104:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147182.134474:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134480:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134481:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 29 pid: 6881 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.134488:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466342656:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.134489:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.134494:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134505:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.134509:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.134510:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.134512:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134513:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 15 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.134520:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 15 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:1.0:1746147182.134524:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.134528:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466342784:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.134531:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 32 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.134538:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466342912:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.134548:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134555:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.134559:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.134562:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466343040:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.134565:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 17 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.134572:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466343168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.134576:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147182.134588:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.134598:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 32 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.134604:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466343296:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.134613:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.134902:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11316 00000100:00100000:3.0:1746147182.134907:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463566976:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147182.134922:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134931:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.134952:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.134954:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.134957:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.135016:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.135023:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 32 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.135031:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466343424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.135079:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.138553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.138641:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567232 00000100:00100000:3.0:1746147182.138648:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567232 00000100:00100000:0.0:1746147182.138651:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466341760:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147182.138678:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094450a00/0xb4b2209fbdac5987 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f7e expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.138691:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11317 00010000:00010000:0.0:1746147182.138691:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094450a00/0xb4b2209fbdac5987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f7e expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.138699:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463567232:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147182.138700:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094450a00, rc 0) 00010000:00010000:3.0:1746147182.138729:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.138735:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463566464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6401us (6448us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147182.138741:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11311 00010000:00010000:3.0:1746147182.138742:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.138751:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.138757:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.138764:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.138770:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.138772:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.138774:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.138798:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 45 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.138808:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 45 pid: 4445 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.138818:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343552:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.138869:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.138877:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 16 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.138884:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343680:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.138903:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.138910:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 29 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.138916:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343808:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.138934:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.138962:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 29 pid: 8481 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.138969:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343936:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.138990:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.142783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.142805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.142816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.142932:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466342912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.142960:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466343168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.142976:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567360 00000100:00100000:3.0:1746147182.142981:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567360 00010000:00010000:3.0:1746147182.143008:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 30 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.143028:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567616 00000100:00100000:3.0:1746147182.143029:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567616 00010000:00010000:3.0:1746147182.143040:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 18 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.143052:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567488 00000100:00100000:3.0:1746147182.143053:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567488 00010000:00010000:3.0:1746147182.143061:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 31 pid: 8480 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.143075:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5531 00000100:00100000:3.0:1746147182.143081:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463567360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.143094:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147182.143108:0:7120:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746147182.143113:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 30 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143122:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 30 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143140:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.143172:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463567360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.143177:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5531 00000100:00100000:3.0:1746147182.143190:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5532 00000100:00100000:3.0:1746147182.143194:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463567616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.143200:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.143211:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 18 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143218:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 18 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143230:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2b800/0xb4b2209fbdac591e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f4d expref: 18 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143239:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.143252:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463567616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.143256:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5532 00000100:00100000:3.0:1746147182.143265:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5533 00000100:00100000:3.0:1746147182.143269:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463567488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.143274:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.143282:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 31 pid: 8480 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143289:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 31 pid: 8480 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.143299:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.143311:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463567488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.143317:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5533 00010000:00010000:3.0:1746147182.143344:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e813600/0xb4b2209fbdac5494 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c9f expref: 30 pid: 8480 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.143351:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466341888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143359:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466342144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143366:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466342400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.143384:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.143404:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466342656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143411:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466342784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143417:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466343040:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.143431:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.143447:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63600/0xb4b2209fbdac549b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ca6 expref: 29 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.143463:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143469:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143474:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466342528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.143484:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.143500:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466343424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.143507:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.143522:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343552:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143528:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343680:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143534:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343808:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.143539:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466343936:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.143551:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.150335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.150545:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568640 00000100:00100000:0.0:1746147182.150553:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568640 00010000:00010000:0.0:1746147182.150580:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 17 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150597:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568512 00000100:00100000:0.0:1746147182.150598:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568512 00010000:00010000:0.0:1746147182.150611:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 46 pid: 21080 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150617:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568768 00000100:00100000:0.0:1746147182.150618:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568768 00010000:00010000:0.0:1746147182.150624:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 47 pid: 4445 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150630:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567744 00000100:00100000:0.0:1746147182.150631:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567744 00010000:00010000:0.0:1746147182.150646:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 48 pid: 8478 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.150653:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568000 00000100:00100000:0.0:1746147182.150654:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568000 00010000:00010000:0.0:1746147182.150661:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150671:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568256 00000100:00100000:0.0:1746147182.150673:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568256 00010000:00010000:0.0:1746147182.150677:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 18 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150683:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463567872 00000100:00100000:0.0:1746147182.150684:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463567872 00010000:00010000:0.0:1746147182.150688:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 19 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150693:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568128 00000100:00100000:0.0:1746147182.150694:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568128 00010000:00010000:0.0:1746147182.150700:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 33 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150706:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568896 00000100:00100000:0.0:1746147182.150707:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568896 00010000:00010000:0.0:1746147182.150714:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 30 pid: 17548 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.150719:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569152 00000100:00100000:0.0:1746147182.150720:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569152 00010000:00010000:0.0:1746147182.150726:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 29 pid: 8481 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.150731:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569280 00000100:00100000:0.0:1746147182.150732:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569280 00010000:00010000:0.0:1746147182.150737:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 30 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.150744:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569408 00000100:00100000:0.0:1746147182.150745:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569408 00010000:00010000:0.0:1746147182.150750:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.150758:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5534 00000100:00100000:0.0:1746147182.150764:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463568640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.150775:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.150789:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 19 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150799:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 19 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150815:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac5925 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f54 expref: 19 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150827:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.150856:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:1958:x1830967463568640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.150862:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5534 00000100:00100000:0.0:1746147182.150894:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5535 00000100:00100000:0.0:1746147182.150898:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1958:x1830967463568512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.150904:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.150913:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 48 pid: 21080 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150920:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 48 pid: 21080 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150928:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc0a200/0xb4b2209fbdac553c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5d01 expref: 48 pid: 21080 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150950:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.150962:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5536 00000100:00100000:0.0:1746147182.150966:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1958:x1830967463568768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.150971:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.150978:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 47 pid: 4445 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150983:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 47 pid: 4445 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150991:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e1000/0xb4b2209fbdac5892 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f00 expref: 47 pid: 4445 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.150998:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.151009:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967463568768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.151013:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5536 00000100:00100000:0.0:1746147182.151022:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5537 00000100:00100000:0.0:1746147182.151026:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967463567744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.151030:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.151036:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.151043:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.151051:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64e3400/0xb4b2209fbdac5718 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e12 expref: 45 pid: 8478 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.151057:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.151066:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463567744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.151069:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5537 00000100:00100000:0.0:1746147182.151075:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5538 00000100:00100000:0.0:1746147182.151079:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463568000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.151083:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.151092:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151099:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151107:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2200/0xb4b2209fbdac5416 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c60 expref: 17 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151117:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.151126:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463568000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 47us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.151130:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5538 00000100:00100000:0.0:1746147182.151137:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5539 00000100:00100000:0.0:1746147182.151140:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463568256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.151144:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.151149:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151155:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151161:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d00c00/0xb4b2209fbdac5806 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e97 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151167:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.151175:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463568256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.151179:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5539 00000100:00100000:0.0:1746147182.151186:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5540 00000100:00100000:0.0:1746147182.151189:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463567872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.151193:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.151198:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.151203:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5541 00010000:00010000:0.0:1746147182.151204:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.151211:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463568128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.151212:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e812000/0xb4b2209fbdac542b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5c67 expref: 15 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151218:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.151219:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.151219:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.151223:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.151229:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 34 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151229:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.151238:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 34 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151246:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.151255:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463567872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (809us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147182.151256:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f5a000/0xb4b2209fbdac552e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cfa expref: 34 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.151259:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5540 00000100:00100000:0.0:1746147182.151266:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5542 00010000:00010000:3.0:1746147182.151269:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.151270:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147182.151270:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463568896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.151273:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.151274:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.151279:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.151281:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 30 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151287:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 30 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.151294:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147182.151296:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df16000/0xb4b2209fbdac58e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f2a expref: 30 pid: 17548 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.151302:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.151311:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463568128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.151312:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463568896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.151317:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5541 00000100:00100000:1.0:1746147182.151577:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463568384 00000100:00100000:1.0:1746147182.151582:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463568384 00002000:00100000:1.0:1746147182.151605:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1335296->2052095) req@ffff88009f045c00 x1830967463568384/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.151613:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967463568384 ext(1335296->2052095) 00010000:00010000:1.0:1746147182.151620:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 33 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.151642:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 33 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:1.0:1746147182.151652:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:1.0:1746147182.151665:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1462 00000100:00100000:1.0:1746147182.151671:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463568384:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147182.152235:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569024 00000100:00100000:2.0:1746147182.152239:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569024 00000100:00100000:2.0:1746147182.152257:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11318 00000100:00100000:2.0:1746147182.152262:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28675:x1830967463569024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.152270:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.152280:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f85 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.152291:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.152293:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.152297:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147182.152300:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4870144->5242879] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.152309:0:6881:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.152317:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4870144->5242879] (req 4870144->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.152328:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86f800, rc 0) 00000100:00100000:2.0:1746147182.152342:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28675:x1830967463569024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 80us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.152346:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11318 00000100:00100000:0.0:1746147182.152493:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5542 00000100:00080000:0.0:1746147182.152522:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147182.152533:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152540:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152555:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152561:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152568:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152573:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5dd400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147182.152575:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152585:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152595:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152600:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd400/0xb4b2209fbdac5995 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.152629:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463566720:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 18412us (18580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.152646:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11313 00000100:00100000:0.0:1746147182.152803:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463568512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1902us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.152810:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5535 00000100:00100000:0.0:1746147182.152839:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5543 00000100:00100000:0.0:1746147182.152844:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463569152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.152852:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.152861:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 30 pid: 8481 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152868:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 30 pid: 8481 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152879:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4773000/0xb4b2209fbdac57f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e90 expref: 30 pid: 8481 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152887:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.152898:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463569152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 55us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.152903:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5543 00000100:00100000:0.0:1746147182.152913:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5544 00000100:00100000:0.0:1746147182.152917:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463569280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.152922:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.152929:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 28 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152950:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 28 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152960:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d080c00/0xb4b2209fbdac5829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5eba expref: 28 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.152968:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.152969:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147182.152972:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5545 00010000:00010000:0.0:1746147182.152972:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152977:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.152993:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.153005:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463569280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.153010:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5544 00010000:00010000:0.0:1746147182.153056:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153062:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153073:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153078:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153083:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153088:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c10600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147182.153090:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153098:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153105:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.153114:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c10600/0xb4b2209fbdac59b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.153283:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466343296:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.153303:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153319:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153325:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153340:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153349:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153355:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153360:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094450600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147182.153362:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153368:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153377:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.153382:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094450600/0xb4b2209fbdac598e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.154129:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463569408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.154139:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.154152:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.154159:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463566592:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 19994us (20130us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147182.154160:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.154166:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11312 00010000:00010000:2.0:1746147182.154170:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e811a00/0xb4b2209fbdac58b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f15 expref: 34 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.154179:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.154181:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147182.154182:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463567232:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15484us (15635us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147182.154184:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.154188:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11317 00010000:00010000:2.0:1746147182.154190:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154204:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.154225:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463569408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1245us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.154230:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5545 00010000:00010000:2.0:1746147182.154247:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154255:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154266:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154271:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154276:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154283:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4773400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147182.154285:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154290:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154297:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.154297:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.154301:0:17530:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154311:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.154331:0:17530:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.154340:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466344064:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147182.154383:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.154711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.155107:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569536 00000100:00100000:3.0:1746147182.155114:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569536 00010000:00010000:3.0:1746147182.155132:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 27 pid: 6881 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.155153:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5546 00000100:00100000:3.0:1746147182.155158:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463569536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.155165:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.155175:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 27 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.155183:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 27 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.155194:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e5600/0xb4b2209fbdac5765 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5e43 expref: 27 pid: 6881 timeout: 669 lvb_type: 1 00010000:00010000:3.0:1746147182.155203:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.155204:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.155207:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155213:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155225:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.155246:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463569536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.155252:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5546 00010000:00010000:3.0:1746147182.155267:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155273:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155284:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155293:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155298:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155303:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5dcc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147182.155305:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155310:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155317:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.155322:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dcc00/0xb4b2209fbdac599c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.155351:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463566848:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20937us (21277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.155357:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11314 00000001:00080000:2.0:1746147182.155725:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840563 is committed 00000001:00080000:2.0:1746147182.155736:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840553 is committed 00000001:00080000:2.0:1746147182.155748:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840518 is committed 00000001:00080000:2.0:1746147182.155757:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840514 is committed 00000001:00080000:2.0:1746147182.155761:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840568 is committed 00000001:00080000:2.0:1746147182.155767:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840562 is committed 00000001:00080000:2.0:1746147182.155798:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840567 is committed 00000001:00080000:2.0:1746147182.155823:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840569 is committed 00000100:00100000:0.0:1746147182.164975:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967463568384:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13298us (14640us total) trans 21474840570 rc 0/0 00000100:00100000:0.0:1746147182.164986:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1462 00002000:00100000:0.0:1746147182.164999:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1335296->2052095) req@ffff88009f045c00 x1830967463568384/t21474840570(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.165225:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830967463568384 ext(1335296->2052095) 00010000:00010000:0.0:1746147182.165234:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.165249:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:0.0:1746147182.165255:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746147182.165456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.165470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.165481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.165503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.165517:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569792 00000100:00100000:0.0:1746147182.165524:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569792 00000100:00100000:0.0:1746147182.165545:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463570048 00000100:00100000:0.0:1746147182.165547:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463570048 00000100:00100000:0.0:1746147182.165555:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569664 00000100:00100000:0.0:1746147182.165556:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569664 00000100:00100000:0.0:1746147182.165564:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463569920 00000100:00100000:0.0:1746147182.165565:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463569920 00000100:00100000:0.0:1746147182.165574:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11319 00000100:00100000:0.0:1746147182.165580:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463569792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.165592:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.165604:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f93 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147182.165620:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814176b, atime: 0x6814176b, ctime: 0x6814176b, blocks: 0x821 00010000:00010000:0.0:1746147182.165645:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165647:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165654:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165666:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165675:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904ed400, rc 0) 00000100:00100000:0.0:1746147182.165694:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463569792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.165698:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11319 00000100:00100000:0.0:1746147182.165708:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11320 00000100:00100000:0.0:1746147182.165712:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463570048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.165721:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.165727:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904ec000/0xb4b2209fbdac59c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fa1 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.165757:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466344192:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147182.165806:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.165820:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11321 00000100:00100000:0.0:1746147182.165825:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463569664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.165830:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.165836:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f8c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147182.165846:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x6814176b, atime: 0x6814176b, ctime: 0x6814176b, blocks: 0x7f7 00010000:00010000:0.0:1746147182.165852:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165853:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165857:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165866:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165871:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ee00, rc 0) 00000100:00100000:0.0:1746147182.165885:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463569664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 60us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.165889:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11321 00000100:00100000:0.0:1746147182.165897:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11322 00000100:00100000:0.0:1746147182.165902:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463569920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.165906:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.165913:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5f9a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147182.165921:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x6814176d, atime: 0x6814176b, ctime: 0x6814176d, blocks: 0x81f 00010000:00010000:0.0:1746147182.165927:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165928:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.165931:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165956:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.165962:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72e800, rc 0) 00000100:00100000:0.0:1746147182.165975:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463569920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.165980:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11322 00000100:00100000:3.0:1746147182.166150:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466344064:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147182.166166:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.166173:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac59a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.166203:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463567104:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 31738us (32091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.166208:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11315 00000100:00100000:0.0:1746147182.167146:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.168845:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463570176 00000100:00100000:2.0:1746147182.168853:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463570176 00000100:00100000:2.0:1746147182.168897:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11323 00000100:00100000:2.0:1746147182.168905:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463570176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.168918:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.168932:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fa8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147182.168965:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x6814176d, atime: 0x6814176d, ctime: 0x6814176d, blocks: 0x1029 00010000:00010000:2.0:1746147182.168980:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.168982:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.168989:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 29 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.169002:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 29 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.169011:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e600, rc 0) 00000100:00100000:2.0:1746147182.169048:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463570176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.169053:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11323 00000100:00100000:2.0:1746147182.174305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.174343:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463570304 00000100:00100000:3.0:1746147182.174351:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463570304 00010000:00010000:3.0:1746147182.174381:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.174407:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5547 00000100:00100000:3.0:1746147182.174414:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1959:x1830967463570304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.174426:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.174443:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.174452:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.174453:0:4444:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8801312a7480 x1830967466344192) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.174474:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.174474:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df16e00/0xb4b2209fbdac58ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1335296->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f31 expref: 15 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.174475:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.174479:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.174483:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466344192:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147182.174486:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174500:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147182.174505:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904ec000/0xb4b2209fbdac59c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa1 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.174513:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904ec000/0xb4b2209fbdac59c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa1 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.174519:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904ec000, rc 0) 00000100:00100000:3.0:1746147182.174529:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1959:x1830967463570304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.174533:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1957:x1830967463570048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8820us (9063us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147182.174535:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5547 00000100:00100000:1.0:1746147182.174537:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11320 00010000:00010000:3.0:1746147182.174553:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174560:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174575:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174582:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174588:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174598:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1b400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147182.174601:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174608:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174617:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.174622:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1b400/0xb4b2209fbdac59aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.174666:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463566976:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 39757us (40578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.174672:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11316 00000100:00100000:0.0:1746147182.191795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.191827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.191857:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463570816 00000100:00100000:0.0:1746147182.191865:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463570816 00000100:00100000:1.0:1746147182.191872:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463570560 00000100:00100000:1.0:1746147182.191875:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463570560 00000100:00100000:0.0:1746147182.191901:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10416 00000100:00100000:1.0:1746147182.191906:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4107 00000100:00100000:0.0:1746147182.191908:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:28676:x1830967463570816:12345-192.168.203.36@tcp:36:mirror_io.0 00000100:00100000:1.0:1746147182.191910:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28675:x1830967463570560:12345-192.168.203.36@tcp:35:cat.0 00010000:00010000:0.0:1746147182.191951:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147182.191976:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e810800/0xb4b2209fbdac5979 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f77 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.191990:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147182.191994:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.192041:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:28676:x1830967463570816:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 133us (213us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746147182.192048:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10416 00000100:00100000:1.0:1746147182.193791:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28675:x1830967463570560:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1562us (1687us total) trans 8589944148 rc 0/0 00000100:00100000:1.0:1746147182.193801:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4107 00000100:00100000:0.0:1746147182.195277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.195300:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571072 00000100:00100000:1.0:1746147182.195309:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571072 00000100:00100000:1.0:1746147182.195341:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4108 00000100:00100000:1.0:1746147182.195347:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:28676:x1830967463571072:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147182.195465:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:28676:x1830967463571072:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 117us (189us total) trans 8589944149 rc 0/0 00000100:00100000:1.0:1746147182.195472:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4108 00000001:00080000:0.0:1746147182.200852:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873149 is committed 00000001:00080000:0.0:1746147182.200867:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873143 is committed 00000001:00080000:0.0:1746147182.200878:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873142 is committed 00000001:00080000:0.0:1746147182.200883:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873115 is committed 00000001:00080000:0.0:1746147182.200888:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873164 is committed 00000001:00080000:0.0:1746147182.200896:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873158 is committed 00000001:00080000:0.0:1746147182.200908:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873144 is committed 00000001:00080000:0.0:1746147182.200970:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873166 is committed 00000001:00080000:0.0:1746147182.201003:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873165 is committed 00000001:00080000:0.0:1746147182.201014:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873162 is committed 00000100:00100000:1.0:1746147182.201840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.201963:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571328 00000100:00100000:0.0:1746147182.201972:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571328 00000100:00100000:0.0:1746147182.202016:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4109 00000100:00100000:0.0:1746147182.202024:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:28676:x1830967463571328:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147182.202516:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:28676:x1830967463571328:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 490us (687us total) trans 8589944150 rc 0/0 00000100:00100000:0.0:1746147182.202524:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4109 00000100:00100000:0.0:1746147182.288701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.288982:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571456 00000100:00100000:3.0:1746147182.288992:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571456 00000100:00100000:3.0:1746147182.289046:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11324 00000100:00100000:3.0:1746147182.289053:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28680:x1830967463571456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147182.289070:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.289083:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5faf expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.289108:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.289115:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.289117:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.289120:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.289145:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.289155:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.289165:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466344320:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.290543:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.293416:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466344320:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.293442:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.293458:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edace00, rc 0) 00000100:00100000:3.0:1746147182.293515:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28680:x1830967463571456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4461us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.293523:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11324 00000100:00100000:0.0:1746147182.293608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.294549:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571584 00000100:00100000:2.0:1746147182.294557:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571584 00010000:00010000:2.0:1746147182.294582:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.294612:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5548 00000100:00100000:2.0:1746147182.294619:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463571584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.294640:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.294658:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.294668:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.294691:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e800/0xb4b2209fbdac59d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f9a expref: 10 pid: 8478 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.294716:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.294718:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.294723:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.294730:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.294758:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.294768:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466344448:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147182.294823:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.296663:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466344448:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147182.296677:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.296714:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463571584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2095us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.296721:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5548 00000100:00100000:0.0:1746147182.303022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.303123:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571840 00000100:00100000:2.0:1746147182.303133:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571840 00002000:00100000:2.0:1746147182.303171:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff8801312a7480 x1830967463571840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.303185:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a7480 with x1830967463571840 ext(1863680->1867775) 00002000:00010000:2.0:1746147182.303189:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a7480 00000100:00100000:2.0:1746147182.303207:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4240 00000100:00100000:2.0:1746147182.303214:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463571840:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147182.303371:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463571840:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 155us (356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147182.303377:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4240 00002000:00100000:2.0:1746147182.303383:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff8801312a7480 x1830967463571840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.303389:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a7480 with x1830967463571840 ext(1863680->1867775) 00002000:00010000:2.0:1746147182.303392:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a7480 00000100:00100000:0.0:1746147182.314018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.314070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.314218:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572224 00000100:00100000:1.0:1746147182.314227:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572224 00000100:00100000:3.0:1746147182.314237:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463571968 00000100:00100000:3.0:1746147182.314241:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463571968 00000100:00100000:1.0:1746147182.314268:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10417 00000100:00100000:3.0:1746147182.314270:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11325 00000100:00100000:3.0:1746147182.314276:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28680:x1830967463571968:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147182.314276:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28684:x1830967463572224:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147182.314292:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.314292:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.314305:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fb6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.314306:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530a00/0xb4b2209fbdac59e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fbd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147182.314323:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814176d, atime: 0x6814176d, ctime: 0x6814176d, blocks: 0x81f 00010000:00010000:3.0:1746147182.314338:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.314339:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.314345:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.314357:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.314365:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad000, rc 0) 00010000:00010000:1.0:1746147182.314435:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314444:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314452:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314463:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314468:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314473:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147182.314575:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28680:x1830967463571968:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 298us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.314581:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11325 00010000:00010000:1.0:1746147182.314772:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314783:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314789:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147182.314796:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147182.314867:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314873:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314878:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314882:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e530800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.314885:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314890:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314898:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147182.314901:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.314903:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314908:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530800/0xb4b2209fbdac59f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314931:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314962:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314967:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314970:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e531200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.314973:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314977:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314982:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f000) 00010000:00010000:1.0:1746147182.314984:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.314986:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.314991:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531200/0xb4b2209fbdac59fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.315020:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530a00/0xb4b2209fbdac59e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 320 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.315027:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.315032:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.315034:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147182.315036:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e531000, rc 0) 00000100:00100000:1.0:1746147182.315056:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28684:x1830967463572224:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 782us (986us total) trans 8589944151 rc 0/0 00000100:00100000:1.0:1746147182.315062:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10417 00000100:00100000:0.0:1746147182.324356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.324656:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572352 00000100:00100000:3.0:1746147182.324665:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572352 00000100:00100000:3.0:1746147182.324706:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11326 00000100:00100000:3.0:1746147182.324713:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28684:x1830967463572352:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147182.324730:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.324745:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fc4 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.324769:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.324779:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.324781:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.324784:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.324807:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 8 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.324817:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 8 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:3.0:1746147182.324827:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466344576:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.324923:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.330646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.331090:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572608 00000100:00100000:2.0:1746147182.331099:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572608 00002000:00100000:2.0:1746147182.331138:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1789952->1794047) req@ffff8801312a5500 x1830967463572608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.331147:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5500 with x1830967463572608 ext(1789952->1794047) 00002000:00010000:2.0:1746147182.331151:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5500 00000100:00100000:2.0:1746147182.331184:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4241 00000100:00100000:2.0:1746147182.331192:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463572608:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147182.331333:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463572608:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (703us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147182.331339:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4241 00002000:00100000:2.0:1746147182.331345:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1789952->1794047) req@ffff8801312a5500 x1830967463572608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.331351:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5500 with x1830967463572608 ext(1789952->1794047) 00002000:00010000:2.0:1746147182.331353:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5500 00000100:00100000:3.0:1746147182.331595:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466344576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.331619:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.331639:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad200, rc 0) 00000100:00100000:3.0:1746147182.331675:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28684:x1830967463572352:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6962us (7337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.331680:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11326 00000100:00100000:0.0:1746147182.340906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.340981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.341972:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463573760 00000100:00100000:0.0:1746147182.341983:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463573760 00000100:00100000:2.0:1746147182.342324:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572864 00000100:00100000:2.0:1746147182.342329:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572864 00000100:00100000:2.0:1746147182.342356:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572992 00000100:00100000:2.0:1746147182.342358:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572992 00000100:00100000:2.0:1746147182.342367:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463573120 00000100:00100000:2.0:1746147182.342369:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463573120 00000100:00100000:2.0:1746147182.342377:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463573248 00000100:00100000:2.0:1746147182.342379:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463573248 00000100:00100000:2.0:1746147182.342386:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463573376 00000100:00100000:2.0:1746147182.342388:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463573376 00000100:00100000:2.0:1746147182.342394:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463573504 00000100:00100000:2.0:1746147182.342396:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463573504 00000100:00100000:2.0:1746147182.342405:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11327 00000100:00100000:2.0:1746147182.342412:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463572864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.342426:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.342441:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fcb expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.342460:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342462:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342468:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342481:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 17 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342494:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e800, rc 0) 00000100:00100000:2.0:1746147182.342539:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463572864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 127us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.342544:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11327 00000100:00100000:2.0:1746147182.342558:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11328 00000100:00100000:2.0:1746147182.342563:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463572992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.342570:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.342578:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fd2 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.342588:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342595:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fd2 expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342602:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fd2 expref: 23 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342615:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86ec00, rc 0) 00000100:00100000:2.0:1746147182.342630:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463572992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 67us (1649us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.342643:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11328 00000100:00100000:2.0:1746147182.342653:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11329 00000100:00100000:2.0:1746147182.342657:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463573120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.342663:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.342669:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86f400/0xb4b2209fbdac5a28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fd9 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.342682:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11330 00000100:00100000:0.0:1746147182.342683:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4110 00000100:00100000:3.0:1746147182.342688:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463573248:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147182.342689:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28680:x1830967463573760:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:3.0:1746147182.342693:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.342699:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5a2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fe0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.342702:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466344704:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147182.342720:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466344832:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147182.342747:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11331 00000100:00100000:2.0:1746147182.342750:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.342751:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463573376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147182.342756:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.342762:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fe7 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.342764:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11332 00000100:00100000:2.0:1746147182.342768:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463573504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147182.342771:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.342772:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342773:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.342776:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342778:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5fee expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.342785:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342785:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342786:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342790:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.342792:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad800, rc 0) 00010000:00010000:2.0:1746147182.342797:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.342803:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86fa00, rc 0) 00000100:00100000:3.0:1746147182.342806:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463573376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.342811:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11331 00000100:00100000:2.0:1746147182.342814:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463573504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 46us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.342818:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11332 00000100:00100000:3.0:1746147182.342824:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.342838:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463572736 00000100:00100000:2.0:1746147182.342841:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463572736 00000100:00100000:0.0:1746147182.342846:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28680:x1830967463573760:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 157us (1737us total) trans 8589944152 rc 0/0 00000100:00100000:0.0:1746147182.342852:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4110 00010000:00010000:2.0:1746147182.342853:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 9 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.342871:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5549 00000100:00100000:2.0:1746147182.342875:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463572736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.342881:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.342895:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 9 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.342904:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 9 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.342915:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904ed400/0xb4b2209fbdac59bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f93 expref: 9 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.342922:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342923:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.342927:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.342932:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.342964:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.342972:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466344960:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147182.343002:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00002000:00010000:2.0:1746147182.344818:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147181 -> 1746147182 00002000:00010000:2.0:1746147182.344823:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147179 -> 1746147181 00002000:00010000:2.0:1746147182.344825:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147181 -> 1746147182 00000100:00100000:2.0:1746147182.344840:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466344704:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147182.344863:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86f400/0xb4b2209fbdac5a28 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fd9 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.344874:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86f400/0xb4b2209fbdac5a28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fd9 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.344882:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86f400, rc 0) 00000100:00100000:2.0:1746147182.344912:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463573120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2254us (3909us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.344919:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11329 00002000:00010000:3.0:1746147182.345460:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147181 -> 1746147182 00002000:00010000:3.0:1746147182.345464:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147181 -> 1746147182 00000100:00100000:3.0:1746147182.345475:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466344832:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147182.345492:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5a2f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe0 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.345502:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5a2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe0 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.345514:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edacc00, rc 0) 00000100:00100000:3.0:1746147182.345533:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463573248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2845us (4494us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147182.345538:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11330 00000100:00100000:2.0:1746147182.346981:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466344960:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147182.346993:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.347029:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463572736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4152us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.347036:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5549 00000100:00100000:0.0:1746147182.348230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.348374:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574016 00000100:00100000:3.0:1746147182.348381:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574016 00002000:00100000:3.0:1746147182.348411:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1966080->1970175) req@ffff88009f044000 x1830967463574016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.348419:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044000 with x1830967463574016 ext(1966080->1970175) 00002000:00010000:3.0:1746147182.348423:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044000 00000100:00100000:3.0:1746147182.348437:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4242 00000100:00100000:3.0:1746147182.348444:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463574016:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147182.349085:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463574016:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 639us (854us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147182.349091:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4242 00002000:00100000:3.0:1746147182.349096:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1966080->1970175) req@ffff88009f044000 x1830967463574016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.349104:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044000 with x1830967463574016 ext(1966080->1970175) 00002000:00010000:3.0:1746147182.349107:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044000 00000100:00100000:0.0:1746147182.351158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.351272:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574272 00000100:00100000:1.0:1746147182.351281:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574272 00000100:00100000:1.0:1746147182.351317:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10418 00000100:00100000:1.0:1746147182.351324:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28690:x1830967463574272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.351345:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.351359:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531600/0xb4b2209fbdac5a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ff5 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.351604:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351647:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351659:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351670:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351675:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351679:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351806:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351815:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351821:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147182.351828:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147182.351893:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351899:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351904:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351909:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e530200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.351912:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351918:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.351926:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147182.351929:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.351932:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352017:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530200/0xb4b2209fbdac5a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352320:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352326:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352333:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352337:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e530c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147182.352339:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352343:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352350:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f300) 00010000:00010000:1.0:1746147182.352352:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147182.352353:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352358:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e530c00/0xb4b2209fbdac5a52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.352391:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531600/0xb4b2209fbdac5a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.352402:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 27 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.352407:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.352409:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147182.352411:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e531800, rc 0) 00000100:00100000:1.0:1746147182.352674:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28690:x1830967463574272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1348us (1521us total) trans 8589944153 rc 0/0 00000100:00100000:1.0:1746147182.352681:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10418 00000100:00100000:0.0:1746147182.355884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.356240:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574400 00000100:00100000:3.0:1746147182.356249:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574400 00000100:00100000:3.0:1746147182.356296:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11333 00000100:00100000:3.0:1746147182.356304:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28684:x1830967463574400:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147182.356319:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.356333:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e5ffc expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.356355:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.356361:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.356362:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746147182.356436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147182.356552:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.356554:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574528 00000100:00100000:2.0:1746147182.356558:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574528 00010000:00010000:3.0:1746147182.356580:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.356589:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11334 00010000:00010000:3.0:1746147182.356590:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 8 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.356595:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463574528:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147182.356601:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466345088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.356602:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.356610:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8520400/0xb4b2209fbdac5a6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6003 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.356654:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345216:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147182.356677:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.357526:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.361227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.361256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.361293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.361314:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574784 00000100:00100000:0.0:1746147182.361370:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574784 00002000:00100000:0.0:1746147182.361410:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012ecec000 x1830967463574784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.361417:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967463574784 ext(0->1048575) 00000100:00100000:3.0:1746147182.361419:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466345088:192.168.203.36@tcp:104: 00002000:00010000:0.0:1746147182.361421:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecec000 00000100:00100000:0.0:1746147182.361435:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463574912 00000100:00100000:0.0:1746147182.361437:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463574912 00010000:00010000:3.0:1746147182.361440:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147182.361447:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff88012ecee300 x1830967463574912/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.361453:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967463574912 ext(1863680->2097151) 00010000:00010000:3.0:1746147182.361457:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad600, rc 0) 00010000:00010000:0.0:1746147182.361457:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.361466:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:0.0:1746147182.361470:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecee300 00000100:00100000:0.0:1746147182.361477:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463575168 00000100:00100000:0.0:1746147182.361479:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463575168 00002000:00100000:0.0:1746147182.361486:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1966079) req@ffff88012ecef480 x1830967463575168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.361492:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef480 with x1830967463575168 ext(1048576->1966079) 00000100:00100000:3.0:1746147182.361493:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28684:x1830967463574400:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5190us (5615us total) trans 0 rc 0/0 00002000:00010000:0.0:1746147182.361494:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef480 00000100:00100000:3.0:1746147182.361500:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11333 00000100:00100000:0.0:1746147182.361502:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1463 00000100:00100000:0.0:1746147182.361507:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463574912:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147182.361535:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4243 00000100:00100000:3.0:1746147182.361540:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463574784:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.361882:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4244 00000100:00100000:1.0:1746147182.361890:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463575168:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:2.0:1746147182.362549:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147179 -> 1746147182 00002000:00010000:2.0:1746147182.362553:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147179 -> 1746147182 00002000:00010000:2.0:1746147182.362554:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147179 -> 1746147182 00000100:00100000:2.0:1746147182.362563:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345216:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147182.362580:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8520400/0xb4b2209fbdac5a6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6003 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.362589:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8520400/0xb4b2209fbdac5a6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6003 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.362601:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8520400, rc 0) 00000100:00100000:2.0:1746147182.362622:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463574528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6027us (6187us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.362627:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11334 00000100:00100000:0.0:1746147182.369387:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463574912:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7873us (8125us total) trans 17179873167 rc 0/0 00000100:00100000:0.0:1746147182.369396:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1463 00002000:00100000:0.0:1746147182.369406:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff88012ecee300 x1830967463574912/t17179873167(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.369414:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967463574912 ext(1863680->2097151) 00010000:00010000:0.0:1746147182.369422:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.369433:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:0.0:1746147182.369438:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecee300 00000100:00100000:0.0:1746147182.371567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.373260:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463575424 00000100:00100000:2.0:1746147182.373271:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463575424 00002000:00100000:2.0:1746147182.373307:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012eceed80 x1830967463575424/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.373317:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967463575424 ext(0->1048575) 00002000:00010000:2.0:1746147182.373321:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceed80 00000100:00100000:2.0:1746147182.373346:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4245 00000100:00100000:2.0:1746147182.373352:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463575424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.376118:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463575168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14222us (14816us total) trans 0 rc 917504/917504 00000100:00100000:0.0:1746147182.376128:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4244 00002000:00100000:0.0:1746147182.376136:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1966079) req@ffff88012ecef480 x1830967463575168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.376145:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef480 with x1830967463575168 ext(1048576->1966079) 00002000:00010000:0.0:1746147182.376149:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef480 00000100:00100000:0.0:1746147182.380600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.380677:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463575552 00000100:00100000:2.0:1746147182.380686:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463575552 00010000:00010000:2.0:1746147182.380717:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.381101:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5550 00000100:00100000:2.0:1746147182.381109:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463575552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.381122:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.381177:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.381188:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.381207:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac59e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5faf expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.382054:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.382056:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.382063:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.382070:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.382098:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.382112:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466345344:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147182.382254:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463574784:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20712us (21037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.382262:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4243 00002000:00100000:3.0:1746147182.382270:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012ecec000 x1830967463574784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.382279:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecec000 with x1830967463574784 ext(0->1048575) 00002000:00010000:3.0:1746147182.382283:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecec000 00000100:00100000:2.0:1746147182.382346:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.384530:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463575424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11172us (12963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.384539:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4245 00002000:00100000:3.0:1746147182.384547:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012eceed80 x1830967463575424/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.384555:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967463575424 ext(0->1048575) 00002000:00010000:3.0:1746147182.384560:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012eceed80 00000100:00100000:0.0:1746147182.386021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.386131:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466345344:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147182.386147:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.386174:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1958:x1830967463575552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5065us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.386182:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5550 00000100:00100000:3.0:1746147182.386325:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463575808 00000100:00100000:3.0:1746147182.386331:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463575808 00002000:00100000:3.0:1746147182.386361:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1085440->1089535) req@ffff880099f6a300 x1830967463575808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.386369:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967463575808 ext(1085440->1089535) 00002000:00010000:3.0:1746147182.386372:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:3.0:1746147182.386386:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4246 00000100:00100000:3.0:1746147182.386393:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463575808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147182.386536:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463575808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 143us (518us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147182.386543:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4246 00002000:00100000:3.0:1746147182.386547:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1085440->1089535) req@ffff880099f6a300 x1830967463575808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.386554:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967463575808 ext(1085440->1089535) 00002000:00010000:3.0:1746147182.386557:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:0.0:1746147182.389017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.389113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.389192:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576320 00000100:00100000:3.0:1746147182.389200:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576320 00000100:00100000:3.0:1746147182.389238:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4111 00000100:00100000:3.0:1746147182.389245:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28684:x1830967463576320:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147182.389619:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576064 00000100:00100000:2.0:1746147182.389624:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576064 00002000:00100000:2.0:1746147182.389656:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1089536->2097151) req@ffff880099f6aa00 x1830967463576064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.389665:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6aa00 with x1830967463576064 ext(1089536->2097151) 00002000:00010000:2.0:1746147182.389669:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6aa00 00000100:00100000:2.0:1746147182.389683:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4247 00000100:00100000:2.0:1746147182.389689:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463576064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147182.390735:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:28684:x1830967463576320:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1486us (1618us total) trans 8589944154 rc 0/0 00000100:00100000:3.0:1746147182.390743:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4111 00000100:00100000:0.0:1746147182.400751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.401055:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576448 00000100:00100000:2.0:1746147182.401063:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576448 00000100:00100000:2.0:1746147182.401115:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11335 00000100:00100000:2.0:1746147182.401122:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28690:x1830967463576448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.401136:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.401148:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e600a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.401170:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.401176:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147182.401178:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147182.401181:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.401200:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.401209:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.401219:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345472:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.401233:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463576064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11544us (12221us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746147182.401242:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4247 00002000:00100000:3.0:1746147182.401250:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1089536->2097151) req@ffff880099f6aa00 x1830967463576064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.401258:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6aa00 with x1830967463576064 ext(1089536->2097151) 00002000:00010000:3.0:1746147182.401261:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6aa00 00000100:00100000:2.0:1746147182.401261:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.403232:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345472:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.403250:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.403261:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86ec00, rc 0) 00000100:00100000:2.0:1746147182.403298:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28690:x1830967463576448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2176us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.403304:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11335 00000100:00100000:0.0:1746147182.404617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.404726:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576576 00000100:00100000:3.0:1746147182.404733:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576576 00002000:00100000:3.0:1746147182.404765:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1966080->2097151) req@ffff880099f69500 x1830967463576576/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.404773:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967463576576 ext(1966080->2097151) 00010000:00010000:3.0:1746147182.404779:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.404790:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 22 pid: 4444 timeout: 669 lvb_type: 0 00002000:00010000:3.0:1746147182.404795:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69500 00000100:00100000:3.0:1746147182.404810:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1464 00000100:00100000:3.0:1746147182.404818:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463576576:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147182.407445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.407497:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576704 00000100:00100000:3.0:1746147182.407504:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576704 00000100:00100000:3.0:1746147182.407542:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11336 00000100:00100000:3.0:1746147182.407547:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28688:x1830967463576704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147182.407559:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.407570:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6011 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.407589:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.407594:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.407595:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.407597:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.407620:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.407629:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 7 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.407658:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466345600:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.407726:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.408806:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463576576:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3986us (4189us total) trans 17179873168 rc 0/0 00000100:00100000:2.0:1746147182.408814:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1464 00002000:00100000:2.0:1746147182.408823:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1966080->2097151) req@ffff880099f69500 x1830967463576576/t17179873168(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.408830:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967463576576 ext(1966080->2097151) 00010000:00010000:2.0:1746147182.408837:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.408846:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.408852:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69500 00000100:00100000:3.0:1746147182.409596:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466345600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.409615:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.409627:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac800, rc 0) 00000100:00100000:3.0:1746147182.409727:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28688:x1830967463576704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2177us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.409733:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11336 00000100:00100000:0.0:1746147182.412805:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.413064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.413135:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576832 00000100:00100000:2.0:1746147182.413143:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576832 00002000:00100000:2.0:1746147182.413181:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1794047) req@ffff880099f6b800 x1830967463576832/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.413190:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b800 with x1830967463576832 ext(1048576->1794047) 00010000:00010000:2.0:1746147182.413197:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 8 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.413207:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 8 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.413213:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099f6b800 00000100:00100000:2.0:1746147182.413242:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1465 00000100:00100000:2.0:1746147182.413249:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463576832:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147182.413477:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463576960 00000100:00100000:3.0:1746147182.413481:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463576960 00010000:00010000:3.0:1746147182.413497:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.413525:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5551 00000100:00100000:3.0:1746147182.413529:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463576960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.413536:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.413549:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.413558:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.413668:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5a13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fc4 expref: 24 pid: 4444 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.413692:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.413695:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.413700:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.413708:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.413736:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.413747:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466345728:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147182.413885:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.415992:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466345728:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147182.416006:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.416043:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463576960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2512us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.416051:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5551 00000100:00100000:1.0:1746147182.419897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.420004:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577216 00000100:00100000:0.0:1746147182.420013:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577216 00002000:00100000:0.0:1746147182.420050:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800929f4380 x1830967463577216/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.420059:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4380 with x1830967463577216 ext(1048576->2097151) 00002000:00010000:0.0:1746147182.420064:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f4380 00000100:00100000:0.0:1746147182.420090:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4248 00000100:00100000:0.0:1746147182.420098:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463577216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.425810:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463576832:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12551us (13001us total) trans 21474840571 rc 0/0 00000100:00100000:2.0:1746147182.425825:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1465 00002000:00100000:2.0:1746147182.425838:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1794047) req@ffff880099f6b800 x1830967463576832/t21474840571(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.425847:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b800 with x1830967463576832 ext(1048576->1794047) 00010000:00010000:2.0:1746147182.425856:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.425870:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.425876:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099f6b800 00000100:00100000:2.0:1746147182.427544:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463577216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7439us (7646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.427553:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4248 00002000:00100000:2.0:1746147182.427561:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800929f4380 x1830967463577216/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.427568:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4380 with x1830967463577216 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.427572:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f4380 00000100:00100000:0.0:1746147182.437880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.437970:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577344 00000100:00100000:3.0:1746147182.437981:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577344 00010000:00010000:3.0:1746147182.438015:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.438049:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5552 00000100:00100000:3.0:1746147182.438057:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463577344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.438071:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.438092:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.438104:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.438122:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac59f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fb6 expref: 10 pid: 17548 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.438151:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.438153:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.438159:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.438169:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.438198:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.438210:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466345856:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147182.438303:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.440335:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.440421:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577472 00000100:00100000:3.0:1746147182.440428:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577472 00000100:00100000:3.0:1746147182.440473:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11337 00000100:00100000:3.0:1746147182.440480:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28690:x1830967463577472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147182.440494:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.440507:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6018 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.440530:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.440535:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.440537:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147182.440540:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.440564:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.440579:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 22 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.440588:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345984:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147182.440667:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.443353:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466345856:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147182.443371:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.443410:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463577344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5354us (5537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.443418:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5552 00000100:00100000:0.0:1746147182.444153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.444404:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466345984:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147182.444421:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.444435:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edade00, rc 0) 00000100:00100000:2.0:1746147182.444507:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577600 00000100:00100000:2.0:1746147182.444513:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577600 00002000:00100000:2.0:1746147182.444545:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1089535) req@ffff880099f68380 x1830967463577600/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.444552:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967463577600 ext(1048576->1089535) 00010000:00010000:2.0:1746147182.444558:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 23 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.444581:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 23 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.444586:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68380 00000100:00100000:2.0:1746147182.444601:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1466 00000100:00100000:2.0:1746147182.444606:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463577600:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147182.445088:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28690:x1830967463577472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4607us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.445095:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11337 00000100:00100000:0.0:1746147182.446492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.446882:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577856 00000100:00100000:3.0:1746147182.446889:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577856 00002000:00100000:3.0:1746147182.446917:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880099f69f80 x1830967463577856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.446925:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967463577856 ext(1048576->2097151) 00002000:00010000:3.0:1746147182.446929:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69f80 00000100:00100000:1.0:1746147182.447227:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4249 00000100:00100000:1.0:1746147182.447236:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463577856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.447452:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463577600:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2844us (3298us total) trans 17179873169 rc 0/0 00000100:00100000:2.0:1746147182.447458:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1466 00002000:00100000:2.0:1746147182.447463:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1089535) req@ffff880099f68380 x1830967463577600/t17179873169(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.447469:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967463577600 ext(1048576->1089535) 00010000:00010000:2.0:1746147182.447475:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.447485:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.447500:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f68380 00000100:00100000:0.0:1746147182.450820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.450875:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463577984 00000100:00100000:3.0:1746147182.450883:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463577984 00010000:00010000:3.0:1746147182.450915:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.450955:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5553 00000100:00100000:3.0:1746147182.450963:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463577984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.450976:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147182.450990:0:8494:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147181 -> 1746147182 00010000:00010000:3.0:1746147182.450996:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.451008:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.451026:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edad600/0xb4b2209fbdac5a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ffc expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.451040:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.451042:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.451048:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.451056:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.451091:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.451103:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466346112:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147182.451168:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.458183:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466346112:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147182.458203:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.458887:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463577984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7923us (8070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.458898:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5553 00000100:00100000:0.0:1746147182.459627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.459713:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463578240 00000100:00100000:3.0:1746147182.459720:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463578240 00002000:00100000:3.0:1746147182.459752:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880099f6a680 x1830967463578240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.459761:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967463578240 ext(1048576->2097151) 00002000:00010000:3.0:1746147182.459765:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a680 00000100:00100000:1.0:1746147182.460046:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463577856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12809us (13555us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.460053:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4249 00002000:00100000:1.0:1746147182.460058:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880099f69f80 x1830967463577856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.460064:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967463577856 ext(1048576->2097151) 00002000:00010000:1.0:1746147182.460067:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69f80 00000100:00100000:1.0:1746147182.460080:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4250 00000100:00100000:1.0:1746147182.460087:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463578240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.467875:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463578240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7778us (8240us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.467885:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4250 00002000:00100000:1.0:1746147182.467896:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880099f6a680 x1830967463578240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.467904:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967463578240 ext(1048576->2097151) 00002000:00010000:1.0:1746147182.467909:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6a680 00000100:00100000:0.0:1746147182.476751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.477914:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463578624 00000100:00100000:0.0:1746147182.477919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.477924:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463578624 00000100:00100000:1.0:1746147182.477951:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463579648 00000100:00100000:1.0:1746147182.477956:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463579648 00000100:00100000:0.0:1746147182.477963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.477973:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11338 00000100:00100000:3.0:1746147182.477981:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28690:x1830967463578624:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147182.477988:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10419 00000100:00100000:1.0:1746147182.477994:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28694:x1830967463579648:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147182.477997:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147182.477999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147182.478007:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147182.478011:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e601f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.478017:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac5a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6026 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.478029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147182.478031:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.478033:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.478038:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.478054:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.478063:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edada00, rc 0) 00000100:00100000:0.0:1746147182.478066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.478082:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463578752 00000100:00100000:3.0:1746147182.478085:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463578752 00000100:00100000:0.0:1746147182.478090:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463578880 00000100:00100000:0.0:1746147182.478092:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463578880 00002000:00100000:3.0:1746147182.478104:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880099f6b480 x1830967463578752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.478104:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f6bb80 x1830967463578880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.478112:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b480 with x1830967463578752 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.478116:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6b480 00002000:00100000:0.0:1746147182.478117:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967463578880 ext(3145728->4194303) 00002000:00010000:0.0:1746147182.478119:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:3.0:1746147182.478124:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463579264 00000100:00100000:3.0:1746147182.478125:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463579264 00000100:00100000:0.0:1746147182.478130:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463579136 00000100:00100000:0.0:1746147182.478132:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463579136 00002000:00100000:3.0:1746147182.478135:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edcb480 x1830967463579264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.478139:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9500 x1830967463579136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.478141:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830967463579264 ext(3145728->4194303) 00002000:00010000:3.0:1746147182.478144:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00002000:00100000:0.0:1746147182.478145:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9500 with x1830967463579136 ext(2097152->3145727) 00002000:00010000:0.0:1746147182.478147:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9500 00000100:00100000:3.0:1746147182.478151:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4251 00000100:00100000:0.0:1746147182.478154:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4252 00000100:00100000:3.0:1746147182.478156:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463578752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.478158:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463578880:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147182.478313:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.478326:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.478332:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.478337:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.478365:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.478375:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 28 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.478385:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466346240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.478448:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 319 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.478454:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 319 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.478461:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466346368:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.478475:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.478490:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4253 00000100:00100000:1.0:1746147182.478495:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463579264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.478654:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4254 00000100:00100000:2.0:1746147182.478662:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463579136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.478721:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28690:x1830967463578624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 740us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.478729:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11338 00000100:00100000:1.0:1746147182.482912:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466346240:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147182.482997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.483014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.483039:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466346368:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147182.483049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147182.483057:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147182.483067:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463580160 00000100:00100000:0.0:1746147182.483072:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463580160 00000100:00100000:1.0:1746147182.483073:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463579776 00000100:00100000:1.0:1746147182.483076:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463579776 00010000:00010000:1.0:1746147182.483093:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 29 pid: 14125 timeout: 669 lvb_type: 0 00002000:00100000:0.0:1746147182.483099:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009edc9180 x1830967463580160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.483107:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967463580160 ext(1048576->2097151) 00002000:00010000:0.0:1746147182.483113:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:1.0:1746147182.483118:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463579904 00000100:00100000:1.0:1746147182.483120:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463579904 00010000:00010000:1.0:1746147182.483127:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 320 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147182.483130:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5554 00000100:00100000:0.0:1746147182.483137:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463579776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147182.483139:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5555 00000100:00100000:1.0:1746147182.483143:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967463579904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147182.483147:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.483149:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.483153:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 320 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.483153:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 29 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.483164:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 320 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.483177:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 29 pid: 14125 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.483217:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4255 00000100:00100000:2.0:1746147182.483223:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463580160:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147182.483617:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531000/0xb4b2209fbdac5a05 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fbd expref: 320 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.483655:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.483659:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.483666:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147182.483670:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.483696:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1956:x1830967463579904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 551us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.483702:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5555 00010000:00010000:0.0:1746147182.485275:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e531800/0xb4b2209fbdac5a59 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ff5 expref: 29 pid: 14125 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.485297:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147182.485300:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.485305:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.485309:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.485324:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.485346:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463579776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2210us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.485352:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5554 00010000:00010000:0.0:1746147182.485453:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147182.485459:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147182.485473:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147182.485565:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095371000/0xb4b2209fbdac5a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 29 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.485576:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.485580:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147182.485582:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147182.485587:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370000, rc 0) 00000100:00100000:0.0:1746147182.485601:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28694:x1830967463579648:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7608us (7683us total) trans 8589944155 rc 0/0 00000100:00100000:0.0:1746147182.485605:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10419 00000100:00100000:3.0:1746147182.491778:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463578880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13610us (13770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.491787:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4252 00002000:00100000:3.0:1746147182.491798:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f6bb80 x1830967463578880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.491812:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6bb80 with x1830967463578880 ext(3145728->4194303) 00002000:00010000:3.0:1746147182.491816:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6bb80 00000100:00100000:0.0:1746147182.492577:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463579264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14077us (14543us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147182.492585:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4253 00002000:00100000:0.0:1746147182.492590:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edcb480 x1830967463579264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.492598:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830967463579264 ext(3145728->4194303) 00002000:00010000:0.0:1746147182.492602:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00000100:00100000:3.0:1746147182.499260:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463579136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20589us (21182us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.499272:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4254 00002000:00100000:3.0:1746147182.499283:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9500 x1830967463579136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.499293:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9500 with x1830967463579136 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.499298:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9500 00000100:00100000:2.0:1746147182.503342:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463580160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20110us (20284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.503353:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4255 00002000:00100000:2.0:1746147182.503364:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009edc9180 x1830967463580160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.503373:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967463580160 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.503378:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:3.0:1746147182.510601:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463578752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 32434us (32627us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.510612:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4251 00002000:00100000:3.0:1746147182.510624:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880099f6b480 x1830967463578752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.510643:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b480 with x1830967463578752 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.510647:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6b480 00000100:00100000:0.0:1746147182.515265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.515871:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463580416 00000100:00100000:3.0:1746147182.515882:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463580416 00002000:00100000:3.0:1746147182.515927:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009edc8a80 x1830967463580416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.515994:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830967463580416 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.516000:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:3.0:1746147182.516117:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4256 00000100:00100000:3.0:1746147182.516126:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463580416:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.516168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.516196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.516212:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463580672 00000100:00100000:3.0:1746147182.516215:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463580672 00000100:00100000:2.0:1746147182.516365:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463580928 00000100:00100000:2.0:1746147182.516369:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463580928 00002000:00100000:2.0:1746147182.516386:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9c00 x1830967463580928/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.516393:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967463580928 ext(2097152->3145727) 00002000:00010000:2.0:1746147182.516396:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:0.0:1746147182.516974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147182.517158:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009edcaa00 x1830967463580672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.517166:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcaa00 with x1830967463580672 ext(3145728->4194303) 00002000:00010000:3.0:1746147182.517169:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcaa00 00000100:00100000:2.0:1746147182.517620:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463581184 00000100:00100000:2.0:1746147182.517624:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463581184 00002000:00100000:2.0:1746147182.517651:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edca300 x1830967463581184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.517657:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967463581184 ext(3145728->4194303) 00002000:00010000:2.0:1746147182.517660:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:2.0:1746147182.517679:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4257 00000100:00100000:2.0:1746147182.517685:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463580928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.518020:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4258 00000100:00100000:3.0:1746147182.518025:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4259 00000100:00100000:1.0:1746147182.518027:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463580672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147182.518030:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463581184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.518315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.518338:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463581312 00000100:00100000:0.0:1746147182.518341:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463581312 00000100:00100000:0.0:1746147182.518362:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11339 00000100:00100000:0.0:1746147182.518367:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463581312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.518376:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.518390:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e602d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.518406:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.518408:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.518414:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 25 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.518425:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 25 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.518433:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14cc00, rc 0) 00000100:00100000:0.0:1746147182.518466:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463581312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 99us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.518471:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11339 00000100:00100000:0.0:1746147182.519762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.524269:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463581440 00000100:00100000:0.0:1746147182.524281:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463581440 00000100:00100000:0.0:1746147182.524347:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11340 00000100:00100000:0.0:1746147182.524357:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463581440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147182.524374:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.524390:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6034 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.524416:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.524418:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.524425:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.524440:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147182.524449:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e68400, rc 0) 00000100:00100000:1.0:1746147182.524517:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463581440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 160us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.524524:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11340 00000100:00100000:0.0:1746147182.526027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.526650:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463581696 00000100:00100000:2.0:1746147182.526658:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463581696 00000100:00100000:2.0:1746147182.526705:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10420 00000100:00100000:2.0:1746147182.526711:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28696:x1830967463581696:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.526728:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.526741:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9ea00/0xb4b2209fbdac5ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e603b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.526874:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.526885:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.526893:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.526903:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.526908:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.526912:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527156:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527163:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527169:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147182.527176:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.527347:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527353:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527358:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527362:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef9f800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.527365:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527371:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527380:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147182.527382:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.527385:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527389:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9f800/0xb4b2209fbdac5abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527412:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527417:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527421:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527429:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c95e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.527431:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527436:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527442:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48900) 00010000:00010000:2.0:1746147182.527443:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.527445:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527450:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95e00/0xb4b2209fbdac5ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.527482:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef9ea00/0xb4b2209fbdac5ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 322 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.527492:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 321 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.527497:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.527499:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147182.527501:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c95800, rc 0) 00000100:00100000:2.0:1746147182.527549:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+321:28696:x1830967463581696:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 838us (1527us total) trans 8589944156 rc 0/0 00000100:00100000:2.0:1746147182.527555:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10420 00000100:00100000:2.0:1746147182.530259:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463580928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12565us (14052us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.530272:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4257 00002000:00100000:2.0:1746147182.530283:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9c00 x1830967463580928/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.530293:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830967463580928 ext(2097152->3145727) 00002000:00010000:2.0:1746147182.530297:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:2.0:1746147182.535837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.536099:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463581952 00000100:00100000:3.0:1746147182.536109:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463581952 00002000:00100000:3.0:1746147182.536151:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009050bb80 x1830967463581952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.536160:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050bb80 with x1830967463581952 ext(4194304->4870143) 00002000:00010000:3.0:1746147182.536164:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050bb80 00000100:00100000:3.0:1746147182.536182:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4260 00000100:00100000:3.0:1746147182.536189:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463581952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.536411:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463580672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18383us (20241us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.536418:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4258 00002000:00100000:1.0:1746147182.536424:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009edcaa00 x1830967463580672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.536432:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcaa00 with x1830967463580672 ext(3145728->4194303) 00002000:00010000:1.0:1746147182.536435:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcaa00 00000100:00100000:3.0:1746147182.543615:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463581184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25576us (26633us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.543627:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4259 00002000:00100000:3.0:1746147182.543647:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edca300 x1830967463581184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.543655:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830967463581184 ext(3145728->4194303) 00002000:00010000:3.0:1746147182.543660:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:3.0:1746147182.544469:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463580416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28342us (29209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.544476:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4256 00002000:00100000:3.0:1746147182.544483:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009edc8a80 x1830967463580416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.544490:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830967463580416 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.544493:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:3.0:1746147182.545539:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463581952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9346us (9706us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147182.545546:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4260 00002000:00100000:3.0:1746147182.545554:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009050bb80 x1830967463581952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.545561:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050bb80 with x1830967463581952 ext(4194304->4870143) 00002000:00010000:3.0:1746147182.545565:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050bb80 00000100:00100000:0.0:1746147182.553912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.554151:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463582208 00000100:00100000:3.0:1746147182.554162:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463582208 00002000:00100000:3.0:1746147182.554205:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880099f69180 x1830967463582208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.554214:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69180 with x1830967463582208 ext(4194304->4870143) 00002000:00010000:3.0:1746147182.554219:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69180 00000100:00100000:3.0:1746147182.554270:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4261 00000100:00100000:3.0:1746147182.554280:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463582208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147182.562218:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463582208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7932us (8305us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147182.562229:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4261 00002000:00100000:3.0:1746147182.562240:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff880099f69180 x1830967463582208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.562248:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69180 with x1830967463582208 ext(4194304->4870143) 00002000:00010000:3.0:1746147182.562253:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69180 00000100:00100000:0.0:1746147182.567374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.567458:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463582464 00000100:00100000:3.0:1746147182.567468:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463582464 00000100:00100000:3.0:1746147182.567502:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4112 00000100:00100000:3.0:1746147182.567508:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28690:x1830967463582464:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147182.569269:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28690:x1830967463582464:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1754us (1894us total) trans 8589944157 rc 0/0 00000100:00100000:3.0:1746147182.569279:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4112 00000100:00100000:0.0:1746147182.631571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.631690:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463582592 00000100:00100000:1.0:1746147182.631706:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463582592 00000100:00100000:1.0:1746147182.631770:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11341 00000100:00100000:1.0:1746147182.631777:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28694:x1830967463582592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147182.631793:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.631807:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6042 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.631831:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.631839:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 25 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.631844:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.631845:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.631847:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2498560->3145727] (req 2498560->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.631874:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 25 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.631882:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 25 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.631897:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346496:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.632028:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.632035:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.632042:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346624:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.632061:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.635999:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346496:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.636666:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.636699:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2498560->3145727] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.636717:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b000, rc 0) 00000100:00100000:1.0:1746147182.636795:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28694:x1830967463582592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5017us (5233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.636804:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11341 00000100:00100000:0.0:1746147182.642010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.643739:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463582720 00000100:00100000:2.0:1746147182.643750:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463582720 00010000:00010000:2.0:1746147182.643791:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.644264:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5556 00000100:00100000:2.0:1746147182.644272:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463582720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.644285:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.644309:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.644320:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.644345:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86e600/0xb4b2209fbdac59db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fa8 expref: 12 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.644377:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.644443:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463582720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 170us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.644450:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5556 00000100:00100000:0.0:1746147182.645263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.645778:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463582848 00000100:00100000:1.0:1746147182.645784:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463582848 00010000:00010000:1.0:1746147182.645805:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 26 pid: 11147 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.646152:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5557 00000100:00100000:1.0:1746147182.646160:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463582848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.646171:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.646186:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 26 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:1.0:1746147182.646196:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 26 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:1.0:1746147182.646214:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86fa00/0xb4b2209fbdac5a3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fee expref: 26 pid: 11147 timeout: 669 lvb_type: 1 00010000:00010000:1.0:1746147182.646241:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.646244:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.646250:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.646258:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.646290:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.646302:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466346752:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147182.646375:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.648664:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466346752:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147182.648685:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147182.648732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.648846:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463582848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2685us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.648855:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5557 00000100:00100000:3.0:1746147182.649812:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583104 00000100:00100000:3.0:1746147182.649821:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583104 00002000:00100000:3.0:1746147182.649859:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2498560->2502655) req@ffff88008f819500 x1830967463583104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.649868:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819500 with x1830967463583104 ext(2498560->2502655) 00002000:00010000:3.0:1746147182.649873:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f819500 00000100:00100000:3.0:1746147182.649905:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4262 00000100:00100000:3.0:1746147182.649912:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463583104:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147182.650498:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463583104:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 585us (1772us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147182.650505:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4262 00002000:00100000:3.0:1746147182.650512:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2498560->2502655) req@ffff88008f819500 x1830967463583104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.650518:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819500 with x1830967463583104 ext(2498560->2502655) 00002000:00010000:3.0:1746147182.650521:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f819500 00000100:00100000:0.0:1746147182.658407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.658497:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583232 00000100:00100000:1.0:1746147182.658508:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583232 00000100:00100000:1.0:1746147182.658611:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11342 00000100:00100000:1.0:1746147182.658620:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28696:x1830967463583232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147182.658645:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.658659:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6049 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.658683:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.658690:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.658695:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.658697:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.658700:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1490944->2097151] (req 1490944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.658724:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.658734:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 669 lvb_type: 1 00000100:00100000:1.0:1746147182.658745:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346880:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.659274:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.659283:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 10 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.659291:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466347008:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.659315:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.659981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.660489:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583360 00000100:00100000:2.0:1746147182.660496:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583360 00000100:00100000:2.0:1746147182.660559:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11343 00000100:00100000:2.0:1746147182.660566:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28694:x1830967463583360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.660578:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.660589:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6050 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.660607:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.660615:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.660620:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.660621:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.660624:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.660653:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 16 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.660661:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 16 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.660668:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.661001:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.661008:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.661015:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.661536:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.661920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.662002:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466346880:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.662010:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466347008:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.662029:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1490944->2097151] (req 1490944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.662039:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a800, rc 0) 00000100:00100000:1.0:1746147182.662063:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28696:x1830967463583232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3444us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.662069:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11342 00000100:00100000:2.0:1746147182.662219:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583488 00000100:00100000:2.0:1746147182.662224:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583488 00010000:00010000:2.0:1746147182.662243:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.662271:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5558 00000100:00100000:2.0:1746147182.662276:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463583488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.662285:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.662304:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.662312:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.662328:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e68400/0xb4b2209fbdac5aad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6034 expref: 26 pid: 17530 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.662351:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.662369:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463583488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.662375:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5558 00000100:00100000:0.0:1746147182.664221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.664240:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583616 00000100:00100000:2.0:1746147182.664247:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583616 00010000:00010000:2.0:1746147182.664267:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.664285:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5559 00000100:00100000:2.0:1746147182.664290:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463583616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.664301:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.664315:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.664323:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.664338:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edade00/0xb4b2209fbdac5a83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6018 expref: 11 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.664349:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.664350:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.664356:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.664362:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.664389:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.664399:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466347392:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147182.664460:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.666445:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466347392:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147182.666461:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.666491:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463583616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2201us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.666499:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5559 00000100:00100000:2.0:1746147182.669326:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.669341:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347264:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.669366:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.669380:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c95200, rc 0) 00000100:00100000:2.0:1746147182.669420:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28694:x1830967463583360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8853us (9440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.669426:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11343 00000100:00100000:0.0:1746147182.669522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.669582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.669600:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584000 00000100:00100000:2.0:1746147182.669606:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584000 00010000:00010000:2.0:1746147182.669625:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:2.0:1746147182.669655:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5560 00000100:00100000:2.0:1746147182.669660:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967463584000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147182.669662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147182.669675:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147182.669676:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584128 00000100:00100000:0.0:1746147182.669678:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584128 00010000:00010000:0.0:1746147182.669690:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.669691:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:2.0:1746147182.669700:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00000100:00100000:0.0:1746147182.669709:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5561 00000100:00100000:0.0:1746147182.669714:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463584128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.669718:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edad800/0xb4b2209fbdac5a36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fe7 expref: 17 pid: 4444 timeout: 669 lvb_type: 1 00010000:00010000:0.0:1746147182.669722:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.669727:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147182.669728:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.669736:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.669746:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86f800/0xb4b2209fbdac59b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f85 expref: 11 pid: 6881 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.669749:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463584000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.669754:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5560 00010000:00010000:0.0:1746147182.669756:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.669758:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147182.669763:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.669770:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.669794:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.669804:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f81a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466347520:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147182.669847:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.670050:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463583872 00000100:00100000:3.0:1746147182.670054:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463583872 00002000:00100000:3.0:1746147182.670083:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1490944->1495039) req@ffff88008f819880 x1830967463583872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.670091:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819880 with x1830967463583872 ext(1490944->1495039) 00002000:00010000:3.0:1746147182.670094:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f819880 00000100:00100000:3.0:1746147182.670108:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4263 00000100:00100000:3.0:1746147182.670113:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463583872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147182.670239:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463583872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 125us (717us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147182.670244:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4263 00002000:00100000:3.0:1746147182.670249:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1490944->1495039) req@ffff88008f819880 x1830967463583872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.670255:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819880 with x1830967463583872 ext(1490944->1495039) 00002000:00010000:3.0:1746147182.670257:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f819880 00000100:00100000:2.0:1746147182.672562:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f81a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466347520:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147182.672578:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.672818:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463584128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3098us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.673121:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5561 00000100:00100000:2.0:1746147182.678007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.678310:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584384 00000100:00100000:1.0:1746147182.678319:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584384 00002000:00100000:1.0:1746147182.678356:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3432448->3436543) req@ffff880090509180 x1830967463584384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.678365:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967463584384 ext(3432448->3436543) 00002000:00010000:1.0:1746147182.678370:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00000100:00100000:1.0:1746147182.678402:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4264 00000100:00100000:1.0:1746147182.678410:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463584384:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147182.678479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.678498:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584512 00000100:00100000:2.0:1746147182.678501:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584512 00000100:00100000:2.0:1746147182.678522:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11344 00000100:00100000:2.0:1746147182.678527:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:28696:x1830967463584512:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.678535:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.678547:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6057 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.678556:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463584384:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (557us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147182.678561:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4264 00002000:00100000:1.0:1746147182.678567:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x419:0x0] (3432448->3436543) req@ffff880090509180 x1830967463584384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147182.678573:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147182.678573:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967463584384 ext(3432448->3436543) 00002000:00010000:1.0:1746147182.678575:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00010000:00010000:2.0:1746147182.678580:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.678585:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.678587:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.678590:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.678614:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 9 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.678624:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 9 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.678649:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347648:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.679333:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.679342:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.679349:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347776:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.679667:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.680672:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347648:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.681587:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466347776:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.681611:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.681625:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c95000, rc 0) 00000100:00100000:2.0:1746147182.681965:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28696:x1830967463584512:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3435us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.681973:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11344 00000100:00100000:0.0:1746147182.685229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.685272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.685425:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584640 00000100:00100000:2.0:1746147182.685433:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584640 00010000:00010000:2.0:1746147182.685465:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.685486:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463584768 00000100:00100000:2.0:1746147182.685488:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463584768 00010000:00010000:2.0:1746147182.685496:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.685514:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5562 00000100:00100000:2.0:1746147182.685520:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463584640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.685533:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.685550:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685564:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685581:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5a7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6011 expref: 17 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685596:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.685642:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463584640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.685648:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5562 00000100:00100000:2.0:1746147182.685698:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5563 00000100:00100000:2.0:1746147182.685704:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463584768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147182.685710:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147182.685717:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685725:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685736:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edada00/0xb4b2209fbdac5a8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e601f expref: 10 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.685743:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.685745:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.685751:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.685758:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.685785:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.685795:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466347904:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147182.685850:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.689531:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466347904:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147182.689551:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147182.689586:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463584768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3881us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.689596:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5563 00000100:00100000:0.0:1746147182.690187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.690524:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585024 00000100:00100000:2.0:1746147182.690530:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585024 00002000:00100000:2.0:1746147182.690563:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1314816->1318911) req@ffff88008f81b480 x1830967463585024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.690572:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81b480 with x1830967463585024 ext(1314816->1318911) 00002000:00010000:2.0:1746147182.690575:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81b480 00000100:00100000:2.0:1746147182.690602:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4265 00000100:00100000:2.0:1746147182.690609:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463585024:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147182.690752:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463585024:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (566us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147182.690760:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4265 00002000:00100000:2.0:1746147182.690765:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1314816->1318911) req@ffff88008f81b480 x1830967463585024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.690772:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81b480 with x1830967463585024 ext(1314816->1318911) 00002000:00010000:2.0:1746147182.690774:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81b480 00000100:00100000:0.0:1746147182.692762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.692842:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585280 00000100:00100000:3.0:1746147182.692848:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585280 00000100:00100000:3.0:1746147182.692879:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4113 00000100:00100000:3.0:1746147182.692886:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+321:28696:x1830967463585280:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147182.693071:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+322:28696:x1830967463585280:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 185us (313us total) trans 8589944158 rc 0/0 00000100:00100000:3.0:1746147182.693077:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4113 00000100:00100000:0.0:1746147182.694727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.694773:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585536 00000100:00100000:2.0:1746147182.694780:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585536 00000100:00100000:2.0:1746147182.694898:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10421 00000100:00100000:2.0:1746147182.694907:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28702:x1830967463585536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.694923:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.694996:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95400/0xb4b2209fbdac5af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e605e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.695071:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695080:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695088:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695096:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695101:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695105:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695178:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94800/0xb4b2209fbdac5b08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695184:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94800/0xb4b2209fbdac5b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695189:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94800/0xb4b2209fbdac5b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147182.695196:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.695253:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695258:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695262:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695266:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c94e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.695269:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695275:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695282:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147182.695284:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.695287:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695290:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94e00/0xb4b2209fbdac5afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695351:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695359:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695363:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695367:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c94200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.695369:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695373:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695379:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48500) 00010000:00010000:2.0:1746147182.695382:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.695384:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695388:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94200/0xb4b2209fbdac5b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.695417:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95400/0xb4b2209fbdac5af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e605e expref: 32 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.695426:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94800/0xb4b2209fbdac5b08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e605e expref: 31 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.695431:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.695433:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147182.695435:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c94800, rc 0) 00000100:00100000:2.0:1746147182.695707:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28702:x1830967463585536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 801us (984us total) trans 8589944159 rc 0/0 00000100:00100000:2.0:1746147182.695712:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10421 00000100:00100000:1.0:1746147182.698282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.698321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.698418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.698490:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585920 00000100:00100000:3.0:1746147182.698499:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585920 00000100:00100000:3.0:1746147182.698551:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 580 00000100:00100000:3.0:1746147182.698558:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463585920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.698569:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.698586:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c94800/0xb4b2209fbdac5b08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e605e expref: 31 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.698600:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147182.698604:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.698648:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463585920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.698655:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 580 00000100:00100000:2.0:1746147182.698714:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585664 00000100:00100000:2.0:1746147182.698718:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585664 00000100:00100000:2.0:1746147182.698738:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463585792 00000100:00100000:2.0:1746147182.698740:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463585792 00000100:00100000:2.0:1746147182.698759:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11345 00000100:00100000:2.0:1746147182.698765:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463585664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.698776:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147182.698780:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11346 00000100:00100000:0.0:1746147182.698787:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463585792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.698788:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c94400/0xb4b2209fbdac5b16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6065 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147182.698794:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147182.698802:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdac5b1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e606c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.698825:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466348032:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147182.698825:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f819180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466348160:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.699085:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.699406:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab300 going to sleep for 11 seconds 00002000:00010000:1.0:1746147182.701164:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147181 -> 1746147182 00000100:00100000:1.0:1746147182.701178:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f819180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466348160:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.701179:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466348032:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147182.701197:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c94400/0xb4b2209fbdac5b16 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6065 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.701197:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdac5b1d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e606c expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.701208:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c94400/0xb4b2209fbdac5b16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6065 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.701208:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86e600/0xb4b2209fbdac5b1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e606c expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.701219:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c94400, rc 0) 00010000:00010000:1.0:1746147182.701219:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b86e600, rc 0) 00000100:00100000:2.0:1746147182.701248:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463585664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2482us (2971us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.701257:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11345 00000100:00100000:1.0:1746147182.701560:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463585792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2773us (3140us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147182.701566:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11346 00000100:00100000:0.0:1746147182.708899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.708976:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586048 00000100:00100000:1.0:1746147182.708985:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586048 00000100:00100000:1.0:1746147182.709028:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11347 00000100:00100000:1.0:1746147182.709035:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28702:x1830967463586048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.709050:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.709063:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6073 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.709087:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.709093:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.709095:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.709098:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.709124:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.709134:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 24 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.709144:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466348288:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.709212:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.711112:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466348288:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.711134:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.711152:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4ba00, rc 0) 00000100:00100000:1.0:1746147182.711185:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28702:x1830967463586048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2151us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.711192:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11347 00000100:00100000:0.0:1746147182.711799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.711967:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586176 00000100:00100000:1.0:1746147182.711973:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586176 00002000:00100000:1.0:1746147182.712002:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1490944->2097151) req@ffff88008f819180 x1830967463586176/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.712009:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819180 with x1830967463586176 ext(1490944->2097151) 00010000:00010000:1.0:1746147182.712015:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.712024:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 25 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:1.0:1746147182.712029:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f819180 00000100:00100000:1.0:1746147182.712058:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1467 00000100:00100000:1.0:1746147182.712065:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463586176:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147182.722547:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463586176:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 10473us (10740us total) trans 17179873170 rc 0/0 00000100:00100000:2.0:1746147182.722557:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1467 00002000:00100000:2.0:1746147182.722568:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1490944->2097151) req@ffff88008f819180 x1830967463586176/t17179873170(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.722576:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f819180 with x1830967463586176 ext(1490944->2097151) 00010000:00010000:2.0:1746147182.722585:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.722602:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.722608:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f819180 00000100:00100000:0.0:1746147182.728099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.728161:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586304 00000100:00100000:1.0:1746147182.728173:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586304 00010000:00010000:1.0:1746147182.728205:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.728239:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5564 00000100:00100000:1.0:1746147182.728247:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463586304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.728261:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.728284:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.728296:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.728314:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a800/0xb4b2209fbdac5ade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6049 expref: 27 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.728336:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.728338:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.728344:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.728351:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.728381:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.728396:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466348416:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147182.728463:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.731978:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466348416:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147182.731996:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.732029:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463586304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3783us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.732037:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5564 00000100:00100000:0.0:1746147182.735151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.736698:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586560 00000100:00100000:2.0:1746147182.736710:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586560 00002000:00100000:2.0:1746147182.736752:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008f818380 x1830967463586560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.736761:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818380 with x1830967463586560 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.736766:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f818380 00000100:00100000:2.0:1746147182.736792:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4266 00000100:00100000:2.0:1746147182.736800:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463586560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.748116:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463586560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11307us (12961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.748130:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4266 00002000:00100000:2.0:1746147182.748142:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008f818380 x1830967463586560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.748150:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818380 with x1830967463586560 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.748155:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f818380 00000100:00100000:0.0:1746147182.753311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.754209:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586688 00000100:00100000:1.0:1746147182.754221:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586688 00000100:00100000:1.0:1746147182.754276:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11348 00000100:00100000:1.0:1746147182.754284:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28702:x1830967463586688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.754302:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.754316:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e607a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.754343:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.754349:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.754350:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.754354:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.754381:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.754392:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 15 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.754403:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466348544:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.754492:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.759285:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466348544:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.759312:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.759327:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a600, rc 0) 00000100:00100000:1.0:1746147182.759377:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28702:x1830967463586688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5092us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.759386:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11348 00000100:00100000:0.0:1746147182.760124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.760176:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586816 00000100:00100000:3.0:1746147182.760184:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586816 00002000:00100000:3.0:1746147182.760219:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1318911) req@ffff88008f81b800 x1830967463586816/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.760227:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81b800 with x1830967463586816 ext(1048576->1318911) 00010000:00010000:3.0:1746147182.760234:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 16 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.760245:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 16 pid: 8480 timeout: 669 lvb_type: 0 00002000:00010000:3.0:1746147182.760251:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f81b800 00000100:00100000:3.0:1746147182.760275:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1468 00000100:00100000:3.0:1746147182.760282:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967463586816:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147182.775171:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463586816:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14876us (15034us total) trans 21474840572 rc 0/0 00000100:00100000:0.0:1746147182.775188:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1468 00002000:00100000:0.0:1746147182.775200:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1318911) req@ffff88008f81b800 x1830967463586816/t21474840572(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.775211:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81b800 with x1830967463586816 ext(1048576->1318911) 00010000:00010000:0.0:1746147182.775221:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147182.775235:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00002000:00010000:0.0:1746147182.775246:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f81b800 00000100:00100000:0.0:1746147182.778392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.778501:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463586944 00000100:00100000:1.0:1746147182.778510:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463586944 00010000:00010000:1.0:1746147182.778539:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.778687:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5565 00000100:00100000:1.0:1746147182.778695:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463586944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.778708:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.778724:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.778734:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.778750:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95000/0xb4b2209fbdac5aec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6057 expref: 18 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.778922:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.778925:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.778931:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.778959:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.778987:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.778999:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466348672:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147182.779677:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.782176:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466348672:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147182.782188:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.782227:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463586944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3532us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.782234:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5565 00000100:00100000:0.0:1746147182.784485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.784562:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463587200 00000100:00100000:2.0:1746147182.784570:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463587200 00000100:00100000:2.0:1746147182.784661:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10422 00000100:00100000:2.0:1746147182.784668:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+322:28706:x1830967463587200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.784685:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.784698:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09800/0xb4b2209fbdac5b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6081 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.784776:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784786:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784794:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784802:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784808:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784812:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784887:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdac5b47 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784894:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdac5b47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.784899:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdac5b47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147182.784907:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.785074:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785081:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785086:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785090:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.785093:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785099:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785107:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147182.785110:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.785113:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785118:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785395:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785401:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785405:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785409:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.785411:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785415:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785420:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48d00) 00010000:00010000:2.0:1746147182.785422:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.785424:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785428:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.785459:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09800/0xb4b2209fbdac5b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6081 expref: 325 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.785468:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdac5b47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6081 expref: 324 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.785475:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.785477:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147182.785479:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f09200, rc 0) 00000100:00100000:2.0:1746147182.785518:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28706:x1830967463587200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 851us (1038us total) trans 8589944160 rc 0/0 00000100:00100000:2.0:1746147182.785524:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10422 00000100:00100000:0.0:1746147182.786029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.786430:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463587456 00000100:00100000:2.0:1746147182.786438:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463587456 00002000:00100000:2.0:1746147182.786478:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880090741180 x1830967463587456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.786488:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741180 with x1830967463587456 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.786493:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741180 00000100:00100000:2.0:1746147182.786511:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4267 00000100:00100000:2.0:1746147182.786517:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463587456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.790783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.790846:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463587712 00000100:00100000:0.0:1746147182.790849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.790856:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463587712 00000100:00100000:2.0:1746147182.790907:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4114 00000100:00100000:2.0:1746147182.790915:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28706:x1830967463587712:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147182.791008:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463587840 00000100:00100000:1.0:1746147182.791013:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463587840 00000100:00100000:1.0:1746147182.791040:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 581 00000100:00100000:1.0:1746147182.791044:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1957:x1830967463587840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.791056:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.791083:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09200/0xb4b2209fbdac5b47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6081 expref: 325 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.791112:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.791116:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.791154:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1957:x1830967463587840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.791160:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 581 00000100:00100000:2.0:1746147182.791753:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28706:x1830967463587712:12345-192.168.203.36@tcp:35:cat.0 Request processed in 837us (979us total) trans 8589944161 rc 0/0 00000100:00100000:2.0:1746147182.791761:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4114 00000100:00100000:2.0:1746147182.793498:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463587456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6971us (7466us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.793510:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4267 00002000:00100000:2.0:1746147182.793522:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880090741180 x1830967463587456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.793538:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741180 with x1830967463587456 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.793543:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741180 00000100:00100000:0.0:1746147182.794921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.794988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.795013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.795120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.795195:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463587968 00000100:00100000:1.0:1746147182.795203:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463587968 00000100:00100000:1.0:1746147182.795237:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588096 00000100:00100000:1.0:1746147182.795238:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588096 00000100:00100000:1.0:1746147182.795249:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588224 00000100:00100000:1.0:1746147182.795250:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588224 00000100:00100000:1.0:1746147182.795265:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588352 00000100:00100000:1.0:1746147182.795266:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588352 00000100:00100000:1.0:1746147182.795280:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11349 00000100:00100000:1.0:1746147182.795286:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463587968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.795303:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.795322:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6088 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.795344:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.795346:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.795354:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.795370:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.795379:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4a400, rc 0) 00000100:00100000:1.0:1746147182.795415:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463587968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 129us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.795571:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11350 00000100:00100000:2.0:1746147182.795580:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463588096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.795588:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.795598:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e608f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.795610:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.795611:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147182.795616:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.795625:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.795641:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08800, rc 0) 00000100:00100000:2.0:1746147182.795660:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463588096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 82us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.795665:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11350 00000100:00100000:2.0:1746147182.795686:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11351 00000100:00100000:2.0:1746147182.795691:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463588224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.795696:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.795703:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f08600/0xb4b2209fbdac5b63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6096 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.795743:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466348800:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.795793:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.795815:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11352 00000100:00100000:2.0:1746147182.795820:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463588352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.795826:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.795832:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdac5b6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e609d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.795854:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466348928:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.795875:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.796594:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11349 00002000:00010000:2.0:1746147182.798699:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147181 -> 1746147182 00002000:00010000:2.0:1746147182.798707:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147181 -> 1746147182 00002000:00010000:2.0:1746147182.798709:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147181 -> 1746147182 00002000:00010000:3.0:1746147182.798726:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147181 -> 1746147182 00002000:00010000:3.0:1746147182.798730:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147181 -> 1746147182 00002000:00010000:3.0:1746147182.798732:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147181 -> 1746147182 00000100:00100000:2.0:1746147182.798735:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466348800:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147182.798746:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466348928:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147182.798770:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdac5b6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e609d expref: 28 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.798784:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f08200/0xb4b2209fbdac5b6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e609d expref: 28 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147182.798798:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08200, rc 0) 00010000:00010000:2.0:1746147182.798815:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f08600/0xb4b2209fbdac5b63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6096 expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147182.798853:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463588352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3031us (3732us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147182.798861:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11352 00010000:00010000:2.0:1746147182.798864:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f08600/0xb4b2209fbdac5b63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6096 expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.798878:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08600, rc 0) 00000100:00100000:2.0:1746147182.798900:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463588224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3209us (3886us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.798907:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11351 00000100:00100000:0.0:1746147182.810695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.810739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.810773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.810796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.810821:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588608 00000100:00100000:0.0:1746147182.810828:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588608 00002000:00100000:0.0:1746147182.810868:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090741c00 x1830967463588608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.810878:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741c00 with x1830967463588608 ext(2097152->3145727) 00002000:00010000:0.0:1746147182.810884:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741c00 00000100:00100000:0.0:1746147182.810899:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588864 00000100:00100000:0.0:1746147182.810900:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588864 00002000:00100000:0.0:1746147182.810912:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3792895) req@ffff880090742a00 x1830967463588864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 504/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.810919:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742a00 with x1830967463588864 ext(2097152->3792895) 00002000:00010000:0.0:1746147182.810922:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742a00 00000100:00100000:0.0:1746147182.810930:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463588992 00000100:00100000:0.0:1746147182.810931:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463588992 00002000:00100000:0.0:1746147182.810968:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3792896->4194303) req@ffff880090740e00 x1830967463588992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.810974:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463588992 ext(3792896->4194303) 00002000:00010000:0.0:1746147182.810976:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740e00 00000100:00100000:0.0:1746147182.810984:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463589248 00000100:00100000:0.0:1746147182.810986:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463589248 00002000:00100000:0.0:1746147182.810995:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3436544->4194303) req@ffff880090740000 x1830967463589248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.811000:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740000 with x1830967463589248 ext(3436544->4194303) 00002000:00010000:0.0:1746147182.811002:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090740000 00000100:00100000:0.0:1746147182.811012:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4268 00000100:00100000:0.0:1746147182.811019:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463588608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147182.811178:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4269 00000100:00100000:3.0:1746147182.811194:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463588864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.812138:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4270 00000100:00100000:0.0:1746147182.812146:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463588992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.812991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.813954:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4271 00000100:00100000:2.0:1746147182.813972:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463589248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147182.814896:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463589632 00000100:00100000:2.0:1746147182.814903:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463589632 00002000:00100000:2.0:1746147182.814931:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880090743800 x1830967463589632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.814954:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743800 with x1830967463589632 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.814959:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743800 00000100:00100000:2.0:1746147182.814980:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4272 00000100:00100000:2.0:1746147182.814985:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463589632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147182.815200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.815221:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463589888 00000100:00100000:3.0:1746147182.815230:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463589888 00000100:00100000:1.0:1746147182.815236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147182.815262:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800929f5c00 x1830967463589888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.815272:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5c00 with x1830967463589888 ext(1048576->2097151) 00002000:00010000:3.0:1746147182.815276:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5c00 00000100:00100000:3.0:1746147182.815294:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463590144 00000100:00100000:3.0:1746147182.815297:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463590144 00002000:00100000:3.0:1746147182.815309:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800929f6d80 x1830967463590144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.815315:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6d80 with x1830967463590144 ext(1048576->2097151) 00002000:00010000:3.0:1746147182.815488:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f6d80 00000100:00100000:3.0:1746147182.815502:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4273 00000100:00100000:3.0:1746147182.815508:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463589888:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:0.0:1746147182.816415:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147182.816443:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4274 00000100:00100000:0.0:1746147182.816452:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463590144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.829167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.829274:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463590400 00000100:00100000:2.0:1746147182.829283:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463590400 00000100:00100000:2.0:1746147182.829325:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10423 00000100:00100000:2.0:1746147182.829332:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28709:x1830967463590400:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.829355:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.829370:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09800/0xb4b2209fbdac5b71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60a4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.829470:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829482:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829491:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829503:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829508:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829513:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829603:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09000/0xb4b2209fbdac5b86 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829610:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09000/0xb4b2209fbdac5b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829614:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09000/0xb4b2209fbdac5b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147182.829622:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.829706:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829712:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829718:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829723:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f08e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.829726:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829731:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829740:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147182.829744:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.829747:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829752:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f08e00/0xb4b2209fbdac5b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829775:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829779:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829783:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829788:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.829790:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829795:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829801:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48e00) 00010000:00010000:2.0:1746147182.829803:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.829805:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829809:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5b7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147182.829841:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09800/0xb4b2209fbdac5b71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60a4 expref: 327 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.829855:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09000/0xb4b2209fbdac5b86 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60a4 expref: 326 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.829860:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.829862:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147182.829864:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f09000, rc 0) 00000100:00100000:2.0:1746147182.829897:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28709:x1830967463590400:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 566us (742us total) trans 8589944162 rc 0/0 00000100:00100000:2.0:1746147182.829903:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10423 00000100:00100000:0.0:1746147182.831479:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463588992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19325us (20696us total) trans 0 rc 401408/401408 00000100:00100000:0.0:1746147182.831493:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4270 00002000:00100000:0.0:1746147182.831504:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3792896->4194303) req@ffff880090740e00 x1830967463588992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.831513:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463588992 ext(3792896->4194303) 00002000:00010000:0.0:1746147182.831518:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740e00 00000100:00100000:3.0:1746147182.836042:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463588864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24847us (25294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.836052:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4269 00002000:00100000:3.0:1746147182.836063:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3792895) req@ffff880090742a00 x1830967463588864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 504/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.836071:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742a00 with x1830967463588864 ext(2097152->3792895) 00002000:00010000:3.0:1746147182.836076:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742a00 00000100:00100000:3.0:1746147182.837255:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463589248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23284us (26454us total) trans 0 rc 757760/757760 00000100:00100000:3.0:1746147182.837262:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4271 00002000:00100000:3.0:1746147182.837268:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3436544->4194303) req@ffff880090740000 x1830967463589248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.837278:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740000 with x1830967463589248 ext(3436544->4194303) 00002000:00010000:3.0:1746147182.837282:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090740000 00000100:00100000:3.0:1746147182.843474:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463589888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27956us (28265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.843486:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4273 00002000:00100000:3.0:1746147182.843497:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800929f5c00 x1830967463589888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.843505:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5c00 with x1830967463589888 ext(1048576->2097151) 00002000:00010000:3.0:1746147182.843510:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5c00 00000100:00100000:3.0:1746147182.849922:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463588608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 38893us (39228us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.849932:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4268 00002000:00100000:3.0:1746147182.849957:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090741c00 x1830967463588608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.849964:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741c00 with x1830967463588608 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.849969:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741c00 00000100:00100000:2.0:1746147182.854315:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463589632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 39322us (41316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147182.854325:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4272 00002000:00100000:2.0:1746147182.854337:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880090743800 x1830967463589632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.854345:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743800 with x1830967463589632 ext(1048576->2097151) 00002000:00010000:2.0:1746147182.854350:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743800 00000100:00100000:0.0:1746147182.854573:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463590144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 38122us (39335us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147182.854579:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4274 00002000:00100000:0.0:1746147182.854584:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800929f6d80 x1830967463590144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.854591:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6d80 with x1830967463590144 ext(1048576->2097151) 00002000:00010000:0.0:1746147182.854594:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f6d80 00000100:00100000:0.0:1746147182.858855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.858970:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463590528 00000100:00100000:3.0:1746147182.858980:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463590528 00000100:00100000:3.0:1746147182.859120:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 582 00000100:00100000:3.0:1746147182.859127:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1958:x1830967463590528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.859141:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.859161:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09000/0xb4b2209fbdac5b86 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60a4 expref: 326 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.859191:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147182.859195:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147182.859247:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1958:x1830967463590528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147182.859254:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 582 00000100:00100000:0.0:1746147182.868778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.868961:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463590656 00000100:00100000:2.0:1746147182.868970:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463590656 00000100:00100000:2.0:1746147182.869020:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11353 00000100:00100000:2.0:1746147182.869029:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463590656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.869044:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.869057:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f08c00/0xb4b2209fbdac5b94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60ab expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147182.869099:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466349056:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147182.869175:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147182.869494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.869584:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463590784 00000100:00100000:1.0:1746147182.869588:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463590784 00000100:00100000:1.0:1746147182.869608:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11354 00000100:00100000:1.0:1746147182.869613:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463590784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.869620:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.869636:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac5b9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60b2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.869660:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466349184:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147182.869685:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.870500:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466349056:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147182.870518:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f08c00/0xb4b2209fbdac5b94 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ab expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.870529:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f08c00/0xb4b2209fbdac5b94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ab expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147182.871110:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f08c00, rc 0) 00000100:00100000:2.0:1746147182.871143:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463590656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2114us (2370us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147182.871149:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11353 00000100:00100000:1.0:1746147182.871457:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466349184:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147182.871473:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac5b9b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b2 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.871481:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac5b9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b2 expref: 28 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.871490:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9600, rc 0) 00000100:00100000:1.0:1746147182.871504:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463590784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1891us (2011us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147182.871508:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11354 00000100:00100000:0.0:1746147182.876094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.876376:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591040 00000100:00100000:2.0:1746147182.876385:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591040 00002000:00100000:2.0:1746147182.876424:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008d5de300 x1830967463591040/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.876433:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967463591040 ext(4194304->4870143) 00002000:00010000:2.0:1746147182.876438:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5de300 00000100:00100000:2.0:1746147182.876465:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4275 00000100:00100000:2.0:1746147182.876472:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463591040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.877478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.877625:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591168 00000100:00100000:1.0:1746147182.877637:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591168 00000100:00100000:1.0:1746147182.878584:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11355 00000100:00100000:1.0:1746147182.878593:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28706:x1830967463591168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.878607:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.878620:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60b9 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.878652:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.878659:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.878661:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147182.878663:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.878689:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 11 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.878700:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 11 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.878710:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466349312:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147182.878759:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.887236:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466349312:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147182.887264:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.887280:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8400, rc 0) 00000100:00100000:1.0:1746147182.887398:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28706:x1830967463591168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8806us (9922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.887407:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11355 00000100:00100000:0.0:1746147182.888716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.888792:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591296 00000100:00100000:2.0:1746147182.888799:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591296 00002000:00100000:2.0:1746147182.888827:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3436543) req@ffff88008d5dfb80 x1830967463591296/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.888836:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967463591296 ext(3145728->3436543) 00010000:00010000:2.0:1746147182.888844:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.888854:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.888860:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dfb80 00000100:00100000:2.0:1746147182.888888:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1469 00000100:00100000:2.0:1746147182.888895:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463591296:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147182.890077:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463591040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13601us (13987us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147182.890086:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4275 00002000:00100000:3.0:1746147182.890093:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008d5de300 x1830967463591040/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.890100:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967463591040 ext(4194304->4870143) 00010000:00010000:3.0:1746147182.890107:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.890119:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00002000:00010000:3.0:1746147182.890124:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:2.0:1746147182.893580:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463591296:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4678us (4859us total) trans 21474840573 rc 0/0 00000100:00100000:2.0:1746147182.893589:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1469 00002000:00100000:2.0:1746147182.893600:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3436543) req@ffff88008d5dfb80 x1830967463591296/t21474840573(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.893608:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967463591296 ext(3145728->3436543) 00010000:00010000:2.0:1746147182.893616:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.893642:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 12 pid: 8480 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.893648:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5dfb80 00000100:00100000:0.0:1746147182.896808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.897226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.898316:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591424 00000100:00100000:1.0:1746147182.898326:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591424 00000100:00100000:1.0:1746147182.898382:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11356 00000100:00100000:1.0:1746147182.898390:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463591424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.898408:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.898424:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9200/0xb4b2209fbdac5ba9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60c0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.898475:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466349440:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147182.898559:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147182.899104:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591552 00000100:00100000:3.0:1746147182.899109:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591552 00010000:00010000:3.0:1746147182.899130:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 14 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:3.0:1746147182.899150:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5566 00000100:00100000:3.0:1746147182.899155:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463591552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147182.899166:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147182.899187:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 14 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.899199:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 14 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.899226:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.899228:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147182.899239:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.899247:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147182.899269:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147182.899277:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466349568:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147182.899326:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147182.901343:0:6881:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800929f7b80 x1830967466349440) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 14 pid: 8480 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.901375:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c95200/0xb4b2209fbdac5ae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6050 expref: 14 pid: 8480 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.901400:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466349440:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147182.901430:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9200/0xb4b2209fbdac5ba9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c0 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.901441:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9200/0xb4b2209fbdac5ba9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c0 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147182.901447:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9200, rc 0) 00000100:00100000:1.0:1746147182.901490:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463591424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3101us (4691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147182.901497:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11356 00000100:00100000:2.0:1746147182.904483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.904589:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591680 00000100:00100000:0.0:1746147182.904592:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466349568:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147182.904596:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591680 00010000:00010000:0.0:1746147182.904613:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.904645:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11357 00000100:00100000:1.0:1746147182.904651:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28702:x1830967463591680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147182.904667:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147182.904682:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60c7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147182.904691:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463591552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5535us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147182.904704:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5566 00010000:00010000:1.0:1746147182.904705:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.904707:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.904715:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.904728:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.904737:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9a00, rc 0) 00000100:00100000:1.0:1746147182.904757:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28702:x1830967463591680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.904761:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11357 00000100:00100000:1.0:1746147182.905744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.905779:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463591936 00000100:00100000:2.0:1746147182.905784:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463591936 00002000:00100000:2.0:1746147182.905813:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f7b80 x1830967463591936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.905823:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7b80 with x1830967463591936 ext(2097152->3145727) 00002000:00010000:2.0:1746147182.905827:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7b80 00000100:00100000:2.0:1746147182.905850:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4276 00000100:00100000:2.0:1746147182.905856:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463591936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.907998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.909180:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463592192 00000100:00100000:2.0:1746147182.909191:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463592192 00000100:00100000:2.0:1746147182.909241:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10424 00000100:00100000:2.0:1746147182.909250:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28711:x1830967463592192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147182.909275:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.909294:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbce000/0xb4b2209fbdac5bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60ce expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.909400:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909413:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909424:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909437:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909442:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909447:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909562:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136966000/0xb4b2209fbdac5bcc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909570:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136966000/0xb4b2209fbdac5bcc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909575:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136966000/0xb4b2209fbdac5bcc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147182.909583:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147182.909675:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909681:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909686:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909691:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bbcea00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.909695:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909701:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909711:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147182.909713:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.909717:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909722:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcea00/0xb4b2209fbdac5bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909745:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909750:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909754:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909757:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f09400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147182.909759:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909763:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909833:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48000) 00010000:00010000:2.0:1746147182.909835:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147182.909838:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909842:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f09400/0xb4b2209fbdac5bc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147182.909881:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbce000/0xb4b2209fbdac5bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ce expref: 33 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.909892:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136966000/0xb4b2209fbdac5bcc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ce expref: 32 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.909898:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147182.909901:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147182.909903:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966000, rc 0) 00000100:00100000:2.0:1746147182.909976:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:28711:x1830967463592192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 726us (1985us total) trans 8589944163 rc 0/0 00000100:00100000:2.0:1746147182.909982:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10424 00000100:00100000:0.0:1746147182.913818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.914148:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463592448 00000100:00100000:2.0:1746147182.914158:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463592448 00000100:00100000:2.0:1746147182.914541:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4115 00000100:00100000:2.0:1746147182.914549:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+32:28702:x1830967463592448:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147182.914761:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28702:x1830967463592448:12345-192.168.203.36@tcp:35:cat.0 Request processed in 213us (951us total) trans 8589944164 rc 0/0 00000100:00100000:2.0:1746147182.914767:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4115 00000100:00100000:3.0:1746147182.915086:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463591936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9228us (9343us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.915095:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4276 00002000:00100000:3.0:1746147182.915104:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f7b80 x1830967463591936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.915114:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7b80 with x1830967463591936 ext(2097152->3145727) 00002000:00010000:3.0:1746147182.915120:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7b80 00000100:00100000:0.0:1746147182.915248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.915297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.915364:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463592704 00000100:00100000:2.0:1746147182.915368:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463592704 00000100:00100000:2.0:1746147182.915395:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4116 00000100:00100000:2.0:1746147182.915400:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28711:x1830967463592704:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147182.915491:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+34:28711:x1830967463592704:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 90us (242us total) trans 8589944165 rc 0/0 00000100:00100000:2.0:1746147182.915497:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4116 00000100:00100000:1.0:1746147182.915545:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463592832 00000100:00100000:1.0:1746147182.915550:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463592832 00000100:00100000:1.0:1746147182.915574:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 583 00000100:00100000:1.0:1746147182.915579:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463592832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.915596:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.915621:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136966000/0xb4b2209fbdac5bcc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ce expref: 34 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.915655:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147182.915662:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.915678:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463592832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.915683:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 583 00000100:00100000:0.0:1746147182.923172:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.923262:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463592960 00000100:00100000:2.0:1746147182.923271:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463592960 00000100:00100000:2.0:1746147182.923380:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11358 00000100:00100000:2.0:1746147182.923389:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28706:x1830967463592960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147182.923408:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147182.923429:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60d5 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.923463:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.923470:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147182.923472:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147182.923475:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.923505:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.923517:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 10 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147182.923529:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466349696:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147182.924195:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147182.925513:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466349696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147182.925537:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147182.925552:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966a00, rc 0) 00000100:00100000:2.0:1746147182.925591:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28706:x1830967463592960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2203us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147182.925598:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11358 00000100:00100000:0.0:1746147182.929097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147182.929478:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463593088 00000100:00100000:3.0:1746147182.929487:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463593088 00002000:00100000:3.0:1746147182.929531:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2498560->3145727) req@ffff88008d5dc380 x1830967463593088/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.929540:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc380 with x1830967463593088 ext(2498560->3145727) 00010000:00010000:3.0:1746147182.929550:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 11 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:3.0:1746147182.929564:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 11 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:3.0:1746147182.929571:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5dc380 00000100:00100000:3.0:1746147182.929590:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1470 00000100:00100000:3.0:1746147182.929596:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463593088:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147182.950357:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463593088:12345-192.168.203.36@tcp:4:cat.0 Request processed in 20748us (21255us total) trans 17179873171 rc 0/0 00000100:00100000:2.0:1746147182.950371:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1470 00002000:00100000:2.0:1746147182.950381:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2498560->3145727) req@ffff88008d5dc380 x1830967463593088/t17179873171(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:558/0 lens 488/448 e 0 to 0 dl 1746147193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.950391:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dc380 with x1830967463593088 ext(2498560->3145727) 00010000:00010000:2.0:1746147182.950401:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:2.0:1746147182.950417:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00002000:00010000:2.0:1746147182.950424:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5dc380 00000100:00100000:0.0:1746147182.964524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.965051:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463593216 00000100:00100000:1.0:1746147182.965059:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463593216 00010000:00010000:1.0:1746147182.965095:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00000100:00100000:1.0:1746147182.965215:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5567 00000100:00100000:1.0:1746147182.965223:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463593216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147182.965237:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147182.965261:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.965272:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.965295:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b000/0xb4b2209fbdac5ad7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6042 expref: 13 pid: 17530 timeout: 669 lvb_type: 0 00010000:00010000:1.0:1746147182.966659:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.966663:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147182.966674:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.966685:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147182.966721:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147182.966734:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466349824:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147182.967517:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147182.970529:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466349824:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147182.970550:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147182.970590:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463593216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5367us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147182.970600:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5567 00000100:00100000:0.0:1746147182.976454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147182.976587:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463593472 00000100:00100000:2.0:1746147182.976596:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463593472 00002000:00100000:2.0:1746147182.976681:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008d5df100 x1830967463593472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147182.976692:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df100 with x1830967463593472 ext(2097152->3145727) 00002000:00010000:2.0:1746147182.976697:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df100 00000100:00100000:2.0:1746147182.976728:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4277 00000100:00100000:2.0:1746147182.976735:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463593472:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.978034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147182.978651:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463593728 00000100:00100000:1.0:1746147182.978658:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463593728 00002000:00100000:1.0:1746147182.978688:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008d5dea00 x1830967463593728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.978697:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463593728 ext(3145728->4194303) 00002000:00010000:1.0:1746147182.978701:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:1.0:1746147182.978732:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4278 00000100:00100000:1.0:1746147182.978740:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463593728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.978779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147182.978805:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463593984 00000100:00100000:0.0:1746147182.978808:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463593984 00002000:00100000:0.0:1746147182.978825:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008d5dce00 x1830967463593984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/0 e 0 to 0 dl 1746147193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.978831:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967463593984 ext(3145728->4194303) 00002000:00010000:0.0:1746147182.978834:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dce00 00000100:00100000:0.0:1746147182.978844:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4279 00000100:00100000:0.0:1746147182.978848:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463593984:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147182.986192:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463593472:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9446us (9734us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147182.986204:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4277 00002000:00100000:0.0:1746147182.986214:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008d5df100 x1830967463593472/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147182.986229:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df100 with x1830967463593472 ext(2097152->3145727) 00002000:00010000:0.0:1746147182.986235:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df100 00000100:00100000:1.0:1746147182.987687:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463593728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8940us (9649us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147182.987698:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4278 00002000:00100000:1.0:1746147182.987706:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008d5dea00 x1830967463593728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147182.987714:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463593728 ext(3145728->4194303) 00002000:00010000:1.0:1746147182.987719:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:3.0:1746147182.994043:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463593984:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15182us (15252us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147182.994056:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4279 00002000:00100000:3.0:1746147182.994067:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008d5dce00 x1830967463593984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:558/0 lens 488/440 e 0 to 0 dl 1746147193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147182.994077:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967463593984 ext(3145728->4194303) 00002000:00010000:3.0:1746147182.994083:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dce00 00000100:00100000:0.0:1746147183.001071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.001565:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463594240 00000100:00100000:3.0:1746147183.001574:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463594240 00002000:00100000:3.0:1746147183.001618:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008d5dd180 x1830967463594240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.001645:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967463594240 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.001651:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:3.0:1746147183.001682:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4280 00000100:00100000:3.0:1746147183.001689:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463594240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.001912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.002080:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463594368 00000100:00100000:2.0:1746147183.002084:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463594368 00000100:00100000:2.0:1746147183.002110:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11359 00000100:00100000:2.0:1746147183.002116:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28709:x1830967463594368:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.002126:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.002145:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60dc expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.002171:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.002179:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.002180:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.002184:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.002210:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.002221:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 669 lvb_type: 0 00000100:00100000:2.0:1746147183.002232:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466349952:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.002358:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.006031:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466349952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.006063:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.006081:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946e3a00, rc 0) 00000100:00100000:2.0:1746147183.006138:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28709:x1830967463594368:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4020us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.006146:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11359 00000100:00100000:0.0:1746147183.006546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.006574:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463594496 00000100:00100000:0.0:1746147183.006579:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463594496 00010000:00010000:0.0:1746147183.006604:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 669 lvb_type: 0 00000100:00100000:0.0:1746147183.006624:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5568 00000100:00100000:0.0:1746147183.006644:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463594496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.006655:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.006678:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147183.006689:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147183.006709:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136966a00/0xb4b2209fbdac5bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60d5 expref: 29 pid: 21080 timeout: 669 lvb_type: 0 00010000:00010000:0.0:1746147183.006722:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.006724:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.006730:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.006742:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.006770:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.006782:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f81aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466350080:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147183.006839:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.007390:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463594240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5699us (6328us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147183.007400:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4280 00002000:00100000:3.0:1746147183.007409:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008d5dd180 x1830967463594240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.007417:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967463594240 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.007421:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:2.0:1746147183.008172:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f81aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466350080:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.008187:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.008870:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463594496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2224us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.008880:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5568 00000100:00100000:1.0:1746147183.009239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.009470:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463594752 00000100:00100000:3.0:1746147183.009477:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463594752 00002000:00100000:3.0:1746147183.009510:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2932736->2936831) req@ffff8800929f7800 x1830967463594752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.009520:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7800 with x1830967463594752 ext(2932736->2936831) 00002000:00010000:3.0:1746147183.009525:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f7800 00000100:00100000:3.0:1746147183.009715:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4281 00000100:00100000:3.0:1746147183.009723:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463594752:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147183.010194:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463594752:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 471us (954us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147183.010200:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4281 00002000:00100000:3.0:1746147183.010206:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2932736->2936831) req@ffff8800929f7800 x1830967463594752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.010214:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7800 with x1830967463594752 ext(2932736->2936831) 00002000:00010000:3.0:1746147183.010217:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f7800 00000100:00100000:0.0:1746147183.012664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.012736:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463594880 00000100:00100000:2.0:1746147183.012743:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463594880 00000100:00100000:2.0:1746147183.012805:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10425 00000100:00100000:2.0:1746147183.012813:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:28714:x1830967463594880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.012837:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.012855:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e2c00/0xb4b2209fbdac5be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60e3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.012932:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.012977:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.012989:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013003:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013008:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013013:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013151:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013162:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 32 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.013169:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.013200:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 32 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.013212:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 32 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.013224:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466350208:192.168.203.36@tcp:104: 00000100:00080000:0.0:1746147183.013478:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147183.013998:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.019228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.019328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.019413:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595136 00000100:00100000:2.0:1746147183.019421:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595136 00000100:00100000:3.0:1746147183.019439:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595008 00000100:00100000:3.0:1746147183.019444:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595008 00010000:00010000:2.0:1746147183.019453:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 33 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.019476:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5569 00000100:00100000:2.0:1746147183.019482:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463595136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147183.019487:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11360 00000100:00100000:3.0:1746147183.019493:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28709:x1830967463595008:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.019495:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.019503:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 33 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.019510:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.019513:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 33 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.019527:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60ea expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.019538:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.019549:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.019558:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.019564:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.019566:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.019569:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3788799] (req 3145728->3788799) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.019596:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.019724:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 11 pid: 6881 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.019736:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.019775:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.019784:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.019790:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.019804:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147183.019822:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.019826:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463595136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 344us (498us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147183.019829:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.019833:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5569 00000100:00100000:3.0:1746147183.019836:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350464:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.019854:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00010000:00010000:2.0:1746147183.019873:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095370000/0xb4b2209fbdac5a98 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6026 expref: 32 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.020644:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466350208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.020659:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020668:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020673:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147183.020715:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:2.0:1746147183.020719:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147183.020733:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020744:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020753:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020759:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020765:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020770:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946e3c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147183.020774:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020780:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020789:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147183.020792:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147183.020795:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020799:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3c00/0xb4b2209fbdac5bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020807:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020812:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020817:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020822:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946e3800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147183.020824:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020829:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020834:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48d00) 00010000:00010000:2.0:1746147183.020836:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147183.020838:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020842:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e3800/0xb4b2209fbdac5bf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.020872:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946e2c00/0xb4b2209fbdac5be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.020882:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 15 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.020889:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.020890:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147183.020893:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4811000, rc 0) 00000100:00100000:2.0:1746147183.021195:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:28714:x1830967463594880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8381us (8538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.021202:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10425 00000100:00100000:0.0:1746147183.023929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.024008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.024129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.024351:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595264 00000100:00100000:1.0:1746147183.024360:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595264 00000100:00100000:1.0:1746147183.024413:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595392 00000100:00100000:1.0:1746147183.024415:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595392 00000100:00100000:1.0:1746147183.024433:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595520 00000100:00100000:1.0:1746147183.024434:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595520 00000100:00100000:1.0:1746147183.024449:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11361 00000100:00100000:1.0:1746147183.024455:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463595264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.024475:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.024493:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60f1 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.024515:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024517:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024526:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024542:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024553:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51d5600, rc 0) 00000100:00100000:1.0:1746147183.024595:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463595264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 139us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.024600:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11361 00000100:00100000:1.0:1746147183.024624:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11362 00000100:00100000:1.0:1746147183.024638:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463595392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.024646:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.024655:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60f8 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.024666:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024667:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024671:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024681:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024687:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51d5c00, rc 0) 00000100:00100000:1.0:1746147183.024703:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463595392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 75us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.024709:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11362 00000100:00100000:1.0:1746147183.024721:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11363 00000100:00100000:1.0:1746147183.024725:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463595520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.024733:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.024739:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e60ff expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.024747:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024749:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.024752:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024765:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.024772:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51d4c00, rc 0) 00000100:00100000:1.0:1746147183.024786:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463595520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 61us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.024792:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11363 00000100:00080000:1.0:1746147183.024808:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147183.024811:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147183.024892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.024910:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595776 00000100:00100000:2.0:1746147183.024914:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595776 00000100:00100000:2.0:1746147183.024931:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11364 00000100:00100000:2.0:1746147183.024958:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463595776:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.024964:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.024971:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5c20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e610d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.024983:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.024992:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5c20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e610d expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.025001:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5c20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e610d expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.025010:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fec00, rc 0) 00000100:00100000:2.0:1746147183.025027:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463595776:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 91us (136us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.025032:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11364 00000100:00100000:2.0:1746147183.025151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.025165:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595648 00000100:00100000:2.0:1746147183.025168:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595648 00000100:00100000:2.0:1746147183.025183:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11365 00000100:00100000:2.0:1746147183.025187:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463595648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.025194:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.025202:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6106 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.025212:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.025214:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.025219:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.025229:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.025236:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ff200, rc 0) 00000100:00100000:2.0:1746147183.025250:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463595648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 62us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.025255:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11365 00000100:00100000:2.0:1746147183.034272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.034970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.035017:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596416 00000100:00100000:0.0:1746147183.035025:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596416 00000100:00100000:2.0:1746147183.035154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.035170:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596032 00000100:00100000:2.0:1746147183.035173:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596032 00000100:00100000:3.0:1746147183.035250:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350336:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.035262:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350464:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.035288:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3788799] (req 3145728->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 20 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.035305:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad000, rc 0) 00000100:00100000:3.0:1746147183.035350:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28709:x1830967463595008:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15857us (16131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.035358:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11360 00000100:00100000:3.0:1746147183.035379:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463595904 00000100:00100000:3.0:1746147183.035381:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463595904 00000100:00100000:3.0:1746147183.035398:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11366 00000100:00100000:3.0:1746147183.035403:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463595904:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.035417:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.035434:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5c2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6114 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.035544:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10426 00000100:00100000:0.0:1746147183.035551:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:28718:x1830967463596416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.035565:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.035576:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8200/0xb4b2209fbdac5c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e611b expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.035691:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035703:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035713:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035723:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035729:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035734:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035840:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035848:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035853:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147183.035862:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:0.0:1746147183.035975:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035982:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035987:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.035996:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b8600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147183.035999:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036006:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036014:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147183.036017:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147183.036020:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036025:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036037:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036041:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036045:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036049:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b8c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147183.036051:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036055:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036060:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008dc4be00) 00010000:00010000:0.0:1746147183.036062:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147183.036064:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036068:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac5c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.036102:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8200/0xb4b2209fbdac5c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 35 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.036111:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 34 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.036116:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147183.036118:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147183.036120:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8800, rc 0) 00000100:00100000:0.0:1746147183.036142:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:28718:x1830967463596416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 593us (1175us total) trans 8589944166 rc 0/0 00000100:00100000:0.0:1746147183.036148:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10426 00010000:00010000:2.0:1746147183.036979:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 12 pid: 6881 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.037000:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466350592:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147183.037003:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5570 00000100:00100000:2.0:1746147183.037010:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463596032:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.037020:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.037038:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 12 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.037049:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 12 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.037064:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac5bb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60c7 expref: 12 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.037079:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.037097:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463596032:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.037102:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5570 00000100:00080000:1.0:1746147183.039351:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147183.039659:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.039776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.040472:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596160 00000100:00100000:2.0:1746147183.040479:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596160 00010000:00010000:2.0:1746147183.040508:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.040539:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5571 00000100:00100000:2.0:1746147183.040545:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463596160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.040556:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.040576:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.040586:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.040604:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8400/0xb4b2209fbdac5ba2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60b9 expref: 20 pid: 6881 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.040620:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.040622:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.040637:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.040649:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.040678:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 19 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.040688:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466350720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.041513:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.041893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.042000:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466350592:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.042024:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5c2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6114 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.042036:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edad200/0xb4b2209fbdac5c2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6114 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.042057:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad200, rc 0) 00000100:00100000:3.0:1746147183.042088:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463595904:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6684us (7826us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.042094:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11366 00000100:00100000:0.0:1746147183.042202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.042400:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596544 00000100:00100000:3.0:1746147183.042405:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596544 00000100:00100000:3.0:1746147183.042439:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11367 00000100:00100000:3.0:1746147183.042446:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463596544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.042460:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.042473:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac5c58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6122 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.042507:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350848:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147183.042545:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.042592:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596672 00000100:00100000:0.0:1746147183.042594:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596672 00000100:00100000:0.0:1746147183.042619:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11368 00000100:00100000:0.0:1746147183.042623:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463596672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.042641:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.042649:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9800/0xb4b2209fbdac5c5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6129 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.042670:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466350976:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147183.042692:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00080000:1.0:1746147183.042783:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147183.046147:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466350720:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.046168:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.046236:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463596160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5690us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.046247:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5571 00000100:00100000:0.0:1746147183.046543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.046601:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463596928 00000100:00100000:1.0:1746147183.046608:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463596928 00000100:00100000:1.0:1746147183.046660:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10427 00000100:00100000:1.0:1746147183.046667:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:28714:x1830967463596928:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.046687:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147183.046692:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466350976:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.046706:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5a00/0xb4b2209fbdac5c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6130 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.046716:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9800/0xb4b2209fbdac5c5f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6129 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.046728:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9800/0xb4b2209fbdac5c5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6129 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.046740:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9800, rc 0) 00000100:00100000:0.0:1746147183.046761:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463596672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4136us (4559us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147183.046766:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11368 00000100:00100000:3.0:1746147183.046773:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466350848:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.046791:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac5c58 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6122 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.046798:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147183.046800:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac5c58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6122 expref: 12 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.046808:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac000, rc 0) 00010000:00010000:1.0:1746147183.046811:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.046818:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 33 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.046824:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147183.046828:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463596544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4382us (4937us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.046833:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11367 00010000:00010000:1.0:1746147183.046850:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 33 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.046862:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 33 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.046872:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466351104:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147183.047758:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.047768:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 16 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.047777:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466351232:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147183.047822:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.053611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.053690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.053700:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597184 00000100:00100000:3.0:1746147183.053709:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597184 00000100:00100000:0.0:1746147183.053735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147183.053750:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3784704->3788799) req@ffff8800a0449f80 x1830967463597184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147183.053752:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597312 00000100:00100000:0.0:1746147183.053755:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597312 00002000:00100000:3.0:1746147183.053759:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463597184 ext(3784704->3788799) 00002000:00010000:3.0:1746147183.053764:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0449f80 00010000:00010000:0.0:1746147183.053777:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 34 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.053784:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4282 00000100:00100000:3.0:1746147183.053791:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463597184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.053801:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597440 00000100:00100000:0.0:1746147183.053803:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597440 00000100:00100000:3.0:1746147183.053811:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5572 00010000:00010000:0.0:1746147183.053813:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.053817:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463597312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147183.053827:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5573 00010000:00010000:3.0:1746147183.053832:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147183.053832:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463597440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.053839:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 34 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.053839:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.053843:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.053854:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 34 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.053973:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466351104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147183.053984:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466351232:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147183.054045:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.054067:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b8800/0xb4b2209fbdac5c4a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e611b expref: 34 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.054083:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.054088:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147183.054095:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147183.054099:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.054136:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463597312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 320us (446us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147183.054137:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4811000/0xb4b2209fbdac5bfd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60e3 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.054142:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5572 00010000:00010000:0.0:1746147183.054147:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147183.054151:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147183.054158:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147183.054164:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147183.054179:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147183.054196:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463597440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 364us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147183.054202:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5573 00010000:00010000:1.0:1746147183.054427:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.054436:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.054442:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147183.054460:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147183.054588:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51d5a00/0xb4b2209fbdac5c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.054620:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.054637:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147183.054640:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147183.054642:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40200, rc 0) 00000100:00100000:3.0:1746147183.057748:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463597184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 3944us (4133us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147183.057763:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4282 00002000:00100000:3.0:1746147183.057775:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3784704->3788799) req@ffff8800a0449f80 x1830967463597184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.057785:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463597184 ext(3784704->3788799) 00002000:00010000:3.0:1746147183.057792:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0449f80 00000100:00100000:1.0:1746147183.057861:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463596928:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11190us (11315us total) trans 8589944167 rc 0/0 00000100:00100000:1.0:1746147183.057869:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10427 00000100:00100000:2.0:1746147183.058080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.058653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.058835:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597696 00000100:00100000:0.0:1746147183.058842:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597696 00000100:00100000:0.0:1746147183.058868:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597568 00000100:00100000:0.0:1746147183.058869:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597568 00000100:00100000:0.0:1746147183.058893:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11369 00000100:00100000:0.0:1746147183.058898:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463597696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.058916:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147183.058922:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11370 00000100:00100000:1.0:1746147183.058929:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463597568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.058934:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8200/0xb4b2209fbdac5c7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e613e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.058955:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.058966:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac5c82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6137 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.059000:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466351360:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147183.059001:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466351488:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.059242:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.059399:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.068406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.068532:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463597824 00000100:00100000:1.0:1746147183.068540:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463597824 00000100:00100000:1.0:1746147183.068588:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10428 00000100:00100000:1.0:1746147183.068596:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463597824:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:0.0:1746147183.068609:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466351488:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.068621:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.068648:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8200/0xb4b2209fbdac5c7b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e613e expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.068649:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac5c89 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6145 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.068662:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8200/0xb4b2209fbdac5c7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e613e expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147183.068669:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466351360:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147183.068674:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8200, rc 0) 00010000:00010000:2.0:1746147183.068695:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac5c82 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6137 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.068704:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac5c82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6137 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147183.068722:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463597696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9823us (10643us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147183.068723:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40800, rc 0) 00000100:00100000:0.0:1746147183.068727:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11369 00010000:00010000:1.0:1746147183.068728:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147183.068742:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.068748:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.068759:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463597568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9831us (10108us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.068765:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11370 00010000:00010000:1.0:1746147183.068775:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.068787:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 17 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.068798:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466351616:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147183.068808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.068850:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598080 00000100:00100000:1.0:1746147183.068852:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.068854:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598080 00000100:00100000:2.0:1746147183.068886:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4117 00000100:00100000:2.0:1746147183.068892:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+325:28709:x1830967463598080:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147183.069075:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28709:x1830967463598080:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 182us (266us total) trans 8589944168 rc 0/0 00000100:00100000:2.0:1746147183.069080:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4117 00000100:00100000:0.0:1746147183.070499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.070674:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466351616:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147183.070693:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.070768:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598208 00000100:00100000:2.0:1746147183.070773:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598208 00000100:00100000:2.0:1746147183.070803:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11371 00000100:00100000:2.0:1746147183.070809:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28718:x1830967463598208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.070823:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.070837:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e614c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.070859:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.070866:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.070868:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.070871:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.070895:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.070911:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 18 pid: 21080 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.070921:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466351744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.071007:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.074665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.074746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.074818:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466351744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.074835:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598336 00000100:00100000:2.0:1746147183.074843:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598336 00010000:00010000:3.0:1746147183.074859:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.074874:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fe000, rc 0) 00010000:00010000:2.0:1746147183.074877:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 18 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.074895:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598464 00000100:00100000:1.0:1746147183.074900:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598464 00000100:00100000:2.0:1746147183.074908:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5574 00000100:00100000:2.0:1746147183.074914:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1956:x1830967463598336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.074927:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147183.074928:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28718:x1830967463598208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4118us (4431us total) trans 0 rc 0/0 00002000:00100000:1.0:1746147183.074933:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3788799) req@ffff8800a0449180 x1830967463598464/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147183.074934:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 18 pid: 14125 timeout: 670 lvb_type: 0 00002000:00100000:1.0:1746147183.074962:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967463598464 ext(3145728->3788799) 00010000:00010000:1.0:1746147183.074970:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 19 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.074981:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 19 pid: 21080 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.074988:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0449180 00000100:00100000:1.0:1746147183.075003:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1471 00000100:00100000:1.0:1746147183.075008:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463598464:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147183.075132:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11371 00010000:00010000:2.0:1746147183.075718:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 18 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.075739:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac5c6d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6130 expref: 18 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.075757:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.075762:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.075775:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.075782:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.075801:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.075830:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463598336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 916us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.075836:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5574 00010000:00010000:2.0:1746147183.075858:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.075864:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147183.075904:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:2.0:1746147183.075908:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147183.075925:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.075969:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41600/0xb4b2209fbdac5c89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 17 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.075981:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.075986:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.075988:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147183.075991:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40400, rc 0) 00000100:00100000:2.0:1746147183.076014:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463597824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7420us (7620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.076020:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10428 00000100:00100000:0.0:1746147183.076293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.076826:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598592 00000100:00100000:2.0:1746147183.076831:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598592 00000100:00100000:2.0:1746147183.076911:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11372 00000100:00100000:2.0:1746147183.076918:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28711:x1830967463598592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.076930:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.076959:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6153 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.076977:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.076982:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.076988:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147183.076990:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2572288->3145727] (req 2572288->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.077331:0:8481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.077343:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2572288->3145727] (req 2572288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.077351:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ff400, rc 0) 00000100:00100000:2.0:1746147183.078584:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28711:x1830967463598592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1659us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.078593:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11372 00000100:00100000:0.0:1746147183.078705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.078975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.078993:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598720 00000100:00100000:0.0:1746147183.078999:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598720 00000100:00100000:0.0:1746147183.079022:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463598848 00000100:00100000:0.0:1746147183.079024:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463598848 00000100:00100000:0.0:1746147183.079367:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11373 00000100:00100000:0.0:1746147183.079376:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463598720:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147183.079392:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.079408:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5ca5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e615a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.079456:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466352000:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147183.079524:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.079995:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11374 00000100:00100000:3.0:1746147183.080003:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463598848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.080012:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.080023:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edac400/0xb4b2209fbdac5cac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6161 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.080051:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466352128:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147183.080076:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.083091:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466352000:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147183.083125:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5ca5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e615a expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.083139:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5ca5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e615a expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.083154:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8600, rc 0) 00000100:00100000:0.0:1746147183.083198:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463598720:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3821us (4490us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147183.083206:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11373 00000100:00100000:3.0:1746147183.084662:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466352128:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.084791:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edac400/0xb4b2209fbdac5cac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6161 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.085046:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edac400/0xb4b2209fbdac5cac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6161 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.085071:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac400, rc 0) 00000100:00100000:3.0:1746147183.085119:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463598848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5116us (6142us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.085127:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11374 00000100:00100000:1.0:1746147183.089836:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463598464:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14816us (15077us total) trans 21474840574 rc 0/0 00000100:00100000:1.0:1746147183.089849:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1471 00002000:00100000:1.0:1746147183.089860:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3788799) req@ffff8800a0449180 x1830967463598464/t21474840574(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.089869:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967463598464 ext(3145728->3788799) 00010000:00010000:1.0:1746147183.089879:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.089900:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.089907:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0449180 00000100:00100000:0.0:1746147183.090177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.090450:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463599104 00000100:00100000:3.0:1746147183.090457:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463599104 00000100:00100000:3.0:1746147183.090503:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10429 00000100:00100000:3.0:1746147183.090509:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463599104:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.090527:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.090545:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edade00/0xb4b2209fbdac5cb3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6168 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.091154:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091171:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091182:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091194:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091200:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091205:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091211:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edac800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.091214:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091220:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091234:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.091237:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147183.091241:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091245:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac800/0xb4b2209fbdac5cba lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.091273:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edade00/0xb4b2209fbdac5cb3 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6168 expref: 17 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.091280:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edade00/0xb4b2209fbdac5cb3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6168 expref: 17 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.091287:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edade00, rc 0) 00000100:00100000:3.0:1746147183.091338:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463599104:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 828us (1162us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.091344:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10429 00000100:00100000:0.0:1746147183.093016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.093082:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463599232 00000100:00100000:2.0:1746147183.093092:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463599232 00010000:00010000:2.0:1746147183.093124:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.093163:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5575 00000100:00100000:2.0:1746147183.093169:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463599232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.093181:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.093203:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.093214:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.093233:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac5c04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ea expref: 21 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.093261:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.093263:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.093271:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.093279:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.093311:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.093327:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 12 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.093338:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466352256:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.093421:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.096156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.096215:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463599488 00000100:00100000:2.0:1746147183.096223:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463599488 00000100:00100000:2.0:1746147183.096272:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4118 00000100:00100000:2.0:1746147183.096280:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:28714:x1830967463599488:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147183.096498:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:28714:x1830967463599488:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 217us (350us total) trans 8589944169 rc 0/0 00000100:00100000:2.0:1746147183.096505:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4118 00000100:00100000:2.0:1746147183.098084:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466352256:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.098132:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.098168:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463599232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4997us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.098177:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5575 00000100:00100000:0.0:1746147183.100270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.100352:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463599744 00000100:00100000:1.0:1746147183.100360:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463599744 00002000:00100000:1.0:1746147183.100405:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fa94700 x1830967463599744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.100415:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa94700 with x1830967463599744 ext(2097152->3145727) 00010000:00010000:1.0:1746147183.100424:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.100437:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.100445:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fa94700 00000100:00100000:1.0:1746147183.100472:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1472 00000100:00100000:1.0:1746147183.100479:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463599744:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147183.113843:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463599744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13352us (13567us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.113855:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1472 00002000:00100000:1.0:1746147183.113865:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fa94700 x1830967463599744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.113875:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa94700 with x1830967463599744 ext(2097152->3145727) 00010000:00010000:1.0:1746147183.113885:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.113901:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.113912:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fa94700 00000100:00100000:0.0:1746147183.120863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.121055:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463599872 00000100:00100000:3.0:1746147183.121064:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463599872 00000100:00100000:3.0:1746147183.121115:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11375 00000100:00100000:3.0:1746147183.121123:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28718:x1830967463599872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.121140:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.121160:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e616f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.121196:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.121210:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.121212:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.121215:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.121245:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.121257:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 27 pid: 21080 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.121268:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466352384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.121365:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.121663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.121702:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600000 00000100:00100000:2.0:1746147183.121706:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600000 00010000:00010000:2.0:1746147183.121727:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.121746:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5576 00000100:00100000:2.0:1746147183.121751:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463600000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.121761:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.121783:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.121798:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.121815:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e614c expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.121840:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.121841:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.121846:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.121853:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.121874:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.121882:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466352512:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.121919:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.122657:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466352384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.122678:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.122689:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad800, rc 0) 00000100:00100000:3.0:1746147183.122723:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28718:x1830967463599872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1600us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.122729:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11375 00000100:00100000:0.0:1746147183.123856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.124245:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600128 00000100:00100000:1.0:1746147183.124251:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600128 00000100:00100000:2.0:1746147183.124261:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466352512:192.168.203.36@tcp:105: 00002000:00100000:1.0:1746147183.124287:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2932736->3145727) req@ffff88008fa97800 x1830967463600128/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.124295:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa97800 with x1830967463600128 ext(2932736->3145727) 00010000:00010000:2.0:1746147183.124303:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147183.124303:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 28 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.124314:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 28 pid: 21080 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.124320:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa97800 00000100:00100000:1.0:1746147183.124335:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1473 00000100:00100000:1.0:1746147183.124341:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463600128:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147183.124484:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463600000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2731us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.124493:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5576 00000100:00100000:0.0:1746147183.128395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.128904:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600256 00000100:00100000:3.0:1746147183.128912:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600256 00000100:00100000:3.0:1746147183.128985:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11376 00000100:00100000:3.0:1746147183.128997:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28711:x1830967463600256:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147183.129014:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.129031:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6176 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.129055:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.129061:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.129067:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147183.129069:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.129106:0:8481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.129118:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.129127:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac800, rc 0) 00000100:00100000:3.0:1746147183.129171:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28711:x1830967463600256:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 175us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.129176:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11376 00000100:00100000:1.0:1746147183.129342:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463600128:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4999us (5488us total) trans 17179873172 rc 0/0 00000100:00100000:1.0:1746147183.129351:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1473 00002000:00100000:1.0:1746147183.129360:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2932736->3145727) req@ffff88008fa97800 x1830967463600128/t17179873172(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.129374:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa97800 with x1830967463600128 ext(2932736->3145727) 00010000:00010000:1.0:1746147183.129380:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.129392:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.129398:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa97800 00000100:00100000:0.0:1746147183.133345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.133442:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600384 00000100:00100000:2.0:1746147183.133452:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600384 00010000:00010000:2.0:1746147183.133481:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.133521:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5577 00000100:00100000:2.0:1746147183.133528:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463600384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.133541:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.133561:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.133572:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.133594:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946e3a00/0xb4b2209fbdac5be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2932736->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60dc expref: 30 pid: 21080 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.133622:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.133624:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.133643:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.133651:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.133682:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.133794:0:7120:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.133806:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466352768:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.133878:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.135982:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466352768:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.136028:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.136066:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463600384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2537us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.136075:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5577 00000100:00100000:0.0:1746147183.145052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.145083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.145118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.145142:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600768 00000100:00100000:2.0:1746147183.145143:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463600896 00000100:00100000:2.0:1746147183.145150:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600896 00000100:00100000:0.0:1746147183.145150:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463600768 00002000:00100000:2.0:1746147183.145191:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008fa96d80 x1830967463600896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.145191:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008fa97100 x1830967463600768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.145200:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa96d80 with x1830967463600896 ext(3145728->4194303) 00002000:00100000:0.0:1746147183.145200:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa97100 with x1830967463600768 ext(2097152->3145727) 00010000:00010000:2.0:1746147183.145209:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.145209:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.145223:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:2.0:1746147183.145230:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa96d80 00010000:00010000:0.0:1746147183.145231:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:0.0:1746147183.145237:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa97100 00000100:00100000:0.0:1746147183.145263:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463601152 00000100:00100000:0.0:1746147183.145266:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463601152 00000100:00100000:1.0:1746147183.145272:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1474 00002000:00100000:0.0:1746147183.145279:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fa95f80 x1830967463601152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147183.145281:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463600896:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:0.0:1746147183.145286:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95f80 with x1830967463601152 ext(3145728->4194303) 00002000:00010000:0.0:1746147183.145288:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fa95f80 00000100:00100000:0.0:1746147183.145299:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1475 00000100:00100000:0.0:1746147183.145303:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463600768:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147183.145401:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4283 00000100:00100000:0.0:1746147183.145408:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463601152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147183.158656:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463600768:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13341us (13602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.158669:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1475 00002000:00100000:1.0:1746147183.158680:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008fa97100 x1830967463600768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.158691:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa97100 with x1830967463600768 ext(2097152->3145727) 00010000:00010000:1.0:1746147183.158701:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.158715:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.158722:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa97100 00000100:00100000:2.0:1746147183.163156:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463601152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17741us (18029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147183.163169:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4283 00002000:00100000:2.0:1746147183.163181:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fa95f80 x1830967463601152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.163189:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95f80 with x1830967463601152 ext(3145728->4194303) 00002000:00010000:2.0:1746147183.163194:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fa95f80 00000100:00100000:3.0:1746147183.164884:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463600896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 19596us (19791us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.166305:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1474 00002000:00100000:3.0:1746147183.166322:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008fa96d80 x1830967463600896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.166339:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa96d80 with x1830967463600896 ext(3145728->4194303) 00010000:00010000:3.0:1746147183.166351:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.166366:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.166374:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa96d80 00000100:00100000:0.0:1746147183.166618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.167239:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463601408 00000100:00100000:3.0:1746147183.167247:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463601408 00002000:00100000:3.0:1746147183.167283:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008fa94e00 x1830967463601408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.167291:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa94e00 with x1830967463601408 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.167295:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fa94e00 00000100:00100000:3.0:1746147183.167322:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4284 00000100:00100000:3.0:1746147183.167329:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463601408:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147183.172438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.173008:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463601536 00000100:00100000:3.0:1746147183.173017:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463601536 00000100:00100000:3.0:1746147183.173055:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11377 00000100:00100000:3.0:1746147183.173063:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28718:x1830967463601536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.173080:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.173094:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e617d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.173115:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.173118:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.173124:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.173136:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.173144:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edada00, rc 0) 00000100:00100000:3.0:1746147183.173262:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28718:x1830967463601536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 199us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.173269:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11377 00000100:00100000:3.0:1746147183.176754:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463601408:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9415us (10133us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147183.176763:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4284 00002000:00100000:3.0:1746147183.176773:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008fa94e00 x1830967463601408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 675840/675840 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.176781:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa94e00 with x1830967463601408 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.176786:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fa94e00 00000100:00100000:0.0:1746147183.176829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.176918:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463601664 00000100:00100000:3.0:1746147183.176925:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463601664 00010000:00010000:3.0:1746147183.176962:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.176992:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5578 00000100:00100000:3.0:1746147183.176998:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463601664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.177009:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.177026:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.177037:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.177054:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edad800/0xb4b2209fbdac5cc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e616f expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.177431:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.177433:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.177438:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.177445:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.177471:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.177479:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466352896:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147183.177801:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.178890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.178933:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463601920 00000100:00100000:3.0:1746147183.178948:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463601920 00002000:00100000:3.0:1746147183.178971:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b6b9c00 x1830967463601920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.178977:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9c00 with x1830967463601920 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.178980:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9c00 00000100:00100000:3.0:1746147183.178999:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4285 00000100:00100000:3.0:1746147183.179003:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463601920:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147183.180307:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466352896:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147183.180321:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.180396:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463601664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3396us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.180405:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5578 00000100:00100000:0.0:1746147183.184167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.185065:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463602176 00000100:00100000:2.0:1746147183.185074:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463602176 00002000:00100000:2.0:1746147183.185110:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2449408->2453503) req@ffff88009b6b9180 x1830967463602176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.185118:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967463602176 ext(2449408->2453503) 00002000:00010000:2.0:1746147183.185122:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:2.0:1746147183.185153:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4286 00000100:00100000:2.0:1746147183.185160:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463602176:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.185307:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463602176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 147us (1148us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147183.185313:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4286 00002000:00100000:2.0:1746147183.185318:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2449408->2453503) req@ffff88009b6b9180 x1830967463602176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.185324:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9180 with x1830967463602176 ext(2449408->2453503) 00002000:00010000:2.0:1746147183.185327:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9180 00000100:00100000:0.0:1746147183.189182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.189241:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463602432 00000100:00100000:2.0:1746147183.189250:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463602432 00000100:00100000:2.0:1746147183.189294:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4119 00000100:00100000:2.0:1746147183.189301:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28711:x1830967463602432:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147183.189467:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:28711:x1830967463602432:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 165us (291us total) trans 8589944170 rc 0/0 00000100:00100000:2.0:1746147183.189472:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4119 00000100:00100000:3.0:1746147183.189560:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463601920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10554us (10672us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.189568:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4285 00002000:00100000:3.0:1746147183.189575:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b6b9c00 x1830967463601920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.189582:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9c00 with x1830967463601920 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.189587:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b9c00 00000100:00100000:2.0:1746147183.195679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.195752:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463602560 00000100:00100000:0.0:1746147183.195761:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463602560 00000100:00100000:0.0:1746147183.195812:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11378 00000100:00100000:0.0:1746147183.195823:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463602560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.195839:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.195854:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5cd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6184 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.195884:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5cd6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6184 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.195893:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8600/0xb4b2209fbdac5cd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6184 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.195911:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8600, rc 0) 00000100:00100000:0.0:1746147183.195964:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463602560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (296us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147183.195970:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11378 00000100:00100000:0.0:1746147183.200005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.200104:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463602688 00000100:00100000:2.0:1746147183.200113:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463602688 00000100:00100000:2.0:1746147183.200206:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11379 00000100:00100000:2.0:1746147183.200213:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463602688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.200228:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.200242:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5cdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e618b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.200265:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5cdd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e618b expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.200275:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9fe000/0xb4b2209fbdac5cdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e618b expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.200518:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fe000, rc 0) 00000100:00100000:2.0:1746147183.200722:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463602688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 508us (723us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.200728:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11379 00000100:00100000:0.0:1746147183.202171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.202828:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463602816 00000100:00100000:2.0:1746147183.202836:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463602816 00000100:00100000:2.0:1746147183.202868:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11380 00000100:00100000:2.0:1746147183.202875:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463602816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.202887:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.202900:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9fee00/0xb4b2209fbdac5ce4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6192 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.202920:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9fee00/0xb4b2209fbdac5ce4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6192 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.202928:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9fee00/0xb4b2209fbdac5ce4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6192 expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.202964:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fee00, rc 0) 00000100:00100000:2.0:1746147183.203000:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463602816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 125us (831us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.203005:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11380 00000100:00100000:0.0:1746147183.207210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.207263:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603072 00000100:00100000:2.0:1746147183.207276:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603072 00000100:00100000:2.0:1746147183.207321:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4120 00000100:00100000:2.0:1746147183.207329:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:28718:x1830967463603072:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147183.207485:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+35:28718:x1830967463603072:12345-192.168.203.36@tcp:35:cat.0 Request processed in 156us (326us total) trans 8589944171 rc 0/0 00000100:00100000:2.0:1746147183.207491:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4120 00000100:00100000:0.0:1746147183.232058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.232167:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603328 00000100:00100000:3.0:1746147183.232176:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603328 00000100:00100000:3.0:1746147183.232295:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10430 00000100:00100000:3.0:1746147183.232303:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28725:x1830967463603328:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.232322:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.232336:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac400/0xb4b2209fbdac5ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6199 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.232417:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232426:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232435:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232444:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232449:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232454:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232526:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232532:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232538:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.232544:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147183.232602:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232608:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232613:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232618:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edacc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.232621:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232637:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232646:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147183.232649:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.232652:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.232656:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edacc00/0xb4b2209fbdac5cf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233324:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233330:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233334:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233338:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edace00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.233340:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233345:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233351:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137600) 00010000:00010000:3.0:1746147183.233353:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.233356:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233360:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edace00/0xb4b2209fbdac5cf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.233393:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac400/0xb4b2209fbdac5ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 329 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.233402:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 328 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.233408:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.233410:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147183.233412:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac200, rc 0) 00000100:00100000:3.0:1746147183.233460:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+328:28725:x1830967463603328:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1158us (1408us total) trans 8589944172 rc 0/0 00000100:00100000:3.0:1746147183.233466:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10430 00000100:00100000:0.0:1746147183.236049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.236134:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603584 00000100:00100000:2.0:1746147183.236143:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603584 00000100:00100000:2.0:1746147183.236176:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4121 00000100:00100000:2.0:1746147183.236182:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+328:28725:x1830967463603584:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147183.236335:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+329:28725:x1830967463603584:12345-192.168.203.36@tcp:35:cat.0 Request processed in 152us (948us total) trans 8589944173 rc 0/0 00000100:00100000:2.0:1746147183.236342:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4121 00000100:00100000:0.0:1746147183.239733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.239773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.239798:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603712 00000100:00100000:2.0:1746147183.239807:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603712 00000100:00100000:3.0:1746147183.239822:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603840 00000100:00100000:3.0:1746147183.239825:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603840 00000100:00100000:2.0:1746147183.239874:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11381 00000100:00100000:2.0:1746147183.239882:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463603712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.239896:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.239910:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac5d0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61a0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.239969:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353024:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147183.240037:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.240247:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11382 00000100:00100000:0.0:1746147183.240254:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463603840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.240262:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.240270:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8a00/0xb4b2209fbdac5d15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61a7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.240287:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8a00/0xb4b2209fbdac5d15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61a7 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.240296:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8a00/0xb4b2209fbdac5d15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61a7 expref: 30 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.240318:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8a00, rc 0) 00000100:00100000:0.0:1746147183.240342:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463603840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (567us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147183.240347:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11382 00002000:00010000:2.0:1746147183.241381:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147182 -> 1746147183 00000100:00100000:2.0:1746147183.241400:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353024:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.241435:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac5d0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61a0 expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.241444:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac5d0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61a0 expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.241452:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ff600, rc 0) 00000100:00100000:2.0:1746147183.241480:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463603712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1599us (1754us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.241486:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11381 00000100:00100000:0.0:1746147183.248855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.248902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.248970:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604096 00000100:00100000:2.0:1746147183.248979:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604096 00000100:00100000:2.0:1746147183.249029:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463603968 00000100:00100000:2.0:1746147183.249031:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463603968 00000100:00100000:3.0:1746147183.249044:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11383 00000100:00100000:3.0:1746147183.249053:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463604096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.249069:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.249083:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edac000/0xb4b2209fbdac5d1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61b5 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.249108:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edac000/0xb4b2209fbdac5d1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61b5 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.249118:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edac000/0xb4b2209fbdac5d1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61b5 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.249148:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac000, rc 0) 00000100:00100000:3.0:1746147183.249186:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463604096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 135us (339us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.249226:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11384 00000100:00100000:2.0:1746147183.249233:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463603968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.249240:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.249248:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61ae expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.249278:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353152:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147183.249289:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11383 00000100:00100000:2.0:1746147183.249636:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.251254:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353152:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.251285:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d23 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ae expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.251293:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ae expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.251308:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fe200, rc 0) 00000100:00100000:2.0:1746147183.251336:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463603968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2103us (2432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.251342:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11384 00000100:00100000:0.0:1746147183.252934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.253108:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604224 00000100:00100000:2.0:1746147183.253115:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604224 00000100:00100000:2.0:1746147183.253213:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11385 00000100:00100000:2.0:1746147183.253219:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28725:x1830967463604224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.253233:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.253370:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61bc expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.253390:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 11 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.253397:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.253398:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.253401:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.253421:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 11 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.253430:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 11 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.253439:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353280:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.253498:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.256050:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466353280:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.256082:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.256096:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fea00, rc 0) 00000100:00100000:2.0:1746147183.256129:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28725:x1830967463604224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2910us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.256137:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11385 00000100:00100000:0.0:1746147183.256792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.256908:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604352 00000100:00100000:3.0:1746147183.256914:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604352 00002000:00100000:3.0:1746147183.256970:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2572288->3145727) req@ffff88009b6b9880 x1830967463604352/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.256978:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967463604352 ext(2572288->3145727) 00010000:00010000:3.0:1746147183.256984:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 12 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.256995:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 12 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.257000:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:3.0:1746147183.257022:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1476 00000100:00100000:3.0:1746147183.257028:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463604352:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147183.265554:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463604352:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7734us (7972us total) trans 21474840575 rc 0/0 00000100:00100000:3.0:1746147183.265568:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1476 00002000:00100000:3.0:1746147183.265581:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2572288->3145727) req@ffff88009b6b9880 x1830967463604352/t21474840575(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.265594:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967463604352 ext(2572288->3145727) 00010000:00010000:3.0:1746147183.265603:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.265616:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.265622:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:2.0:1746147183.272336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.272382:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604480 00000100:00100000:3.0:1746147183.272390:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604480 00010000:00010000:3.0:1746147183.272421:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.272453:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5579 00000100:00100000:3.0:1746147183.272460:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463604480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.272472:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.272489:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.272498:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.272515:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5c9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6153 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.272537:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.272539:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.272545:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.272552:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.272582:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.272593:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466353408:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147183.272676:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.275381:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466353408:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147183.275398:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.275553:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463604480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3092us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.275563:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5579 00000100:00100000:0.0:1746147183.278386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.278510:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604736 00000100:00100000:3.0:1746147183.278519:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604736 00002000:00100000:3.0:1746147183.278556:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b6bb480 x1830967463604736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.278565:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967463604736 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.278570:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:3.0:1746147183.278598:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4287 00000100:00100000:3.0:1746147183.278605:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463604736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147183.290586:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463604736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11970us (12195us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.290598:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4287 00002000:00100000:3.0:1746147183.290608:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b6bb480 x1830967463604736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.290616:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967463604736 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.290621:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:0.0:1746147183.297721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.297957:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604864 00000100:00100000:2.0:1746147183.297967:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604864 00000100:00100000:2.0:1746147183.298161:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11386 00000100:00100000:2.0:1746147183.298170:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28725:x1830967463604864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.298187:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.298202:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61c3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.298229:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.298236:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.298237:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.298240:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.298267:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.298276:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.298286:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466353536:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.298363:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.301023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.301044:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466353536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.301081:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.301094:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fec00, rc 0) 00000100:00100000:2.0:1746147183.301130:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28725:x1830967463604864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2960us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.301137:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11386 00000100:00100000:3.0:1746147183.301167:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463604992 00000100:00100000:3.0:1746147183.301173:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463604992 00002000:00100000:3.0:1746147183.301203:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2453503) req@ffff88009b6b8700 x1830967463604992/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.301211:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8700 with x1830967463604992 ext(2097152->2453503) 00010000:00010000:3.0:1746147183.301217:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.301227:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.301232:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b8700 00000100:00100000:3.0:1746147183.301257:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1477 00000100:00100000:3.0:1746147183.301264:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463604992:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147183.301705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.301834:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605248 00000100:00100000:3.0:1746147183.301838:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605248 00000100:00100000:3.0:1746147183.301870:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10431 00000100:00100000:3.0:1746147183.301876:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+329:28727:x1830967463605248:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147183.301887:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.301900:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ae00/0xb4b2209fbdac5d38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61ca expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.301981:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.301997:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.302003:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 330 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.302007:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.302030:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 330 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.302038:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 330 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.302047:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353664:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.302115:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 16 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.302122:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 16 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.302261:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353792:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.302283:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.307480:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353664:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.307493:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353792:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147183.307504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147183.307512:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.307684:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605376 00000100:00100000:2.0:1746147183.307690:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605376 00010000:00010000:2.0:1746147183.307716:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.307738:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5580 00000100:00100000:2.0:1746147183.307744:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463605376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.307754:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.307758:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.307766:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.307781:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40400/0xb4b2209fbdac5c90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6145 expref: 17 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.308358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.308371:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605504 00000100:00100000:0.0:1746147183.308375:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605504 00010000:00010000:0.0:1746147183.308388:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 331 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.308404:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5581 00000100:00100000:0.0:1746147183.308408:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+331:1956:x1830967463605504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.308414:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.308418:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 331 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.308425:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 331 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.308436:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5d00 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6199 expref: 331 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.309074:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147183.309079:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.309087:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147183.309097:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.309413:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.309417:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.309456:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463605376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1711us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.309462:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5580 00010000:00010000:1.0:1746147183.309559:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147183.309586:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1956:x1830967463605504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1177us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.309591:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5581 00010000:00010000:2.0:1746147183.309866:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.309872:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147183.309886:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000100:00100000:3.0:1746147183.309970:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463604992:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8706us (8954us total) trans 17179873173 rc 0/0 00000100:00100000:3.0:1746147183.309978:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1477 00002000:00100000:3.0:1746147183.309987:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2453503) req@ffff88009b6b8700 x1830967463604992/t17179873173(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.309995:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8700 with x1830967463604992 ext(2097152->2453503) 00010000:00010000:3.0:1746147183.310001:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.310012:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.310017:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6b8700 00010000:00010000:2.0:1746147183.310278:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94ae00/0xb4b2209fbdac5d38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 331 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.310292:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 330 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.310298:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.310300:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147183.310302:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94a400, rc 0) 00000100:00100000:2.0:1746147183.310640:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+330:28727:x1830967463605248:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8763us (8934us total) trans 8589944174 rc 0/0 00000100:00100000:2.0:1746147183.310646:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10431 00000100:00100000:0.0:1746147183.310794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.310903:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605632 00000100:00100000:3.0:1746147183.310909:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605632 00000100:00100000:3.0:1746147183.310993:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10432 00000100:00100000:3.0:1746147183.311001:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:28728:x1830967463605632:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.311015:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.311025:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61d1 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.311064:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311073:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311081:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311091:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311096:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311100:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311176:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311185:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 329 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.311190:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.311213:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 329 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.311222:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 329 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.311232:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353920:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.311295:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.311755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.313150:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605760 00000100:00100000:1.0:1746147183.313159:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605760 00010000:00010000:1.0:1746147183.313186:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.313218:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5582 00000100:00100000:1.0:1746147183.313225:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463605760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147183.313444:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147183.313464:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.313474:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.313491:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edac800/0xb4b2209fbdac5cc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6176 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.313514:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.313516:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.313521:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.313528:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.313560:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.313570:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466354048:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147183.313642:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.314203:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466353920:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.314221:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147183.314559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.315529:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463605888 00000100:00100000:2.0:1746147183.315536:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463605888 00010000:00010000:2.0:1746147183.315560:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 330 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.315687:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5583 00000100:00100000:2.0:1746147183.315694:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1959:x1830967463605888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.315707:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.315712:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 330 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.315721:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 330 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.315735:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5d3f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ca expref: 330 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.315746:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.315749:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.315756:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.315762:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.315782:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.315809:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1959:x1830967463605888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.315814:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5583 00010000:00010000:3.0:1746147183.315866:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315872:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.315905:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147183.315908:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147183.315920:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315928:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315949:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315955:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315960:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315964:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.315967:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315972:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315979:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147183.315981:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.315984:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315987:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.315997:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316001:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316005:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316008:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a1c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.316010:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316014:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316018:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137600) 00010000:00010000:3.0:1746147183.316019:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.316021:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316024:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5d5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.316048:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.316060:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 17 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.316065:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.316067:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147183.316069:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1a00, rc 0) 00000100:00100000:3.0:1746147183.316089:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:28728:x1830967463605632:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5090us (5296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.316094:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10432 00000100:00100000:2.0:1746147183.319448:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466354048:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.319467:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.319516:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463605760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6289us (7759us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.319528:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5582 00000100:00100000:0.0:1746147183.321039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.321081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.321144:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463606016 00000100:00100000:2.0:1746147183.321150:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463606016 00000100:00100000:2.0:1746147183.321177:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463606144 00000100:00100000:2.0:1746147183.321179:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463606144 00000100:00100000:2.0:1746147183.321255:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11387 00000100:00100000:3.0:1746147183.321262:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11388 00000100:00100000:2.0:1746147183.321263:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463606016:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147183.321271:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463606144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.321277:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.321279:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.321289:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61df expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.321289:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61d8 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.321306:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.321306:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.321307:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.321308:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.321313:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.321313:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.321325:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.321325:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.321333:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94bc00, rc 0) 00010000:00010000:2.0:1746147183.321333:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fe200, rc 0) 00000100:00100000:3.0:1746147183.321360:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463606144:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.321368:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11388 00000100:00100000:2.0:1746147183.321600:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463606016:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 337us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.321605:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11387 00000100:00100000:0.0:1746147183.321802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.321857:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463606400 00000100:00100000:3.0:1746147183.321861:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463606400 00002000:00100000:3.0:1746147183.321880:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f76d880 x1830967463606400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.321887:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d880 with x1830967463606400 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.321891:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76d880 00000100:00100000:3.0:1746147183.321905:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4288 00000100:00100000:3.0:1746147183.321909:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463606400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.322618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.322745:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463606656 00000100:00100000:1.0:1746147183.322748:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463606656 00002000:00100000:1.0:1746147183.322765:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76f800 x1830967463606656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.322773:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76f800 with x1830967463606656 ext(3145728->4194303) 00002000:00010000:1.0:1746147183.322776:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76f800 00000100:00100000:1.0:1746147183.323062:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4289 00000100:00100000:1.0:1746147183.323069:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463606656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.324294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.324372:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463606912 00000100:00100000:3.0:1746147183.324378:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463606912 00002000:00100000:3.0:1746147183.324398:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69c00 x1830967463606912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.324406:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967463606912 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.324409:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:3.0:1746147183.325431:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4290 00000100:00100000:3.0:1746147183.325441:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463606912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147183.333742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.333742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.334231:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607296 00000100:00100000:2.0:1746147183.334240:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607296 00000100:00100000:2.0:1746147183.334280:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10433 00000100:00100000:2.0:1746147183.334287:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:28728:x1830967463607296:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.334303:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.334318:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac5d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61ed expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334394:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.334406:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334412:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.334438:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334447:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 18 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.334618:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466354176:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.334695:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.334709:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607040 00000100:00100000:2.0:1746147183.334712:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607040 00000100:00100000:2.0:1746147183.334734:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11389 00000100:00100000:2.0:1746147183.334738:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28727:x1830967463607040:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.334746:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.334754:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61e6 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334771:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334783:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.334789:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.334795:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.334796:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.334799:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334815:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.334823:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 24 pid: 21080 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.334830:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463606400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12917us (13026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147183.334831:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354304:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.334839:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4288 00002000:00100000:3.0:1746147183.334847:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f76d880 x1830967463606400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.334856:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d880 with x1830967463606400 ext(2097152->3145727) 00010000:00010000:2.0:1746147183.334858:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147183.334860:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76d880 00010000:00010000:2.0:1746147183.334866:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 12 pid: 17548 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.334873:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.334898:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.334905:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 12 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.334912:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.334968:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.335060:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463606656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11990us (12442us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147183.335068:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4289 00002000:00100000:0.0:1746147183.335076:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76f800 x1830967463606656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.335084:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76f800 with x1830967463606656 ext(3145728->4194303) 00002000:00010000:0.0:1746147183.335087:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76f800 00000100:00100000:2.0:1746147183.340542:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466354176:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.340571:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147183.340653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.340667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.340702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.340716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.340735:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607936 00000100:00100000:0.0:1746147183.340741:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607936 00002000:00100000:0.0:1746147183.340776:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009f76fb80 x1830967463607936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.340788:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76fb80 with x1830967463607936 ext(4194304->4870143) 00002000:00010000:0.0:1746147183.340792:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76fb80 00000100:00100000:1.0:1746147183.340847:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607552 00000100:00100000:1.0:1746147183.340850:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607552 00010000:00010000:1.0:1746147183.340867:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 13 pid: 17548 timeout: 670 lvb_type: 1 00000100:00100000:1.0:1746147183.340882:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607424 00000100:00100000:1.0:1746147183.340884:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607424 00010000:00010000:1.0:1746147183.340891:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 19 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.340901:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463607808 00000100:00100000:1.0:1746147183.340903:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463607808 00010000:00010000:1.0:1746147183.340910:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 26 pid: 21080 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.340981:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354304:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.340989:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354432:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.341001:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354560:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.341043:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.341055:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ff400, rc 0) 00000100:00100000:3.0:1746147183.341089:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28727:x1830967463607040:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6350us (7349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.341097:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11389 00000100:00100000:0.0:1746147183.341375:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4291 00000100:00100000:0.0:1746147183.341382:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463607936:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.341431:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5584 00000100:00100000:2.0:1746147183.341437:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463607552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147183.341437:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5585 00000100:00100000:1.0:1746147183.341442:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+19:1959:x1830967463607424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.341445:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147183.341447:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147183.341452:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 19 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341458:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 13 pid: 17548 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.341460:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 19 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341465:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 13 pid: 17548 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.341476:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff200/0xb4b2209fbdac5c27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6106 expref: 13 pid: 17548 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.341476:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5d62 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d1 expref: 19 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341489:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147183.341490:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147183.341494:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147183.341501:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.341505:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463607552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 68us (853us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147183.341507:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.341510:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5584 00010000:00010000:1.0:1746147183.341520:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.341526:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5586 00000100:00100000:2.0:1746147183.341530:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463607808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147183.341532:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+18:1959:x1830967463607424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (865us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147183.341535:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147183.341537:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5585 00010000:00010000:2.0:1746147183.341542:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 25 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.341549:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 25 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.341559:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f08800/0xb4b2209fbdac5b5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e608f expref: 25 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.341566:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.341579:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967463607808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.341584:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5586 00010000:00010000:2.0:1746147183.341618:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.341623:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147183.341648:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147183.341738:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ff600/0xb4b2209fbdac5d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.341751:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.341756:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.341758:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147183.341760:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9fe800, rc 0) 00000100:00100000:2.0:1746147183.341777:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463607296:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7492us (8045us total) trans 8589944175 rc 0/0 00000100:00100000:2.0:1746147183.341782:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10433 00000100:00100000:2.0:1746147183.341852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.341862:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608064 00000100:00100000:2.0:1746147183.341865:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608064 00010000:00010000:2.0:1746147183.341877:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.341889:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5587 00000100:00100000:2.0:1746147183.341893:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463608064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.341898:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.341905:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341912:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341922:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4a600/0xb4b2209fbdac5b2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e607a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.341929:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.341931:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.341935:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.341956:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.341976:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.341985:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466354688:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.342016:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.342249:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463606912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16809us (17956us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.342256:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4290 00002000:00100000:3.0:1746147183.342261:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69c00 x1830967463606912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.342269:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967463606912 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.342272:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:2.0:1746147183.346238:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466354688:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.346268:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.346508:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463608064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4611us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.346518:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5587 00000100:00100000:1.0:1746147183.347387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.347456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.347971:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608320 00000100:00100000:3.0:1746147183.347979:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608320 00002000:00100000:3.0:1746147183.348014:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (2068480->2072575) req@ffff8800929f4000 x1830967463608320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.348021:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4000 with x1830967463608320 ext(2068480->2072575) 00002000:00010000:3.0:1746147183.348025:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f4000 00000100:00100000:2.0:1746147183.348116:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608448 00000100:00100000:2.0:1746147183.348120:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608448 00000100:00100000:2.0:1746147183.348145:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10434 00000100:00100000:2.0:1746147183.348152:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463608448:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.348168:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.348181:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ae00/0xb4b2209fbdac5d93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61f4 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.348244:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.348256:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.348262:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.348287:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.348297:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 19 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.348307:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466354816:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.348354:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.348402:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4292 00000100:00100000:3.0:1746147183.348409:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463608320:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147183.348523:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463608320:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 115us (1138us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147183.348529:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4292 00002000:00100000:3.0:1746147183.348534:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (2068480->2072575) req@ffff8800929f4000 x1830967463608320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.348541:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4000 with x1830967463608320 ext(2068480->2072575) 00002000:00010000:3.0:1746147183.348544:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f4000 00000100:00100000:3.0:1746147183.350182:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f69880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466354816:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147183.350194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147183.350211:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147183.350240:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608576 00000100:00100000:3.0:1746147183.350244:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608576 00010000:00010000:3.0:1746147183.350264:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 20 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.350295:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5588 00000100:00100000:3.0:1746147183.350302:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:1957:x1830967463608576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.350312:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.350317:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 20 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.350326:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 20 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.350346:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9fe800/0xb4b2209fbdac5d7e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61ed expref: 20 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.350353:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463607936:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8970us (9634us total) trans 0 rc 675840/675840 00010000:00010000:3.0:1746147183.350360:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:2.0:1746147183.350360:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4291 00010000:00010000:3.0:1746147183.350363:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00002000:00100000:2.0:1746147183.350366:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009f76fb80 x1830967463607936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 675840/675840 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147183.350370:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00002000:00100000:2.0:1746147183.350373:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76fb80 with x1830967463607936 ext(4194304->4870143) 00010000:00010000:3.0:1746147183.350376:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00002000:00010000:2.0:1746147183.350376:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76fb80 00010000:00010000:3.0:1746147183.350388:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.350404:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463608576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.350410:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5588 00010000:00010000:3.0:1746147183.350424:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.350430:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.350457:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147183.350460:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147183.350470:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.350489:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ae00/0xb4b2209fbdac5d93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.350502:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 18 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.350508:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.350510:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147183.350512:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2a000, rc 0) 00000100:00100000:3.0:1746147183.350542:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463608448:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2390us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.350547:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10434 00000100:00100000:0.0:1746147183.351667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.351741:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608704 00000100:00100000:3.0:1746147183.351746:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608704 00000100:00100000:3.0:1746147183.351850:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11390 00000100:00100000:3.0:1746147183.351857:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28727:x1830967463608704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147183.351870:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.351884:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e61fb expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.351904:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.351913:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.351918:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.351919:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.351922:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->2404351] (req 2097152->2404351) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.351969:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.351979:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 11 pid: 17530 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.351988:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354944:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.352430:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.352439:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.352447:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.352662:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.354400:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466354944:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.354407:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355072:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.354426:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->2404351] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.354438:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94a400, rc 0) 00000100:00100000:3.0:1746147183.354880:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:28727:x1830967463608704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3022us (3213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.354891:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11390 00000100:00100000:0.0:1746147183.357014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.357409:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608832 00000100:00100000:3.0:1746147183.357417:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608832 00000100:00100000:0.0:1746147183.357445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.357455:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11391 00000100:00100000:3.0:1746147183.357462:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463608832:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.357478:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147183.357493:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463608960 00000100:00100000:2.0:1746147183.357496:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463608960 00010000:00010000:2.0:1746147183.357512:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 13 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:3.0:1746147183.357528:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5da8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6202 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.357534:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5589 00000100:00100000:2.0:1746147183.357540:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463608960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.357550:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.357565:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 14 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.357575:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 14 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.357589:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fe200/0xb4b2209fbdac5d69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61d8 expref: 14 pid: 17530 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.357592:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355200:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.357602:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.357643:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463608960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.357649:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5589 00000100:00100000:3.0:1746147183.357816:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.357861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.357899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.357922:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463609216 00000100:00100000:2.0:1746147183.357925:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463609216 00010000:00010000:2.0:1746147183.357954:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.357968:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5590 00000100:00100000:2.0:1746147183.357973:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463609216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.357979:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.357986:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.357994:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.358004:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9fea00/0xb4b2209fbdac5d2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61bc expref: 22 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.358011:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.358013:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.358018:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.358024:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.358041:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.358048:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466355328:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.358090:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.358217:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463609088 00000100:00100000:1.0:1746147183.358221:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463609088 00000100:00100000:1.0:1746147183.358239:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11392 00000100:00100000:1.0:1746147183.358244:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463609088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.358251:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.358257:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a310c00/0xb4b2209fbdac5daf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6209 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.358278:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466355456:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.358512:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.359819:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466355328:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.359844:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.359883:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463609216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1908us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.359890:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5590 00002000:00010000:3.0:1746147183.360095:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147182 -> 1746147183 00002000:00010000:3.0:1746147183.360098:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147182 -> 1746147183 00002000:00010000:3.0:1746147183.360100:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147182 -> 1746147183 00000100:00100000:3.0:1746147183.360112:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355200:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.360128:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5da8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6202 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.360138:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5da8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6202 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.360146:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1c00, rc 0) 00000100:00100000:3.0:1746147183.360164:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463608832:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2702us (3156us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.360169:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11391 00002000:00010000:1.0:1746147183.361635:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147182 -> 1746147183 00002000:00010000:1.0:1746147183.361640:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147182 -> 1746147183 00000100:00100000:1.0:1746147183.361652:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466355456:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.361672:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a310c00/0xb4b2209fbdac5daf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6209 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.361681:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a310c00/0xb4b2209fbdac5daf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6209 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.362000:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a310c00, rc 0) 00000100:00100000:1.0:1746147183.362036:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463609088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3790us (4135us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147183.362046:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11392 00000100:00100000:0.0:1746147183.362181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.362348:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463609472 00000100:00100000:3.0:1746147183.362355:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463609472 00000100:00100000:3.0:1746147183.362384:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10435 00000100:00100000:3.0:1746147183.362390:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463609472:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.362403:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.362415:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5db6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6210 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.362481:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362492:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362500:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362509:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362514:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362519:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362523:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55a0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.362526:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362532:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362543:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.362547:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147183.362550:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362554:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a0800/0xb4b2209fbdac5dbd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.362575:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5db6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6210 expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.362581:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5db6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6210 expref: 19 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.362588:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1a00, rc 0) 00000100:00100000:3.0:1746147183.362610:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463609472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 220us (429us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.362616:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10435 00000100:00100000:2.0:1746147183.363866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.363927:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463609728 00000100:00100000:0.0:1746147183.363932:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463609728 00002000:00100000:0.0:1746147183.363986:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2404351) req@ffff880099f6b100 x1830967463609728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.363994:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b100 with x1830967463609728 ext(2400256->2404351) 00002000:00010000:0.0:1746147183.363998:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6b100 00000100:00100000:2.0:1746147183.364067:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4293 00000100:00100000:2.0:1746147183.364076:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463609728:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.364202:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463609728:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 127us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147183.364208:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4293 00002000:00100000:2.0:1746147183.364213:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2404351) req@ffff880099f6b100 x1830967463609728/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.364220:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b100 with x1830967463609728 ext(2400256->2404351) 00002000:00010000:2.0:1746147183.364223:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6b100 00000100:00100000:0.0:1746147183.364457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.364528:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463609984 00000100:00100000:1.0:1746147183.364532:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463609984 00000100:00100000:1.0:1746147183.364562:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4122 00000100:00100000:1.0:1746147183.364566:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:28728:x1830967463609984:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147183.364716:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+19:28728:x1830967463609984:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 148us (258us total) trans 8589944176 rc 0/0 00000100:00100000:1.0:1746147183.364722:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4122 00000100:00100000:2.0:1746147183.369380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.369473:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463610240 00000100:00100000:3.0:1746147183.369483:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463610240 00000100:00100000:3.0:1746147183.369735:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4123 00000100:00100000:3.0:1746147183.369744:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+329:28727:x1830967463610240:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147183.369915:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+330:28727:x1830967463610240:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 172us (541us total) trans 8589944177 rc 0/0 00000100:00100000:3.0:1746147183.369921:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4123 00000100:00100000:0.0:1746147183.411205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.411965:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463610496 00000100:00100000:1.0:1746147183.411974:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463610496 00000100:00100000:1.0:1746147183.412028:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10436 00000100:00100000:1.0:1746147183.412035:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+35:28733:x1830967463610496:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147183.412056:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.412070:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac5dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6217 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.412158:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412428:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412437:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412449:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412454:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412459:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412550:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412558:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412564:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147183.412572:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147183.412649:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412655:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412659:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412663:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147183.412667:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412672:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412680:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147183.412682:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147183.412685:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412689:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412721:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412725:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412729:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412733:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147183.412735:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412739:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412744:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:1.0:1746147183.412746:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147183.412748:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412751:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20800/0xb4b2209fbdac5dd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.412781:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac5dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 38 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.412790:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.412796:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147183.412798:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147183.412800:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20c00, rc 0) 00000100:00100000:1.0:1746147183.412861:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+37:28733:x1830967463610496:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 825us (1661us total) trans 8589944178 rc 0/0 00000100:00100000:1.0:1746147183.412867:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10436 00000100:00100000:0.0:1746147183.431501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.431570:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463610752 00000100:00100000:2.0:1746147183.431580:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463610752 00000100:00100000:2.0:1746147183.431640:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10437 00000100:00100000:2.0:1746147183.431648:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+37:28736:x1830967463610752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.431668:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.431683:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac5de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e621e expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.431755:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.431768:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.431776:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147183.431787:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147183.431874:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac5de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 40 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.431904:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.431911:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.431914:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746147183.431917:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2a600, rc 0) 00000100:00100000:2.0:1746147183.431981:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28736:x1830967463610752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 334us (486us total) trans 8589944179 rc 0/0 00000100:00100000:2.0:1746147183.431988:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10437 00000100:00100000:0.0:1746147183.437997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.438029:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463610880 00000100:00100000:1.0:1746147183.438039:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463610880 00000100:00100000:0.0:1746147183.438043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.438068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.438145:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611136 00000100:00100000:1.0:1746147183.438148:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611136 00000100:00100000:1.0:1746147183.438161:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611008 00000100:00100000:1.0:1746147183.438162:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611008 00000100:00100000:0.0:1746147183.438167:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11393 00000100:00100000:0.0:1746147183.438176:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463610880:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147183.438181:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11394 00000100:00100000:1.0:1746147183.438186:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463611136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.438193:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.438194:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.438206:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6233 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.438206:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4200/0xb4b2209fbdac5e03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6225 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.438224:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.438225:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.438233:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.438245:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147183.438247:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466355584:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.438254:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20200, rc 0) 00000100:00100000:1.0:1746147183.438290:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463611136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.438293:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11395 00000100:00100000:1.0:1746147183.438297:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11394 00000100:00100000:3.0:1746147183.438300:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463611008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.438307:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.438314:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e622c expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.438333:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147183.438391:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.438446:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.442178:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466355584:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.442208:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4200/0xb4b2209fbdac5e03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6225 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.442220:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4200/0xb4b2209fbdac5e03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6225 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.442269:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e9c4200, rc 0) 00000100:00100000:2.0:1746147183.442307:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463610880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4131us (4316us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.442314:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11393 00000100:00100000:2.0:1746147183.442988:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355712:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.443005:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e0a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e622c expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.443013:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e622c expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.443019:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1200, rc 0) 00000100:00100000:2.0:1746147183.443535:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463611008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5234us (5465us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.443540:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11395 00000100:00100000:2.0:1746147183.456280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.456807:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611264 00000100:00100000:3.0:1746147183.456817:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611264 00000100:00100000:3.0:1746147183.456857:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11396 00000100:00100000:3.0:1746147183.456865:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28736:x1830967463611264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.456879:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.456893:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e623a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.456919:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.456926:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.456927:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.456930:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.456974:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.457359:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 20 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.457382:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.457474:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.463959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.464071:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611392 00000100:00100000:1.0:1746147183.464079:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611392 00002000:00100000:1.0:1746147183.464120:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (2068480->2097151) req@ffff88008daaca80 x1830967463611392/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.464130:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaca80 with x1830967463611392 ext(2068480->2097151) 00010000:00010000:1.0:1746147183.464139:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 21 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.464153:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 21 pid: 17530 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.464160:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daaca80 00000100:00100000:3.0:1746147183.464175:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466355840:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147183.464184:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1478 00000100:00100000:1.0:1746147183.464189:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463611392:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:3.0:1746147183.464198:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.464212:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1c00, rc 0) 00000100:00100000:3.0:1746147183.464254:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28736:x1830967463611264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7389us (7980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.464261:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11396 00000100:00100000:1.0:1746147183.466185:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463611392:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1989us (2243us total) trans 21474840576 rc 0/0 00000100:00100000:1.0:1746147183.466195:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1478 00002000:00100000:1.0:1746147183.466203:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (2068480->2097151) req@ffff88008daaca80 x1830967463611392/t21474840576(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.466212:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaca80 with x1830967463611392 ext(2068480->2097151) 00010000:00010000:1.0:1746147183.466220:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.466233:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.466245:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daaca80 00000100:00100000:0.0:1746147183.470518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.470618:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611520 00000100:00100000:2.0:1746147183.470635:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611520 00010000:00010000:2.0:1746147183.470671:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.470697:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5591 00000100:00100000:2.0:1746147183.470705:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463611520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.470720:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.470749:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.470762:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.470785:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ff400/0xb4b2209fbdac5d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61e6 expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.470818:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.470820:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.470828:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.470836:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.471033:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.471047:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466355968:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.472564:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.478634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.479521:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611648 00000100:00100000:1.0:1746147183.479530:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611648 00000100:00100000:1.0:1746147183.479579:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10438 00000100:00100000:1.0:1746147183.479587:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:28737:x1830967463611648:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147183.479611:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.479638:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4513000/0xb4b2209fbdac5e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6241 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.479700:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479713:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479724:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479736:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479741:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479747:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479857:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479865:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479872:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147183.479903:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:1.0:1746147183.479907:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147183.479923:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479932:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479955:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479960:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479966:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479971:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b0a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147183.479975:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479981:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.479991:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147183.479993:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147183.479996:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480001:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0a00/0xb4b2209fbdac5e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480032:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480037:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480041:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480045:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b0e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147183.480048:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480053:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480059:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f400) 00010000:00010000:1.0:1746147183.480061:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147183.480063:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480067:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b0e00/0xb4b2209fbdac5e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147183.480104:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4513000/0xb4b2209fbdac5e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6241 expref: 21 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.480114:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6241 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.480120:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147183.480122:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147183.480125:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673b600, rc 0) 00000100:00100000:1.0:1746147183.480171:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+20:28737:x1830967463611648:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 584us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.480177:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10438 00000100:00100000:1.0:1746147183.482834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.483544:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466355968:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.483566:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147183.484259:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463611904 00000100:00100000:0.0:1746147183.484267:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463611904 00002000:00100000:0.0:1746147183.484308:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800929f4e00 x1830967463611904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.484319:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4e00 with x1830967463611904 ext(1048576->2097151) 00002000:00010000:0.0:1746147183.484323:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f4e00 00000100:00100000:0.0:1746147183.484342:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4294 00000100:00100000:0.0:1746147183.484349:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463611904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.484709:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463611520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 14002us (14196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.484718:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5591 00000100:00100000:0.0:1746147183.500114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.500158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.501793:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612288 00000100:00100000:2.0:1746147183.501804:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612288 00000100:00100000:2.0:1746147183.501876:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 584 00000100:00100000:2.0:1746147183.501883:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:1959:x1830967463612288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.501896:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.501925:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5e2d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6241 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.501981:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.501986:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.502032:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1959:x1830967463612288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 149us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.502038:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 584 00000100:00100000:3.0:1746147183.502191:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612032 00000100:00100000:3.0:1746147183.502196:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612032 00000100:00100000:3.0:1746147183.502226:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11397 00000100:00100000:3.0:1746147183.502231:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463612032:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147183.502247:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.502261:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6248 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.502279:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.502281:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.502288:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.502301:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.502316:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1200, rc 0) 00000100:00100000:3.0:1746147183.502336:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463612032:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 105us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.502341:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11397 00000100:00100000:0.0:1746147183.503264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.503463:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612416 00000100:00100000:3.0:1746147183.503467:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612416 00000100:00100000:3.0:1746147183.503489:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11398 00000100:00100000:3.0:1746147183.503495:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463612416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.503504:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.503513:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6256 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.503526:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.503528:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.503533:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.503542:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.503548:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1e00, rc 0) 00000100:00100000:3.0:1746147183.503567:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463612416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.503572:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11398 00000100:00100000:1.0:1746147183.503869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.504991:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612160 00000100:00100000:3.0:1746147183.505002:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612160 00000100:00100000:1.0:1746147183.506838:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463611904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22478us (24001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.506849:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4294 00002000:00100000:1.0:1746147183.506858:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800929f4e00 x1830967463611904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.506867:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4e00 with x1830967463611904 ext(1048576->2097151) 00002000:00010000:1.0:1746147183.506872:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f4e00 00000100:00100000:3.0:1746147183.506955:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11399 00000100:00100000:3.0:1746147183.506964:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463612160:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147183.506982:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.506998:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5e42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e624f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.507043:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466356096:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147183.507098:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.519140:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.519258:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612672 00000100:00100000:1.0:1746147183.519267:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612672 00002000:00100000:1.0:1746147183.519307:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008daad880 x1830967463612672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.519318:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463612672 ext(1048576->2097151) 00002000:00010000:1.0:1746147183.519324:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:1.0:1746147183.519355:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4295 00000100:00100000:1.0:1746147183.519361:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463612672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147183.527318:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466356096:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.527357:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5e42 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e624f expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.527372:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1a00/0xb4b2209fbdac5e42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e624f expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.527404:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55a1a00, rc 0) 00000100:00100000:3.0:1746147183.527466:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463612160:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 20502us (23595us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.527474:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11399 00000100:00100000:0.0:1746147183.536861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.537074:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463612800 00000100:00100000:3.0:1746147183.537083:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463612800 00000100:00100000:3.0:1746147183.537124:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11400 00000100:00100000:3.0:1746147183.537131:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28736:x1830967463612800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.537152:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.537169:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e625d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.537200:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.537207:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.537209:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147183.537212:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.537239:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.537249:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 24 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.537259:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466356224:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.537958:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.538084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.538099:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463612672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18735us (18968us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.538109:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4295 00002000:00100000:1.0:1746147183.538118:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008daad880 x1830967463612672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.538127:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463612672 ext(1048576->2097151) 00002000:00010000:1.0:1746147183.538132:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:3.0:1746147183.538180:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613056 00000100:00100000:3.0:1746147183.538184:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613056 00000100:00100000:3.0:1746147183.538217:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10439 00000100:00100000:3.0:1746147183.538222:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:28737:x1830967463613056:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147183.538231:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.538241:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6264 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.538329:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.538346:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.538351:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 38 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.538356:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.538374:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 38 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.538382:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 38 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.538390:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466356352:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.538441:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.538449:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 20 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.538456:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466356480:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.538473:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.539281:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466356224:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.539301:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.539320:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b94a000, rc 0) 00000100:00100000:3.0:1746147183.539342:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28736:x1830967463612800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2211us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.539348:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11400 00000100:00100000:0.0:1746147183.539805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.539863:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613184 00000100:00100000:1.0:1746147183.539868:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613184 00002000:00100000:1.0:1746147183.539896:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2404351) req@ffff88008daae300 x1830967463613184/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.539903:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae300 with x1830967463613184 ext(2097152->2404351) 00010000:00010000:1.0:1746147183.539909:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.539919:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 23 pid: 17530 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.539924:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daae300 00000100:00100000:3.0:1746147183.540117:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1479 00000100:00100000:3.0:1746147183.540124:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463613184:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147183.540882:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466356352:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.540891:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466356480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.540909:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147183.541212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.543304:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613312 00000100:00100000:2.0:1746147183.543314:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613312 00010000:00010000:2.0:1746147183.543357:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 21 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.543389:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5592 00000100:00100000:2.0:1746147183.543395:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+21:1959:x1830967463613312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.543408:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.543413:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 21 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.543423:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 21 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.543444:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5d9a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61f4 expref: 21 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.543462:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.543467:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.543479:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.543484:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.543548:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:1959:x1830967463613312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 153us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.543554:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5592 00000100:00100000:1.0:1746147183.544218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.544493:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613440 00000100:00100000:2.0:1746147183.544498:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613440 00010000:00010000:2.0:1746147183.544515:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 39 pid: 14125 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.545727:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5593 00000100:00100000:2.0:1746147183.545737:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1956:x1830967463613440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.545751:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.545758:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 39 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.545768:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 39 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.545785:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac5dd9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6217 expref: 39 pid: 14125 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.545804:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.545809:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.545820:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.545827:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.545858:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.545891:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1956:x1830967463613440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 156us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.545897:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5593 00010000:00010000:3.0:1746147183.546250:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.546258:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.546277:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147183.546416:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edac200/0xb4b2209fbdac5e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6264 expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.546443:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6264 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.546449:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.546452:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147183.546455:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a11200, rc 0) 00000100:00100000:3.0:1746147183.546479:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28737:x1830967463613056:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8256us (8396us total) trans 8589944180 rc 0/0 00000100:00100000:3.0:1746147183.546485:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10439 00000100:00100000:1.0:1746147183.547418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.549194:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463613184:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9065us (9384us total) trans 21474840577 rc 0/0 00000100:00100000:2.0:1746147183.549204:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1479 00002000:00100000:2.0:1746147183.549213:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2404351) req@ffff88008daae300 x1830967463613184/t21474840577(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.549222:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae300 with x1830967463613184 ext(2097152->2404351) 00010000:00010000:2.0:1746147183.549231:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 25 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.549245:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 25 pid: 17530 timeout: 670 lvb_type: 0 00002000:00010000:2.0:1746147183.549251:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daae300 00000100:00100000:2.0:1746147183.549299:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613568 00000100:00100000:2.0:1746147183.549305:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613568 00000100:00100000:2.0:1746147183.549327:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11401 00000100:00100000:2.0:1746147183.549332:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28740:x1830967463613568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.549345:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.549358:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e626b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.549378:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.549382:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2404352->3145727] (req 2404352->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.549391:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2404352->3145727] (req 2404352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.549399:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a773ae00, rc 0) 00000100:00100000:2.0:1746147183.549411:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28740:x1830967463613568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.549415:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11401 00000100:00100000:0.0:1746147183.550233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.550296:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613824 00000100:00100000:3.0:1746147183.550301:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613824 00000100:00100000:3.0:1746147183.550335:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10440 00000100:00100000:3.0:1746147183.550341:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28737:x1830967463613824:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147183.550359:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.550361:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147183.550382:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac5e57 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6264 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.550396:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.550399:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147183.550407:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5e6c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6272 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.550590:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550601:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550610:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550620:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550635:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550641:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550645:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d59dc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.550649:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550655:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550661:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.550663:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147183.550666:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550670:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59dc00/0xb4b2209fbdac5e73 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.550690:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5e6c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6272 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.550696:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5e6c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6272 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.550701:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59d600, rc 0) 00000100:00100000:3.0:1746147183.551753:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:28737:x1830967463613824:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 1408us (1519us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.551761:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10440 00000100:00100000:1.0:1746147183.551897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.552270:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463613952 00000100:00100000:0.0:1746147183.552277:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463613952 00010000:00010000:0.0:1746147183.552302:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 26 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.552333:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5594 00000100:00100000:0.0:1746147183.552339:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463613952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.552349:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.552368:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 26 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.552380:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 26 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.552398:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a400/0xb4b2209fbdac5da1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61fb expref: 26 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.552413:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.552415:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.552423:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.552431:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.552438:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.552439:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.552442:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.552453:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.552480:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.552492:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466356608:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147183.552559:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.552567:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466356736:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147183.552585:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.554077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.554391:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463614208 00000100:00100000:1.0:1746147183.554397:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463614208 00000100:00100000:1.0:1746147183.554440:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4124 00000100:00100000:1.0:1746147183.554447:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+19:28737:x1830967463614208:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147183.554666:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+20:28737:x1830967463614208:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 219us (593us total) trans 8589944181 rc 0/0 00000100:00100000:1.0:1746147183.554673:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4124 00000100:00100000:2.0:1746147183.555542:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466356608:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.555552:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466356736:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.555571:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.555607:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463613952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3267us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.555615:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5594 00000100:00100000:0.0:1746147183.562194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.562228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.562855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.563015:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463614464 00000100:00100000:2.0:1746147183.563025:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463614464 00002000:00100000:2.0:1746147183.563081:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008daaf480 x1830967463614464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.563091:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf480 with x1830967463614464 ext(2097152->3145727) 00002000:00010000:2.0:1746147183.563097:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf480 00000100:00100000:2.0:1746147183.563118:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463614720 00000100:00100000:2.0:1746147183.563120:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463614720 00002000:00100000:2.0:1746147183.563132:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008daaf800 x1830967463614720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.563138:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf800 with x1830967463614720 ext(3145728->4194303) 00002000:00010000:2.0:1746147183.563140:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf800 00000100:00100000:2.0:1746147183.563149:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463614976 00000100:00100000:2.0:1746147183.563151:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463614976 00002000:00100000:2.0:1746147183.563162:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daaea00 x1830967463614976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.563168:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaea00 with x1830967463614976 ext(2097152->3145727) 00002000:00010000:2.0:1746147183.563171:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daaea00 00000100:00100000:2.0:1746147183.563183:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4296 00000100:00100000:2.0:1746147183.563189:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463614464:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.564396:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4297 00000100:00100000:2.0:1746147183.564405:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463614720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147183.565364:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4298 00000100:00100000:1.0:1746147183.565374:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463614976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.566475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.566970:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463615232 00000100:00100000:3.0:1746147183.566978:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463615232 00002000:00100000:3.0:1746147183.567013:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2404352->3452927) req@ffff88008daac700 x1830967463615232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.567023:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac700 with x1830967463615232 ext(2404352->3452927) 00002000:00010000:3.0:1746147183.567028:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac700 00000100:00100000:3.0:1746147183.567043:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4299 00000100:00100000:3.0:1746147183.567050:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463615232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.567483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.568107:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463615360 00000100:00100000:3.0:1746147183.568112:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463615360 00002000:00100000:3.0:1746147183.568131:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3452928->4194303) req@ffff88008daad180 x1830967463615360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.568139:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad180 with x1830967463615360 ext(3452928->4194303) 00002000:00010000:3.0:1746147183.568142:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daad180 00000100:00100000:3.0:1746147183.568158:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4300 00000100:00100000:3.0:1746147183.568606:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463615360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147183.575733:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463614464:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12533us (13537us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.575745:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4296 00002000:00100000:3.0:1746147183.575755:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008daaf480 x1830967463614464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.575766:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf480 with x1830967463614464 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.575772:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf480 00000100:00100000:1.0:1746147183.583758:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463614976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18372us (20890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.583772:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4298 00002000:00100000:1.0:1746147183.583786:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daaea00 x1830967463614976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.583796:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaea00 with x1830967463614976 ext(2097152->3145727) 00002000:00010000:1.0:1746147183.583802:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daaea00 00000100:00100000:3.0:1746147183.589696:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463615232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22634us (23211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.589709:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4299 00002000:00100000:3.0:1746147183.589721:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2404352->3452927) req@ffff88008daac700 x1830967463615232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.589731:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac700 with x1830967463615232 ext(2404352->3452927) 00002000:00010000:3.0:1746147183.589737:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac700 00000100:00100000:3.0:1746147183.597351:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463615360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 29176us (29856us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746147183.597351:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463614720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 32944us (35117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.597363:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4300 00000100:00100000:2.0:1746147183.597367:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4297 00002000:00100000:3.0:1746147183.597375:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3452928->4194303) req@ffff88008daad180 x1830967463615360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.597375:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008daaf800 x1830967463614720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.597384:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad180 with x1830967463615360 ext(3452928->4194303) 00002000:00100000:2.0:1746147183.597384:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf800 with x1830967463614720 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.597389:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daad180 00002000:00010000:2.0:1746147183.597389:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf800 00000100:00100000:0.0:1746147183.608638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.608989:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463615744 00000100:00100000:3.0:1746147183.608998:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463615744 00000100:00100000:3.0:1746147183.609058:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10441 00000100:00100000:3.0:1746147183.609066:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+330:28743:x1830967463615744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147183.609091:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.609466:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d200/0xb4b2209fbdac5e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6279 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.609567:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.609580:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.609591:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.609605:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147183.609732:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d200/0xb4b2209fbdac5e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 333 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.609757:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 332 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.609765:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.609767:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147183.609770:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59cc00, rc 0) 00000100:00100000:3.0:1746147183.610635:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+332:28743:x1830967463615744:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1560us (2006us total) trans 8589944182 rc 0/0 00000100:00100000:3.0:1746147183.610642:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10441 00000100:00100000:3.0:1746147183.610739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.613738:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616000 00000100:00100000:2.0:1746147183.613752:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616000 00002000:00100000:2.0:1746147183.613805:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e135880 x1830967463616000/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.613817:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135880 with x1830967463616000 ext(4194304->4870143) 00002000:00010000:2.0:1746147183.613824:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135880 00000100:00100000:2.0:1746147183.613862:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4301 00000100:00100000:2.0:1746147183.613869:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463616000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.616457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.616527:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616256 00000100:00100000:3.0:1746147183.616536:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616256 00002000:00100000:3.0:1746147183.616573:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800936dca80 x1830967463616256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.616583:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967463616256 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.616588:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:3.0:1746147183.616620:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4302 00000100:00100000:3.0:1746147183.616634:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463616256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.626251:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463616000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12370us (15499us total) trans 0 rc 675840/675840 00000100:00100000:2.0:1746147183.626273:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4301 00002000:00100000:2.0:1746147183.626284:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88008e135880 x1830967463616000/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.626294:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135880 with x1830967463616000 ext(4194304->4870143) 00002000:00010000:2.0:1746147183.626300:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135880 00000100:00100000:3.0:1746147183.628023:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463616256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11383us (11571us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147183.628032:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4302 00002000:00100000:3.0:1746147183.628041:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800936dca80 x1830967463616256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.628050:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967463616256 ext(4194304->4870143) 00002000:00010000:3.0:1746147183.628056:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746147183.631982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.632213:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616384 00000100:00100000:2.0:1746147183.632222:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616384 00000100:00100000:2.0:1746147183.632279:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11402 00000100:00100000:2.0:1746147183.632286:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28733:x1830967463616384:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.632304:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.632322:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6280 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632348:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632360:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.632366:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.632372:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632378:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.632379:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.632382:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 7/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3391488->4194303] (req 3391488->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632407:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632416:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.632427:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466356864:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.632528:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.632536:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 10 pid: 8481 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.632544:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466356992:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.632567:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 17 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.632574:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 17 pid: 21080 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.632580:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357120:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.632601:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.632608:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 29 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.632615:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357248:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.632655:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.634170:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466356864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.634178:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466356992:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.634183:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.634189:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099f68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357248:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.634225:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3391488->4194303] (req 3391488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.634244:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904200, rc 0) 00000100:00100000:2.0:1746147183.634711:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28733:x1830967463616384:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2424us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.634719:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11402 00000100:00100000:0.0:1746147183.635412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.635516:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616640 00000100:00100000:2.0:1746147183.635522:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616640 00010000:00010000:2.0:1746147183.635546:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.635578:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5595 00000100:00100000:2.0:1746147183.635585:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463616640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.635597:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.635620:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.635639:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.635661:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edada00/0xb4b2209fbdac5ccf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e617d expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.636227:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.636274:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463616640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 689us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.636280:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5595 00000100:00100000:2.0:1746147183.636797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.636841:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616768 00000100:00100000:0.0:1746147183.636845:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616768 00010000:00010000:0.0:1746147183.636860:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.636911:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5596 00000100:00100000:0.0:1746147183.636917:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463616768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.636925:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.636960:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.636969:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.636984:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9fec00/0xb4b2209fbdac5d31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61c3 expref: 30 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.637006:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147183.637061:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463616768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 143us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.637068:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5596 00000100:00100000:0.0:1746147183.638066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.638079:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616512 00000100:00100000:1.0:1746147183.638083:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616512 00010000:00010000:1.0:1746147183.638099:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 670 lvb_type: 1 00000100:00100000:1.0:1746147183.638125:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5597 00000100:00100000:1.0:1746147183.638132:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463616512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147183.638140:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147183.638151:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638159:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638177:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b94bc00/0xb4b2209fbdac5d70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e61df expref: 11 pid: 8481 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638192:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147183.638228:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463616512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.638233:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5597 00000100:00100000:0.0:1746147183.638360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.638392:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463616896 00000100:00100000:1.0:1746147183.638395:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463616896 00010000:00010000:1.0:1746147183.638406:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 670 lvb_type: 1 00000100:00100000:1.0:1746147183.638430:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5598 00000100:00100000:1.0:1746147183.638435:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463616896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147183.638441:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147183.638448:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638456:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638467:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac5dfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6233 expref: 16 pid: 21080 timeout: 670 lvb_type: 1 00010000:00010000:1.0:1746147183.638475:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.638477:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.638484:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.638490:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.638519:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.638530:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466357376:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147183.638591:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.643450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.643504:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463617152 00000100:00100000:3.0:1746147183.643512:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463617152 00000100:00100000:2.0:1746147183.643542:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466357376:192.168.203.36@tcp:105: 00002000:00100000:3.0:1746147183.643552:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3391488->3395583) req@ffff88012c9f0700 x1830967463617152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147183.643561:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147183.643562:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967463617152 ext(3391488->3395583) 00002000:00010000:3.0:1746147183.643566:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0700 00000100:00100000:3.0:1746147183.643597:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4303 00000100:00100000:2.0:1746147183.643601:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463616896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5165us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.643603:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463617152:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.643609:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5598 00000100:00100000:3.0:1746147183.643759:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463617152:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 155us (318us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147183.643764:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4303 00002000:00100000:3.0:1746147183.643768:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3391488->3395583) req@ffff88012c9f0700 x1830967463617152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.643775:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0700 with x1830967463617152 ext(3391488->3395583) 00002000:00010000:3.0:1746147183.643778:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0700 00000100:00100000:0.0:1746147183.648475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.648570:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463617280 00000100:00100000:2.0:1746147183.648577:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463617280 00000100:00100000:2.0:1746147183.648612:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11403 00000100:00100000:2.0:1746147183.648690:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28733:x1830967463617280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.648710:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.648726:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6287 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648754:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648764:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648769:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.648771:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.648774:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4440063] (req 4194304->4440063) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648802:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648819:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 24 pid: 8478 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.648831:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466357504:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.648925:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.648933:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.648966:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466357632:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.648994:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.655132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.655281:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466357504:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.655336:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463617408 00000100:00100000:3.0:1746147183.655342:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463617408 00010000:00010000:3.0:1746147183.655377:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.655403:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5599 00000100:00100000:3.0:1746147183.655410:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463617408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.655422:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.655444:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.655455:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.655478:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a773ae00/0xb4b2209fbdac5e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e626b expref: 25 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.655511:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.655552:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967463617408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.655559:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5599 00000100:00100000:2.0:1746147183.655677:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466357632:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.655705:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4440063] (req 4194304->4440063) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.655716:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904e00, rc 0) 00000100:00100000:2.0:1746147183.655755:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28733:x1830967463617280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7134us (7286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.655762:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11403 00000100:00100000:0.0:1746147183.656051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.656084:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463617536 00000100:00100000:2.0:1746147183.656088:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463617536 00010000:00010000:2.0:1746147183.656100:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.656125:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5600 00000100:00100000:2.0:1746147183.656130:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463617536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.656137:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.656149:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.656158:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.656171:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b94a000/0xb4b2209fbdac5e49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e625d expref: 15 pid: 8478 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.656188:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.656190:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.656197:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.656206:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.656231:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.656241:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466357760:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.656302:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.658804:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466357760:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.658821:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.658867:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463617536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2734us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.658877:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5600 00000100:00100000:0.0:1746147183.660258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.660349:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463617792 00000100:00100000:3.0:1746147183.660357:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463617792 00002000:00100000:3.0:1746147183.660395:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4435968->4440063) req@ffff8800936dd880 x1830967463617792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.660405:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830967463617792 ext(4435968->4440063) 00002000:00010000:3.0:1746147183.660410:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:3.0:1746147183.660426:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4304 00000100:00100000:3.0:1746147183.660431:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463617792:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147183.660655:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463617792:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 223us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147183.660664:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4304 00002000:00100000:3.0:1746147183.660669:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4435968->4440063) req@ffff8800936dd880 x1830967463617792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.660675:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830967463617792 ext(4435968->4440063) 00002000:00010000:3.0:1746147183.660677:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:0.0:1746147183.662193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.662249:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618048 00000100:00100000:3.0:1746147183.662255:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618048 00000100:00100000:3.0:1746147183.662293:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4125 00000100:00100000:3.0:1746147183.662300:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+38:28733:x1830967463618048:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147183.662526:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28733:x1830967463618048:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 225us (336us total) trans 8589944183 rc 0/0 00000100:00100000:3.0:1746147183.662532:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4125 00000100:00100000:0.0:1746147183.674777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.674861:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618176 00000100:00100000:2.0:1746147183.674870:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618176 00000100:00100000:2.0:1746147183.674911:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11404 00000100:00100000:2.0:1746147183.674918:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28743:x1830967463618176:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.674950:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.674970:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e628e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.675000:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.675009:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.675015:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.675022:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.675023:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.675027:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.675059:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.675070:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.675081:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357888:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.676028:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 9 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.676038:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 9 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.676046:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358016:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.676221:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.676230:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 14 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.676436:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358144:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.676584:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.678240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.678481:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618304 00000100:00100000:3.0:1746147183.678487:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618304 00000100:00100000:2.0:1746147183.678496:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466357888:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.678508:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358016:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.678514:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.678515:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.678538:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5601 00010000:00010000:2.0:1746147183.678538:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.678544:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463618304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.678556:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.678578:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 670 lvb_type: 1 00010000:00010000:3.0:1746147183.678587:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 670 lvb_type: 1 00010000:00010000:3.0:1746147183.678609:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d4c00/0xb4b2209fbdac5c19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60ff expref: 10 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:1.0:1746147183.678792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147183.678829:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905e00, rc 0) 00000100:00100000:2.0:1746147183.678865:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28743:x1830967463618176:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3948us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.678873:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11404 00000100:00100000:0.0:1746147183.678953:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618432 00000100:00100000:0.0:1746147183.678957:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618432 00010000:00010000:0.0:1746147183.678971:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:0.0:1746147183.678987:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5602 00000100:00100000:0.0:1746147183.678992:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463618432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.678998:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.679288:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147183.679292:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 670 lvb_type: 1 00010000:00010000:0.0:1746147183.679301:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 670 lvb_type: 1 00010000:00010000:0.0:1746147183.679313:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4a400/0xb4b2209fbdac5b55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6088 expref: 30 pid: 6881 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.679319:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463618304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 775us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.679325:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5601 00010000:00010000:0.0:1746147183.679331:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147183.679345:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463618432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 353us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147183.679350:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5602 00000100:00100000:0.0:1746147183.680257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.680430:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618560 00000100:00100000:2.0:1746147183.680434:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618560 00010000:00010000:2.0:1746147183.680449:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 15 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.680555:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5603 00000100:00100000:2.0:1746147183.680561:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463618560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.680568:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.680578:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 15 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.680587:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 15 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.680601:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4ba00/0xb4b2209fbdac5b24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6073 expref: 15 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.680635:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.680637:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.680643:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.680650:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.680677:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.680688:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466358272:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.680753:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.682479:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466358272:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.682494:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.682520:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463618560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1958us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.682527:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5603 00000100:00100000:0.0:1746147183.682824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.682929:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618816 00000100:00100000:2.0:1746147183.682934:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618816 00002000:00100000:2.0:1746147183.683021:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff8800936ddc00 x1830967463618816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.683031:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830967463618816 ext(1863680->1867775) 00002000:00010000:2.0:1746147183.683035:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ddc00 00000100:00100000:2.0:1746147183.683296:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4305 00000100:00100000:2.0:1746147183.683303:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463618816:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.683596:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463618816:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 292us (772us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147183.683602:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4305 00002000:00100000:2.0:1746147183.683607:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff8800936ddc00 x1830967463618816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.683615:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830967463618816 ext(1863680->1867775) 00002000:00010000:2.0:1746147183.683618:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ddc00 00000100:00100000:0.0:1746147183.689440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.689764:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463618944 00000100:00100000:2.0:1746147183.689776:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463618944 00000100:00100000:2.0:1746147183.689837:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11405 00000100:00100000:2.0:1746147183.689844:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:28743:x1830967463618944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.689859:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.689874:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6295 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.689899:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.689910:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.689916:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.689925:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.689927:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.689930:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1445887] (req 1048576->1445887) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.689974:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.689984:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 11 pid: 17530 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.689993:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358400:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.690074:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.690081:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 670 lvb_type: 1 00000100:00100000:2.0:1746147183.690088:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.690106:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.690113:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.690123:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358656:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.690135:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.695743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.695783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.695869:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619072 00000100:00100000:3.0:1746147183.695881:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619072 00010000:00010000:3.0:1746147183.695916:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 670 lvb_type: 1 00000100:00100000:3.0:1746147183.695965:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619200 00000100:00100000:3.0:1746147183.695967:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619200 00010000:00010000:3.0:1746147183.695979:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 14 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.695993:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358400:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.695999:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5604 00000100:00100000:2.0:1746147183.696005:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5605 00000100:00100000:3.0:1746147183.696006:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463619072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147183.696010:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463619200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.696019:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.696019:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147183.696036:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.696036:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 14 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.696045:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:2.0:1746147183.696094:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 14 pid: 17530 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.696114:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.696169:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463619200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 157us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.696175:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5605 00000100:00100000:2.0:1746147183.696203:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.696212:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1c00/0xb4b2209fbdac5e11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e623a expref: 13 pid: 17530 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.696225:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466358656:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.696250:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1445887] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.696264:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905800, rc 0) 00000100:00100000:2.0:1746147183.696300:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28743:x1830967463618944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6452us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.696305:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11405 00010000:00010000:3.0:1746147183.696360:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1200/0xb4b2209fbdac5e34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6248 expref: 12 pid: 17530 timeout: 670 lvb_type: 1 00010000:00010000:3.0:1746147183.696371:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147183.696392:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463619072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 387us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.696397:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5604 00000100:00100000:1.0:1746147183.697758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.697847:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619328 00000100:00100000:0.0:1746147183.697856:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619328 00010000:00010000:0.0:1746147183.697884:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 670 lvb_type: 1 00000100:00100000:0.0:1746147183.697932:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5606 00000100:00100000:0.0:1746147183.697967:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463619328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.697979:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.697998:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 670 lvb_type: 1 00010000:00010000:0.0:1746147183.698008:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 670 lvb_type: 1 00010000:00010000:0.0:1746147183.698025:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55a1e00/0xb4b2209fbdac5e3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6256 expref: 25 pid: 8478 timeout: 670 lvb_type: 1 00010000:00010000:0.0:1746147183.698050:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.698052:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.698060:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.698068:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.698099:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.698116:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466358784:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147183.698192:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.700378:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466358784:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.700401:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.700873:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463619328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2905us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.700885:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5606 00000100:00100000:0.0:1746147183.704479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.704567:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619584 00000100:00100000:2.0:1746147183.704575:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619584 00002000:00100000:2.0:1746147183.704677:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1441792->1445887) req@ffff8800936df100 x1830967463619584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.704688:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967463619584 ext(1441792->1445887) 00002000:00010000:2.0:1746147183.704694:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:2.0:1746147183.704725:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4306 00000100:00100000:2.0:1746147183.704732:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463619584:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147183.705110:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463619584:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 377us (641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147183.705116:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4306 00002000:00100000:2.0:1746147183.705121:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1441792->1445887) req@ffff8800936df100 x1830967463619584/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.705127:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967463619584 ext(1441792->1445887) 00002000:00010000:2.0:1746147183.705130:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:0.0:1746147183.784208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.784323:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619840 00000100:00100000:3.0:1746147183.784331:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619840 00000100:00100000:3.0:1746147183.784385:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10442 00000100:00100000:3.0:1746147183.784392:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28749:x1830967463619840:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147183.784415:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.784433:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdac5eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e629c expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.784528:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.784543:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.784553:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.784563:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147183.784698:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59ce00/0xb4b2209fbdac5eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 42 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.784731:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 41 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.784738:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.784741:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147183.784744:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d59d600, rc 0) 00000100:00100000:3.0:1746147183.784795:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+41:28749:x1830967463619840:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 403us (597us total) trans 8589944184 rc 0/0 00000100:00100000:3.0:1746147183.784800:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10442 00010000:00010000:2.0:1746147183.817179:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147183.835696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.836393:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463619968 00000100:00100000:2.0:1746147183.836402:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463619968 00000100:00100000:2.0:1746147183.836454:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11406 00000100:00100000:2.0:1746147183.836461:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28749:x1830967463619968:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147183.836478:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.836498:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62a3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.836527:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.836534:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.836536:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.836539:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1355776->1961983] (req 1355776->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.836565:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.836576:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 28 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.836587:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358912:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.836701:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.838861:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466358912:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.838891:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1355776->1961983] (req 1355776->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.838907:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb1dc00, rc 0) 00000100:00100000:2.0:1746147183.838987:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28749:x1830967463619968:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2524us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.838995:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11406 00000100:00100000:0.0:1746147183.839905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.840044:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620096 00000100:00100000:2.0:1746147183.840050:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620096 00002000:00100000:2.0:1746147183.840084:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff8800936dfb80 x1830967463620096/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.840094:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967463620096 ext(1863680->2097151) 00010000:00010000:2.0:1746147183.840101:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 29 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.840114:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 29 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:2.0:1746147183.840120:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dfb80 00000100:00100000:2.0:1746147183.840197:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1480 00000100:00100000:2.0:1746147183.840204:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463620096:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147183.844436:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463620096:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4223us (4524us total) trans 17179873174 rc 0/0 00000100:00100000:2.0:1746147183.844449:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1480 00002000:00100000:2.0:1746147183.844460:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff8800936dfb80 x1830967463620096/t17179873174(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.844471:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830967463620096 ext(1863680->2097151) 00010000:00010000:2.0:1746147183.844482:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.844498:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:2.0:1746147183.844506:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746147183.846335:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.846572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.846663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.846825:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620224 00000100:00100000:1.0:1746147183.846833:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620224 00000100:00100000:1.0:1746147183.846875:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620352 00000100:00100000:1.0:1746147183.846877:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620352 00000100:00100000:1.0:1746147183.846895:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11407 00000100:00100000:1.0:1746147183.846901:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463620224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.846918:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.846961:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ecd8800/0xb4b2209fbdac5ec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62aa expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.847017:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466359040:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.847082:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.847106:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11408 00000100:00100000:1.0:1746147183.847112:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463620352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.847120:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.847130:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac5ece lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62b1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.847155:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466359168:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.847173:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.847664:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620480 00000100:00100000:3.0:1746147183.847669:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620480 00010000:00010000:3.0:1746147183.847688:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.847708:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5607 00000100:00100000:3.0:1746147183.847712:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463620480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147183.847721:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147183.847737:0:7120:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147182 -> 1746147183 00002000:00010000:3.0:1746147183.847740:0:7120:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147182 -> 1746147183 00010000:00010000:3.0:1746147183.847746:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.847757:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.847780:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.847782:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.847789:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.847797:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.847820:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.847828:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466359296:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147183.847867:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.849085:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466359168:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.849109:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac5ece lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62b1 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.849125:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac5ece lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62b1 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.849151:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0a2000, rc 0) 00000100:00100000:2.0:1746147183.849180:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463620352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2067us (2607us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.849186:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11408 00010000:00010000:1.0:1746147183.849463:0:8478:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012c9f0380 x1830967466359040) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.849481:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092905e00/0xb4b2209fbdac5e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e628e expref: 31 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.849493:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466359040:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.849508:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ecd8800/0xb4b2209fbdac5ec7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62aa expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.849515:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ecd8800/0xb4b2209fbdac5ec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62aa expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.849521:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ecd8800, rc 0) 00000100:00100000:1.0:1746147183.849537:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463620224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2637us (3208us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147183.849541:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11407 00000100:00100000:1.0:1746147183.850197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.850210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.850230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.850248:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620608 00000100:00100000:1.0:1746147183.850252:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620608 00000100:00100000:1.0:1746147183.850277:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620864 00000100:00100000:0.0:1746147183.850361:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463620736 00000100:00100000:0.0:1746147183.850365:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620736 00000100:00100000:2.0:1746147183.850368:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11409 00000100:00100000:2.0:1746147183.850374:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463620608:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147183.850384:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11410 00010000:00010000:2.0:1746147183.850387:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147183.850388:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463620736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.850394:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.850399:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092905400/0xb4b2209fbdac5ed5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62b8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.850402:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac5edc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62bf expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.850435:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466359552:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147183.850435:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466359424:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147183.850474:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.850494:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466359296:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.850505:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147183.850571:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1abb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.850674:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463620864 00000100:00100000:1.0:1746147183.850692:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11411 00000100:00100000:1.0:1746147183.850698:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463620864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.850704:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.850711:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1be00/0xb4b2209fbdac5ee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62c6 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.850732:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466359680:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.850756:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.850840:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463620480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3126us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.850848:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5607 00000100:00100000:3.0:1746147183.854115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:3.0:1746147183.854230:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147182 -> 1746147183 00002000:00010000:3.0:1746147183.854234:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147182 -> 1746147183 00002000:00010000:3.0:1746147183.854236:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147182 -> 1746147183 00000100:00100000:3.0:1746147183.854258:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466359680:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.854289:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1be00/0xb4b2209fbdac5ee3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62c6 expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.854309:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1be00/0xb4b2209fbdac5ee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62c6 expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.854324:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1be00, rc 0) 00000100:00100000:3.0:1746147183.854366:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463620864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3667us (4154us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147183.854407:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463621120 00000100:00100000:0.0:1746147183.854412:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463621120 00002000:00100000:0.0:1746147183.854446:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1355775) req@ffff88008e134700 x1830967463621120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.854455:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134700 with x1830967463621120 ext(1048576->1355775) 00002000:00010000:0.0:1746147183.854459:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134700 00000100:00100000:0.0:1746147183.854477:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4307 00000100:00100000:0.0:1746147183.854483:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463621120:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:2.0:1746147183.854653:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147182 -> 1746147183 00000100:00100000:2.0:1746147183.854661:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466359552:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.854675:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092905400/0xb4b2209fbdac5ed5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62b8 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.854683:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092905400/0xb4b2209fbdac5ed5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62b8 expref: 32 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.854697:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905400, rc 0) 00000100:00100000:2.0:1746147183.854713:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463620608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4340us (4519us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.854719:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11409 00000100:00100000:2.0:1746147183.854853:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466359424:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147183.854872:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac5edc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62bf expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.854886:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c10a00/0xb4b2209fbdac5edc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62bf expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.854893:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c10a00, rc 0) 00000100:00100000:2.0:1746147183.854913:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463620736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4524us (4682us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147183.854918:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11410 00000100:00100000:3.0:1746147183.855306:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11411 00000100:00100000:0.0:1746147183.857187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.857969:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463621376 00000100:00100000:2.0:1746147183.857976:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463621376 00002000:00100000:2.0:1746147183.858011:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1957888->1961983) req@ffff8800936de300 x1830967463621376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.858020:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830967463621376 ext(1957888->1961983) 00002000:00010000:2.0:1746147183.858025:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936de300 00000100:00100000:2.0:1746147183.858056:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4308 00000100:00100000:2.0:1746147183.858063:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463621376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.858205:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463621376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 142us (1022us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147183.858211:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4308 00002000:00100000:2.0:1746147183.858216:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1957888->1961983) req@ffff8800936de300 x1830967463621376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.858223:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830967463621376 ext(1957888->1961983) 00002000:00010000:2.0:1746147183.858226:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936de300 00000100:00100000:1.0:1746147183.863855:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463621120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9360us (9737us total) trans 0 rc 307200/307200 00000100:00100000:1.0:1746147183.863870:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4307 00002000:00100000:1.0:1746147183.863882:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1355775) req@ffff88008e134700 x1830967463621120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 307200/307200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.863892:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134700 with x1830967463621120 ext(1048576->1355775) 00002000:00010000:1.0:1746147183.863898:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134700 00000100:00100000:2.0:1746147183.864349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.864490:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463621504 00000100:00100000:0.0:1746147183.864498:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463621504 00000100:00100000:0.0:1746147183.864541:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11412 00000100:00100000:0.0:1746147183.864548:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28756:x1830967463621504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147183.864563:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.864580:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62cd expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.864606:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.864613:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147183.864615:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147183.864619:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.864659:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.864671:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.864683:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466359808:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147183.864749:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.867773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.867830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.867988:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463621760 00000100:00100000:1.0:1746147183.867996:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463621760 00000100:00100000:2.0:1746147183.867998:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466359808:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147183.868029:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147183.868034:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1961984->2097151) req@ffff88009f047b80 x1830967463621760/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.868042:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830967463621760 ext(1961984->2097151) 00010000:00010000:2.0:1746147183.868045:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7a6e00, rc 0) 00010000:00010000:1.0:1746147183.868049:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.868060:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.868064:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f047b80 00000100:00100000:1.0:1746147183.868083:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463621888 00000100:00100000:1.0:1746147183.868085:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463621888 00000100:00100000:2.0:1746147183.868086:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28756:x1830967463621504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3538us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.868093:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11412 00002000:00100000:1.0:1746147183.868094:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1355776->1961983) req@ffff88009f046d80 x1830967463621888/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.868101:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830967463621888 ext(1355776->1961983) 00010000:00010000:1.0:1746147183.868104:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.868110:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.868115:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f046d80 00000100:00100000:1.0:1746147183.868126:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1481 00000100:00100000:1.0:1746147183.868132:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463621760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.868161:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1482 00000100:00100000:2.0:1746147183.868170:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463621888:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147183.873232:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463621760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5088us (5455us total) trans 0 rc 135168/135168 00000100:00100000:2.0:1746147183.873243:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1481 00002000:00100000:2.0:1746147183.873253:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1961984->2097151) req@ffff88009f047b80 x1830967463621760/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 135168/135168 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.873263:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830967463621760 ext(1961984->2097151) 00010000:00010000:2.0:1746147183.873273:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.873286:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:2.0:1746147183.873293:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f047b80 00000100:00100000:0.0:1746147183.876708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.876744:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463621888:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8574us (8911us total) trans 17179873175 rc 0/0 00000100:00100000:2.0:1746147183.876951:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622016 00000100:00100000:2.0:1746147183.876959:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622016 00000100:00100000:2.0:1746147183.877001:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11413 00000100:00100000:2.0:1746147183.877008:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28755:x1830967463622016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.877025:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.877043:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62d4 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.877069:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.877076:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.877078:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147183.877081:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.877109:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.877119:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 23 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.877131:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466359936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147183.877196:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.877580:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1482 00002000:00100000:3.0:1746147183.877590:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1355776->1961983) req@ffff88009f046d80 x1830967463621888/t17179873175(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.877599:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830967463621888 ext(1355776->1961983) 00010000:00010000:3.0:1746147183.877607:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.877617:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.877635:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f046d80 00000100:00100000:1.0:1746147183.879334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.879434:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622144 00000100:00100000:2.0:1746147183.879434:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466359936:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.879439:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622144 00010000:00010000:2.0:1746147183.879458:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 14 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147183.879471:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1445887) req@ffff88012c9f1880 x1830967463622144/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147183.879472:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904000, rc 0) 00002000:00100000:3.0:1746147183.879478:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967463622144 ext(1048576->1445887) 00010000:00010000:3.0:1746147183.879483:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 24 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.879491:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 24 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.879501:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1880 00000100:00100000:2.0:1746147183.879507:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28755:x1830967463622016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2500us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.879513:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11413 00000100:00100000:3.0:1746147183.879516:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1483 00000100:00100000:3.0:1746147183.879521:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463622144:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147183.879763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.879820:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622272 00000100:00100000:2.0:1746147183.879823:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622272 00010000:00010000:2.0:1746147183.879840:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.879869:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5608 00000100:00100000:2.0:1746147183.879874:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463622272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.879883:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.879902:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.879911:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.880188:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eb1dc00/0xb4b2209fbdac5ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62a3 expref: 17 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.880212:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.880214:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.880223:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.880231:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.880261:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.880272:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466360064:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.880333:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.883568:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463622144:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4002us (4197us total) trans 21474840578 rc 0/0 00000100:00100000:3.0:1746147183.883581:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1483 00002000:00100000:3.0:1746147183.883592:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1445887) req@ffff88012c9f1880 x1830967463622144/t21474840578(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.883602:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967463622144 ext(1048576->1445887) 00010000:00010000:3.0:1746147183.883612:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.883634:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.883641:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1880 00000100:00100000:2.0:1746147183.883727:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466360064:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.883745:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.883766:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463622272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3892us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.883773:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5608 00000100:00100000:1.0:1746147183.883976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.884409:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622528 00000100:00100000:3.0:1746147183.884416:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622528 00002000:00100000:3.0:1746147183.884442:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012c9f1f80 x1830967463622528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.884450:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967463622528 ext(1048576->2097151) 00002000:00010000:3.0:1746147183.884454:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1f80 00000100:00100000:3.0:1746147183.884565:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4309 00000100:00100000:3.0:1746147183.884573:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463622528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.885009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.886538:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622656 00000100:00100000:2.0:1746147183.886546:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622656 00010000:00010000:2.0:1746147183.886571:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.886593:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5609 00000100:00100000:2.0:1746147183.886599:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463622656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.886609:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.886801:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.886816:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.886844:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6295 expref: 26 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.886858:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.886860:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.886872:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.886881:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.886911:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 13 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147183.886922:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466360192:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.887008:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.889563:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466360192:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.889584:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.890221:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463622656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3619us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.890233:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5609 00000100:00100000:0.0:1746147183.892232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.892302:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463622912 00000100:00100000:2.0:1746147183.892310:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463622912 00002000:00100000:2.0:1746147183.892348:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009a80c000 x1830967463622912/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.892364:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c000 with x1830967463622912 ext(1048576->2097151) 00002000:00010000:2.0:1746147183.892370:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c000 00000100:00100000:2.0:1746147183.892389:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4310 00000100:00100000:2.0:1746147183.892396:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463622912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147183.897992:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463622528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13409us (14006us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.898003:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4309 00002000:00100000:3.0:1746147183.898014:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012c9f1f80 x1830967463622528/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.899007:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967463622528 ext(1048576->2097151) 00002000:00010000:3.0:1746147183.899013:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1f80 00000100:00100000:2.0:1746147183.901658:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463622912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9254us (9425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147183.901668:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4310 00002000:00100000:2.0:1746147183.901679:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009a80c000 x1830967463622912/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.901686:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c000 with x1830967463622912 ext(1048576->2097151) 00002000:00010000:2.0:1746147183.901691:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c000 00000100:00100000:0.0:1746147183.905020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.905086:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463623040 00000100:00100000:2.0:1746147183.905094:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463623040 00000100:00100000:2.0:1746147183.905654:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11414 00000100:00100000:2.0:1746147183.905662:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28756:x1830967463623040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147183.905677:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147183.905690:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62db expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.905712:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.905713:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.905720:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.905732:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.905741:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905800, rc 0) 00000100:00100000:2.0:1746147183.905793:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28756:x1830967463623040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 132us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.905798:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11414 00000100:00100000:0.0:1746147183.911249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.911335:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463623296 00000100:00100000:2.0:1746147183.911344:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463623296 00002000:00100000:2.0:1746147183.911381:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009a80dc00 x1830967463623296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.911390:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80dc00 with x1830967463623296 ext(1048576->2097151) 00002000:00010000:2.0:1746147183.911394:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80dc00 00000100:00100000:2.0:1746147183.911427:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4311 00000100:00100000:2.0:1746147183.911434:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463623296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.918725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.918765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.919639:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463623680 00000100:00100000:3.0:1746147183.919650:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463623680 00000100:00100000:0.0:1746147183.919655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147183.919689:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80c700 x1830967463623680/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147183.919690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147183.919700:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c700 with x1830967463623680 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.919704:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c700 00000100:00100000:0.0:1746147183.919720:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463623808 00000100:00100000:3.0:1746147183.919722:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624192 00000100:00100000:0.0:1746147183.919722:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463623808 00000100:00100000:3.0:1746147183.919723:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624192 00002000:00100000:3.0:1746147183.919734:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3391487) req@ffff8800a56b7800 x1830967463624192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147183.919734:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a56b4a80 x1830967463623808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.919740:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7800 with x1830967463624192 ext(3145728->3391487) 00002000:00100000:0.0:1746147183.919740:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4a80 with x1830967463623808 ext(3145728->4194303) 00002000:00010000:3.0:1746147183.919743:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b7800 00002000:00010000:0.0:1746147183.919743:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4a80 00000100:00100000:3.0:1746147183.919750:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624064 00000100:00100000:3.0:1746147183.919751:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624064 00002000:00100000:3.0:1746147183.919758:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a56b5880 x1830967463624064/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.919764:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5880 with x1830967463624064 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.919766:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b5880 00000100:00100000:2.0:1746147183.920358:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4312 00000100:00100000:2.0:1746147183.920367:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463623680:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147183.920796:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4313 00000100:00100000:0.0:1746147183.920803:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463624192:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147183.921627:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4314 00000100:00100000:1.0:1746147183.921636:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463623808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147183.922120:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4315 00000100:00100000:3.0:1746147183.922128:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463624064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147183.925279:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463623296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13839us (14030us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147183.925287:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4311 00002000:00100000:2.0:1746147183.925295:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009a80dc00 x1830967463623296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.925301:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80dc00 with x1830967463623296 ext(1048576->2097151) 00002000:00010000:2.0:1746147183.925305:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80dc00 00000100:00100000:2.0:1746147183.931503:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463624192:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10691us (11837us total) trans 0 rc 245760/245760 00000100:00100000:2.0:1746147183.931513:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4313 00002000:00100000:2.0:1746147183.931525:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3391487) req@ffff8800a56b7800 x1830967463624192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 245760/245760 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.931532:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7800 with x1830967463624192 ext(3145728->3391487) 00002000:00010000:2.0:1746147183.931537:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b7800 00000100:00100000:1.0:1746147183.933670:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463623808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12031us (14899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147183.933680:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4314 00002000:00100000:1.0:1746147183.933688:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a56b4a80 x1830967463623808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.933696:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4a80 with x1830967463623808 ext(3145728->4194303) 00002000:00010000:1.0:1746147183.933700:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4a80 00000100:00100000:2.0:1746147183.938694:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463623680:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18321us (19968us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147183.938703:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4312 00002000:00100000:2.0:1746147183.938714:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80c700 x1830967463623680/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.938722:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c700 with x1830967463623680 ext(2097152->3145727) 00002000:00010000:2.0:1746147183.938727:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c700 00000100:00100000:3.0:1746147183.938934:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463624064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16806us (19241us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147183.938961:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4315 00002000:00100000:3.0:1746147183.938966:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a56b5880 x1830967463624064/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.938972:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5880 with x1830967463624064 ext(2097152->3145727) 00002000:00010000:3.0:1746147183.938975:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b5880 00000100:00100000:0.0:1746147183.939106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.939172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.939271:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624576 00000100:00100000:1.0:1746147183.939278:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624576 00000100:00100000:1.0:1746147183.939305:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624448 00000100:00100000:1.0:1746147183.939306:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624448 00000100:00100000:1.0:1746147183.939318:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11415 00000100:00100000:1.0:1746147183.939324:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463624576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.939335:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.939349:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f5b000/0xb4b2209fbdac5eff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62e9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.939392:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466360320:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.939442:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.939486:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11416 00000100:00100000:3.0:1746147183.939492:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463624448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.939499:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.939506:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62e2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147183.939525:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466360448:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147183.939542:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.941420:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466360320:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.941441:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f5b000/0xb4b2209fbdac5eff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62e9 expref: 32 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.941451:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5b000/0xb4b2209fbdac5eff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62e9 expref: 32 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.941465:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5b000, rc 0) 00000100:00100000:3.0:1746147183.941598:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466360448:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147183.941613:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f06 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62e2 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.941631:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62e2 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.941645:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbc00, rc 0) 00000100:00100000:1.0:1746147183.941718:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463624576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2393us (2612us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147183.941724:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11415 00000100:00100000:3.0:1746147183.942122:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463624448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2629us (2948us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147183.942128:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11416 00000100:00100000:0.0:1746147183.947106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.947265:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624704 00000100:00100000:3.0:1746147183.947277:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624704 00000100:00100000:3.0:1746147183.947346:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11417 00000100:00100000:3.0:1746147183.947358:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463624704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147183.947377:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.947394:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62f0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.947417:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.947419:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147183.947428:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.947443:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147183.947452:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4ba200, rc 0) 00000100:00100000:3.0:1746147183.947503:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463624704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.947509:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11417 00000100:00100000:0.0:1746147183.949167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.949718:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463624832 00000100:00100000:1.0:1746147183.949726:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463624832 00000100:00100000:1.0:1746147183.949767:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11418 00000100:00100000:1.0:1746147183.949774:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28756:x1830967463624832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.949786:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.949798:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62f7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.949819:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.949825:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147183.949827:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147183.949829:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.949854:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.949864:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 13 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:1.0:1746147183.949873:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466360576:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147183.950271:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147183.956590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147183.956811:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625088 00000100:00100000:3.0:1746147183.956820:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625088 00002000:00100000:3.0:1746147183.956855:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4440064->4870143) req@ffff8800a5ba1f80 x1830967463625088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.956865:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1f80 with x1830967463625088 ext(4440064->4870143) 00010000:00010000:3.0:1746147183.956873:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.956885:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 14 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.956892:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba1f80 00000100:00100000:0.0:1746147183.958328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.958428:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466360576:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147183.958450:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.958463:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5a800, rc 0) 00000100:00100000:1.0:1746147183.958496:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28756:x1830967463624832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8723us (9335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.958504:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11418 00000100:00100000:3.0:1746147183.958641:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625216 00000100:00100000:3.0:1746147183.958645:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625216 00002000:00100000:3.0:1746147183.958667:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4440063) req@ffff8800a5ba2d80 x1830967463625216/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.958675:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2d80 with x1830967463625216 ext(4194304->4440063) 00010000:00010000:3.0:1746147183.958680:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.958690:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 15 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.958696:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba2d80 00000100:00100000:3.0:1746147183.958964:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1484 00000100:00100000:3.0:1746147183.958971:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463625088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147183.959627:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1485 00000100:00100000:1.0:1746147183.959634:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463625216:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147183.976537:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463625216:12345-192.168.203.36@tcp:4:cat.0 Request processed in 16895us (18203us total) trans 21474840579 rc 0/0 00000100:00100000:1.0:1746147183.976547:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1485 00002000:00100000:1.0:1746147183.976557:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4440063) req@ffff8800a5ba2d80 x1830967463625216/t21474840579(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/448 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147183.976565:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2d80 with x1830967463625216 ext(4194304->4440063) 00010000:00010000:1.0:1746147183.976573:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 18 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:1.0:1746147183.976586:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 18 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:1.0:1746147183.976591:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba2d80 00000100:00100000:3.0:1746147183.977454:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463625088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18481us (20910us total) trans 0 rc 430080/430080 00000100:00100000:3.0:1746147183.977462:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1484 00002000:00100000:3.0:1746147183.977467:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4440064->4870143) req@ffff8800a5ba1f80 x1830967463625088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:H/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147183.977474:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1f80 with x1830967463625088 ext(4440064->4870143) 00010000:00010000:3.0:1746147183.977479:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:3.0:1746147183.977488:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00002000:00010000:3.0:1746147183.977493:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba1f80 00000100:00100000:0.0:1746147183.980145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.980194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.980267:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625472 00000100:00100000:1.0:1746147183.980276:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625472 00000100:00100000:1.0:1746147183.980329:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11419 00000100:00100000:1.0:1746147183.980337:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463625472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.980352:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.980366:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5f1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6305 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.980410:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466360704:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.980473:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147183.980575:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625344 00000100:00100000:3.0:1746147183.980579:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625344 00000100:00100000:3.0:1746147183.980599:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10443 00000100:00100000:3.0:1746147183.980604:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28760:x1830967463625344:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147183.980615:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147183.980639:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac5f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e62fe expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.980677:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980687:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980696:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980710:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980715:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980720:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980798:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980807:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 331 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.980814:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 40 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.980820:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.980836:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 40 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.980844:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 40 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.980852:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466360832:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.980877:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 331 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.980888:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 331 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:3.0:1746147183.980894:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466360960:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.980906:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.982185:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466360704:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.982207:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5f1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6305 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.982216:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5f1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6305 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.982228:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55800, rc 0) 00000100:00100000:1.0:1746147183.982253:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463625472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1917us (2059us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147183.982259:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11419 00000100:00100000:3.0:1746147183.982884:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466360832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147183.982892:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466360960:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147183.982909:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147183.985027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.985055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.985093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.985109:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625856 00000100:00100000:0.0:1746147183.985109:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625984 00000100:00100000:2.0:1746147183.985115:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625856 00000100:00100000:0.0:1746147183.985115:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625984 00010000:00010000:2.0:1746147183.985137:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 332 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.985137:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:0.0:1746147183.985174:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5610 00000100:00100000:0.0:1746147183.985181:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463625984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147183.985193:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147183.985208:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.985217:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5611 00010000:00010000:0.0:1746147183.985217:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.985222:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+332:1956:x1830967463625856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.985229:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.985233:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 332 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.985234:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092904e00/0xb4b2209fbdac5e96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4440063) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6287 expref: 16 pid: 8481 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.985240:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 332 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.985250:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.985252:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.985253:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59cc00/0xb4b2209fbdac5e81 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6279 expref: 332 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:0.0:1746147183.985257:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147183.985264:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.985269:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.985272:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.985278:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.985282:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.985286:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147183.985290:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147183.985303:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466361088:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147183.985315:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+331:1956:x1830967463625856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.985320:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5611 00000100:00100000:0.0:1746147183.985354:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147183.985436:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463625728 00000100:00100000:1.0:1746147183.985440:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463625728 00000100:00100000:1.0:1746147183.985461:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4126 00000100:00100000:1.0:1746147183.985467:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+41:7641:x1830967463625728:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147183.985599:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+42:7641:x1830967463625728:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 131us (575us total) trans 8589944185 rc 0/0 00000100:00100000:1.0:1746147183.985607:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4126 00000100:00100000:0.0:1746147183.987400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.987920:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466361088:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147183.987932:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147183.987984:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463625984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2802us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.987990:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5610 00000100:00100000:1.0:1746147183.988117:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626112 00000100:00100000:1.0:1746147183.988123:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626112 00000100:00100000:1.0:1746147183.988159:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11420 00000100:00100000:1.0:1746147183.988166:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28755:x1830967463626112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147183.988177:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.988197:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e630c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.988216:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.988218:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.988222:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.988233:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.988240:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55e00, rc 0) 00000100:00100000:1.0:1746147183.988257:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28755:x1830967463626112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 92us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.988262:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11420 00000100:00100000:0.0:1746147183.988369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147183.988420:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626240 00000100:00100000:2.0:1746147183.988423:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626240 00010000:00010000:2.0:1746147183.988438:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 42 pid: 16361 timeout: 670 lvb_type: 0 00000100:00100000:2.0:1746147183.988453:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5612 00000100:00100000:2.0:1746147183.988458:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+42:1959:x1830967463626240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147183.988465:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147183.988469:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 42 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.988478:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 42 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.988491:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d59d600/0xb4b2209fbdac5eb2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e629c expref: 42 pid: 16361 timeout: 670 lvb_type: 0 00010000:00010000:2.0:1746147183.988501:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147183.988505:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.988512:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.988517:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147183.988543:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147183.988565:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147183.988565:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+41:1959:x1830967463626240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.988570:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5612 00010000:00010000:3.0:1746147183.988572:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147183.988600:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147183.988603:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147183.988615:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988630:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988638:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988643:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988651:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988655:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4bbc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.988658:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988663:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988670:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147183.988673:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.988675:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988678:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac5f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988688:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988692:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988696:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988699:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4fa8000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147183.988701:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988706:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988714:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f137700) 00010000:00010000:3.0:1746147183.988716:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147183.988717:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988721:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac5f30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147183.988744:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac5f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.988753:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147183.988757:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147183.988759:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147183.988761:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fa9400, rc 0) 00000100:00100000:3.0:1746147183.988782:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+21:28760:x1830967463625344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8177us (8644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147183.988788:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10443 00000100:00100000:0.0:1746147183.994077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.994111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.994126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.994144:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626624 00000100:00100000:0.0:1746147183.994156:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626624 00000100:00100000:0.0:1746147183.994187:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626496 00000100:00100000:0.0:1746147183.994189:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626496 00000100:00100000:2.0:1746147183.994197:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626752 00000100:00100000:2.0:1746147183.994201:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626752 00000100:00100000:0.0:1746147183.994203:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11421 00000100:00100000:0.0:1746147183.994210:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463626624:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147183.994222:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11422 00010000:00010000:0.0:1746147183.994224:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147183.994226:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463626496:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147183.994236:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147183.994237:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e631a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.994245:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6313 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147183.994256:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.994256:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.994257:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147183.994257:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147183.994263:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.994263:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147183.994275:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.994276:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147183.994284:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904a00, rc 0) 00010000:00010000:0.0:1746147183.994284:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370a00, rc 0) 00000100:00100000:1.0:1746147183.994339:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11423 00000100:00100000:1.0:1746147183.994345:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463626752:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.994352:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.994358:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6321 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147183.994370:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.994371:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147183.994375:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.994382:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.994388:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55000, rc 0) 00000100:00100000:2.0:1746147183.994801:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463626496:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 572us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147183.994803:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463626752:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 456us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147183.994807:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11422 00000100:00100000:1.0:1746147183.994811:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11423 00000100:00100000:3.0:1746147183.994962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147183.994974:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463626624:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 763us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147183.994979:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11421 00000100:00100000:3.0:1746147183.995013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147183.995364:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463626880 00000100:00100000:1.0:1746147183.995368:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463626880 00000100:00100000:1.0:1746147183.995387:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11424 00000100:00100000:1.0:1746147183.995392:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463626880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147183.995398:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147183.995405:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac5f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6328 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147183.995436:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361216:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147183.995478:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147183.995678:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627008 00000100:00100000:2.0:1746147183.995681:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627008 00002000:00100000:2.0:1746147183.995703:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e135500 x1830967463627008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1746147194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147183.995711:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135500 with x1830967463627008 ext(2097152->3145727) 00002000:00010000:2.0:1746147183.995714:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135500 00000100:00100000:2.0:1746147183.995738:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4316 00000100:00100000:2.0:1746147183.995744:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463627008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147183.997671:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361216:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147183.997691:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac5f5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6328 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.997706:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac5f5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6328 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147183.997713:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54e00, rc 0) 00000100:00100000:1.0:1746147183.997733:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463626880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2341us (2720us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147183.997739:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11424 00000100:00100000:2.0:1746147184.007863:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463627008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12111us (12893us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.007877:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4316 00002000:00100000:2.0:1746147184.007889:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e135500 x1830967463627008/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:559/0 lens 488/440 e 0 to 0 dl 1746147194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.007902:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135500 with x1830967463627008 ext(2097152->3145727) 00002000:00010000:2.0:1746147184.007907:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135500 00000100:00100000:0.0:1746147184.008907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.011428:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627264 00000100:00100000:3.0:1746147184.011439:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627264 00000100:00100000:3.0:1746147184.011857:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10444 00000100:00100000:3.0:1746147184.011868:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+21:28760:x1830967463627264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147184.011888:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.011906:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39800/0xb4b2209fbdac5f61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e632f expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.013786:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.013802:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.013807:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.013834:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.013844:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 22 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.013855:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466361344:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.014587:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.019810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.021484:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466361344:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.021507:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147184.021716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.021786:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627520 00000100:00100000:2.0:1746147184.021792:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627520 00010000:00010000:2.0:1746147184.021817:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.021840:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5613 00000100:00100000:2.0:1746147184.021846:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:1959:x1830967463627520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.021857:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.021863:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.021872:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.021889:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac5f37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62fe expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.021905:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147184.021908:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.021915:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.021921:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.021933:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.021991:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:1959:x1830967463627520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.021997:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5613 00010000:00010000:3.0:1746147184.022075:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.022081:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147184.022095:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:3.0:1746147184.022196:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39800/0xb4b2209fbdac5f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.022211:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.022216:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147184.022219:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147184.022220:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a39e00, rc 0) 00000100:00100000:3.0:1746147184.022242:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463627264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10377us (13340us total) trans 8589944186 rc 0/0 00000100:00100000:3.0:1746147184.022248:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10444 00000100:00100000:1.0:1746147184.022506:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627392 00000100:00100000:1.0:1746147184.022511:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627392 00000100:00100000:1.0:1746147184.022600:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11425 00000100:00100000:1.0:1746147184.022607:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28756:x1830967463627392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.022618:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.022638:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6336 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.022658:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.022665:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147184.022666:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147184.022669:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.022690:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.022704:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 16 pid: 8481 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.022713:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361472:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.022772:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00080000:1.0:1746147184.022784:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147184.025927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.026021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.026269:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361472:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.026290:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.026302:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54800, rc 0) 00000100:00100000:1.0:1746147184.026335:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28756:x1830967463627392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3728us (6530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.026342:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11425 00000100:00100000:2.0:1746147184.026513:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627648 00000100:00100000:2.0:1746147184.026519:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627648 00002000:00100000:2.0:1746147184.026547:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3391488->4194303) req@ffff880132e11c00 x1830967463627648/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.026556:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11c00 with x1830967463627648 ext(3391488->4194303) 00010000:00010000:2.0:1746147184.026562:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 17 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.026572:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 17 pid: 8481 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.026577:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132e11c00 00000100:00100000:2.0:1746147184.026591:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1486 00000100:00100000:2.0:1746147184.026597:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463627648:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147184.027308:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627776 00000100:00100000:3.0:1746147184.027312:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627776 00000100:00100000:3.0:1746147184.027334:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10445 00000100:00100000:3.0:1746147184.027339:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463627776:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147184.027350:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.027363:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e69a00/0xb4b2209fbdac5f7d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e633d expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.027416:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.027426:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.027431:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.027453:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.027462:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.027470:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466361600:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.027510:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.035437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.035777:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466361600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.035800:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147184.035908:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463627904 00000100:00100000:2.0:1746147184.035915:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463627904 00010000:00010000:2.0:1746147184.035980:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 24 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.036012:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5614 00000100:00100000:2.0:1746147184.036022:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:1957:x1830967463627904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.036036:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.036042:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 24 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.036051:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 24 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.036070:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a39e00/0xb4b2209fbdac5f68 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e632f expref: 24 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.036088:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147184.036092:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.036101:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.036107:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147184.036125:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.036200:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:1957:x1830967463627904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 170us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.036207:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5614 00010000:00010000:3.0:1746147184.036426:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.036432:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147184.036463:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00000004:00200000:3.0:1746147184.036467:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147184.036478:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.036503:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e69a00/0xb4b2209fbdac5f7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.036517:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.036522:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147184.036524:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147184.036526:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e68c00, rc 0) 00000100:00100000:3.0:1746147184.036556:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463627776:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9216us (10535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.036562:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10445 00000100:00100000:3.0:1746147184.041525:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463627648:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14918us (15593us total) trans 17179873176 rc 0/0 00000100:00100000:3.0:1746147184.041537:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1486 00002000:00100000:3.0:1746147184.041547:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3391488->4194303) req@ffff880132e11c00 x1830967463627648/t17179873176(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.041555:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11c00 with x1830967463627648 ext(3391488->4194303) 00010000:00010000:3.0:1746147184.041564:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.041576:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.041582:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132e11c00 00000100:00100000:0.0:1746147184.041664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.041955:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463628032 00000100:00100000:2.0:1746147184.041962:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463628032 00000100:00100000:2.0:1746147184.041989:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11426 00000100:00100000:2.0:1746147184.041994:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463628032:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147184.042008:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.042018:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092904600/0xb4b2209fbdac5f8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6344 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.042052:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361728:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147184.042892:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.044143:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466361728:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147184.044162:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092904600/0xb4b2209fbdac5f8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6344 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.044172:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092904600/0xb4b2209fbdac5f8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6344 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.044183:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904600, rc 0) 00000100:00100000:2.0:1746147184.044209:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463628032:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2214us (2545us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.044214:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11426 00000100:00100000:0.0:1746147184.047291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.047362:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463628160 00000100:00100000:2.0:1746147184.047373:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463628160 00010000:00010000:2.0:1746147184.047408:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.047452:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5615 00000100:00100000:2.0:1746147184.047461:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463628160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.047486:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.047510:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.047522:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.047544:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac5e8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6280 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.047557:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.047559:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.047565:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.047573:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.047607:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.047631:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466361856:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.047744:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.048054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.048184:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463628416 00000100:00100000:3.0:1746147184.048188:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463628416 00000100:00100000:3.0:1746147184.048212:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10446 00000100:00100000:3.0:1746147184.048218:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463628416:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147184.048232:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.048245:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673ac00/0xb4b2209fbdac5f92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e634b expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.048309:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048324:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048332:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048341:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048346:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048351:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048356:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013673b600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147184.048359:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048364:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048371:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147184.048374:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147184.048377:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048381:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673b600/0xb4b2209fbdac5f99 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147184.048417:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673ac00/0xb4b2209fbdac5f92 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e634b expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.048428:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673ac00/0xb4b2209fbdac5f92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e634b expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.048437:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673ac00, rc 0) 00000100:00100000:3.0:1746147184.048469:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463628416:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 250us (415us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.048475:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10446 00000100:00100000:2.0:1746147184.053041:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466361856:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.053060:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.053111:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463628160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5647us (5823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.053120:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5615 00000100:00100000:0.0:1746147184.062900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.062969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.063006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.063033:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463628928 00000100:00100000:1.0:1746147184.063043:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463628928 00002000:00100000:1.0:1746147184.063080:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e682d80 x1830967463628928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147184.063088:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463629440 00002000:00100000:1.0:1746147184.063089:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682d80 with x1830967463628928 ext(2097152->3145727) 00000100:00100000:0.0:1746147184.063090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.063092:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463629440 00002000:00010000:1.0:1746147184.063094:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682d80 00000100:00080000:1.0:1746147184.063114:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147184.063120:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463629184 00002000:00100000:3.0:1746147184.063121:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e682a00 x1830967463629440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147184.063122:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463629184 00002000:00100000:3.0:1746147184.063128:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682a00 with x1830967463629440 ext(3145728->4194303) 00002000:00100000:1.0:1746147184.063130:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e680000 x1830967463629184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746147184.063131:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682a00 00002000:00100000:1.0:1746147184.063140:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680000 with x1830967463629184 ext(3145728->4194303) 00002000:00010000:1.0:1746147184.063142:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680000 00000100:00100000:2.0:1746147184.064436:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463628672 00000100:00100000:2.0:1746147184.064443:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463628672 00000100:00100000:2.0:1746147184.064479:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4127 00000100:00100000:2.0:1746147184.064486:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+22:28760:x1830967463628672:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147184.064669:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+23:28760:x1830967463628672:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 182us (1775us total) trans 8589944187 rc 0/0 00000100:00100000:2.0:1746147184.064675:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4127 00000100:00100000:0.0:1746147184.065232:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4317 00000100:00100000:0.0:1746147184.065240:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463628928:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.067186:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4318 00000100:00100000:2.0:1746147184.067197:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463629440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.067728:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4319 00000100:00100000:3.0:1746147184.067735:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463629184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.086120:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463628928:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20873us (23142us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.086130:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4317 00002000:00100000:2.0:1746147184.086141:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e682d80 x1830967463628928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.086149:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682d80 with x1830967463628928 ext(2097152->3145727) 00002000:00010000:2.0:1746147184.086154:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682d80 00000100:00100000:0.0:1746147184.087428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.087488:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463629696 00000100:00100000:1.0:1746147184.087496:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463629696 00000100:00100000:1.0:1746147184.087559:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10447 00000100:00100000:1.0:1746147184.087568:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+41:28763:x1830967463629696:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147184.087587:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.087600:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac5fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6352 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746147184.087640:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147184.087693:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147184.087704:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.087710:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147184.087734:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 22 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.087743:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 22 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.087753:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466361984:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.087825:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.090898:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463629440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23696us (27885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.090908:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4318 00002000:00100000:2.0:1746147184.090917:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e682a00 x1830967463629440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.090926:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682a00 with x1830967463629440 ext(3145728->4194303) 00002000:00010000:2.0:1746147184.090930:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682a00 00000100:00100000:1.0:1746147184.096039:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466361984:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.096041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147184.096055:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147184.096804:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463629824 00000100:00100000:2.0:1746147184.096817:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463629824 00010000:00010000:2.0:1746147184.096846:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.096871:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5616 00000100:00100000:2.0:1746147184.096878:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:1956:x1830967463629824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.096889:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.096895:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.096904:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.096921:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e68c00/0xb4b2209fbdac5f84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e633d expref: 23 pid: 16361 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.096934:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147184.096957:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147184.096966:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147184.096972:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147184.096992:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.097028:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:1956:x1830967463629824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 151us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.097038:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5616 00010000:00010000:1.0:1746147184.097327:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147184.098028:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147184.098043:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:1.0:1746147184.098138:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac5fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 44 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.098156:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 43 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.098162:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147184.098164:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147184.098166:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54600, rc 0) 00000100:00100000:3.0:1746147184.098368:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463629184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30631us (35276us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.098376:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4319 00002000:00100000:3.0:1746147184.098384:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e680000 x1830967463629184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.098392:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680000 with x1830967463629184 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.098396:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e680000 00000100:00100000:1.0:1746147184.098429:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+43:28763:x1830967463629696:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10863us (11005us total) trans 8589944188 rc 0/0 00000100:00100000:1.0:1746147184.098434:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10447 00000100:00100000:0.0:1746147184.108352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.108427:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630080 00000100:00100000:3.0:1746147184.108436:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630080 00002000:00100000:3.0:1746147184.108478:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009e680380 x1830967463630080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.108487:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967463630080 ext(4194304->4870143) 00002000:00010000:3.0:1746147184.108491:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680380 00000100:00100000:3.0:1746147184.108852:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4320 00000100:00100000:3.0:1746147184.108861:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463630080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.121818:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463630080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12949us (13463us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746147184.121830:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4320 00002000:00100000:3.0:1746147184.121842:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009e680380 x1830967463630080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.121850:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967463630080 ext(4194304->4870143) 00002000:00010000:3.0:1746147184.121854:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680380 00000100:00100000:0.0:1746147184.130090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.130135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.131093:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630208 00000100:00100000:1.0:1746147184.131103:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630208 00000100:00100000:1.0:1746147184.131140:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630336 00000100:00100000:1.0:1746147184.131142:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630336 00000100:00100000:1.0:1746147184.132615:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11427 00000100:00100000:1.0:1746147184.132632:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28759:x1830967463630208:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147184.132648:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.132662:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6359 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.132703:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11428 00000100:00100000:2.0:1746147184.132709:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463630336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.132716:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.132723:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6360 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.132738:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.132740:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.132746:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.132757:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.132766:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da3d200, rc 0) 00000100:00100000:2.0:1746147184.132806:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463630336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 97us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.132812:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11428 00010000:00010000:1.0:1746147184.133081:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.133090:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.133095:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.133100:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.133101:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.133104:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2711552->3145727] (req 2711552->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.133130:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.133140:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 15 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.133150:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362112:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.133205:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.133212:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 12 pid: 8481 timeout: 671 lvb_type: 1 00000100:00100000:1.0:1746147184.133220:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362240:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.133243:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.133250:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.133256:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362368:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.133268:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.136096:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362368:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.137451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.137486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.137577:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630464 00000100:00100000:3.0:1746147184.137589:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630464 00010000:00010000:3.0:1746147184.137636:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.137662:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.137667:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630592 00000100:00100000:3.0:1746147184.137669:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630592 00000100:00100000:1.0:1746147184.137671:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466362240:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.137680:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 13 pid: 8481 timeout: 671 lvb_type: 1 00000100:00100000:3.0:1746147184.137698:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5617 00010000:00010000:1.0:1746147184.137702:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2711552->3145727] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.137704:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463630464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.137718:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147184.137719:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55800, rc 0) 00010000:00010000:3.0:1746147184.137737:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.137746:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.137763:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28759:x1830967463630208:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5133us (7679us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147184.137766:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac5f3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4870144->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e630c expref: 16 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.137772:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11427 00010000:00010000:3.0:1746147184.137783:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.137824:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463630464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.137825:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5618 00000100:00100000:3.0:1746147184.137831:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5617 00000100:00100000:1.0:1746147184.137834:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463630592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147184.137844:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147184.137869:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 13 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:1.0:1746147184.137878:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 13 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:1.0:1746147184.137894:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac5f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6321 expref: 13 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:1.0:1746147184.137908:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147184.137925:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463630592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.137931:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5618 00000100:00100000:0.0:1746147184.142716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.142970:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630720 00000100:00100000:2.0:1746147184.142982:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630720 00010000:00010000:2.0:1746147184.143021:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.143060:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5619 00000100:00100000:2.0:1746147184.143067:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463630720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.143082:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.143100:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.143111:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.143129:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f5a800/0xb4b2209fbdac5f14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f7 expref: 28 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.143148:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.143150:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.143156:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.143163:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.143192:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.143202:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466362496:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.143281:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.145484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.145639:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463630976 00000100:00100000:3.0:1746147184.145647:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463630976 00002000:00100000:3.0:1746147184.145689:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a4671500 x1830967463630976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.145699:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967463630976 ext(1048576->2097151) 00002000:00010000:3.0:1746147184.145704:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:3.0:1746147184.146712:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4321 00000100:00100000:3.0:1746147184.146720:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463630976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.148975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.152004:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466362496:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.152029:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.152103:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463630720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9035us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.152116:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5619 00000100:00100000:3.0:1746147184.153266:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631232 00000100:00100000:3.0:1746147184.153275:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631232 00002000:00100000:3.0:1746147184.153308:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2711552->2715647) req@ffff8800a4673b80 x1830967463631232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.153323:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463631232 ext(2711552->2715647) 00002000:00010000:3.0:1746147184.153328:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:2.0:1746147184.155262:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4322 00000100:00100000:2.0:1746147184.155276:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463631232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.155474:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463631232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 201us (6506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147184.155481:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4322 00002000:00100000:2.0:1746147184.155488:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2711552->2715647) req@ffff8800a4673b80 x1830967463631232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.155497:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463631232 ext(2711552->2715647) 00002000:00010000:2.0:1746147184.155501:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673b80 00000100:00100000:1.0:1746147184.159368:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463630976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12636us (13880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.159381:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4321 00002000:00100000:1.0:1746147184.159392:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a4671500 x1830967463630976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.159401:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967463630976 ext(1048576->2097151) 00002000:00010000:1.0:1746147184.159407:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:2.0:1746147184.161875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.162043:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631360 00000100:00100000:1.0:1746147184.162051:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631360 00000100:00100000:1.0:1746147184.162150:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11429 00000100:00100000:1.0:1746147184.162158:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28759:x1830967463631360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147184.162174:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.162191:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6367 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.162220:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.162228:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.162233:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.162234:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.162237:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.162262:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.162274:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 18 pid: 21080 timeout: 671 lvb_type: 1 00000100:00100000:1.0:1746147184.162285:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466362624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.163243:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.163253:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.163261:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466362752:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.163291:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.166994:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466362624:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.166994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.167005:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466362752:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.167036:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147184.167044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147184.167051:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31d400, rc 0) 00000100:00100000:0.0:1746147184.167078:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631488 00000100:00100000:0.0:1746147184.167083:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631488 00000100:00100000:1.0:1746147184.167107:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:28759:x1830967463631360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4950us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.167115:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11429 00010000:00010000:0.0:1746147184.167208:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 671 lvb_type: 1 00000100:00100000:0.0:1746147184.167264:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631616 00000100:00100000:0.0:1746147184.167267:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631616 00010000:00010000:0.0:1746147184.167278:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:0.0:1746147184.167298:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5620 00000100:00100000:0.0:1746147184.167304:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463631488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147184.167315:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147184.167327:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5621 00000100:00100000:2.0:1746147184.167336:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463631616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147184.167342:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.167344:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147184.167352:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.167366:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.167376:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.167397:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54800/0xb4b2209fbdac5f76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6336 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.167416:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da3d200/0xb4b2209fbdac5fbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6360 expref: 19 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.167421:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.167424:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.167430:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.167437:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.167473:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147184.167488:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.167498:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466362880:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147184.167507:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463631488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 201us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147184.167516:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5620 00000100:00100000:2.0:1746147184.167542:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.174502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.174534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.174568:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466362880:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.174582:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631744 00000100:00100000:1.0:1746147184.174587:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463631872 00000100:00100000:3.0:1746147184.174588:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631744 00010000:00010000:2.0:1746147184.174590:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147184.174590:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463631872 00000100:00100000:1.0:1746147184.174638:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11430 00000100:00100000:1.0:1746147184.174644:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463631872:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147184.174651:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463631616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7315us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.174660:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5621 00010000:00010000:1.0:1746147184.174662:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.174678:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac5fca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6375 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.174724:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466363008:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147184.174769:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.175481:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11431 00000100:00100000:3.0:1746147184.175490:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463631744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.175498:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.175508:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac5fd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e636e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.175535:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363136:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.175902:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.176999:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466363008:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147184.177024:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac5fca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6375 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.177036:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac5fca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6375 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.177051:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31de00, rc 0) 00000100:00100000:1.0:1746147184.177078:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463631872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2433us (2543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147184.177085:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11430 00000100:00100000:3.0:1746147184.177673:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363136:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.177692:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac5fd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e636e expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.177702:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2ac00/0xb4b2209fbdac5fd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e636e expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.177835:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2ac00, rc 0) 00000100:00100000:3.0:1746147184.178044:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463631744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2554us (3551us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.178049:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11431 00000100:00100000:0.0:1746147184.180083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.180158:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632128 00000100:00100000:1.0:1746147184.180166:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632128 00002000:00100000:1.0:1746147184.180206:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2600960->2605055) req@ffff88008fc95f80 x1830967463632128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.180217:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95f80 with x1830967463632128 ext(2600960->2605055) 00002000:00010000:1.0:1746147184.180222:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95f80 00000100:00100000:1.0:1746147184.180295:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4323 00000100:00100000:1.0:1746147184.180304:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463632128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.180905:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463632128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 600us (827us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147184.180912:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4323 00002000:00100000:1.0:1746147184.180918:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2600960->2605055) req@ffff88008fc95f80 x1830967463632128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.180926:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95f80 with x1830967463632128 ext(2600960->2605055) 00002000:00010000:1.0:1746147184.180958:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95f80 00000100:00100000:0.0:1746147184.181166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.181543:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632256 00000100:00100000:3.0:1746147184.181549:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632256 00000100:00100000:3.0:1746147184.181587:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11432 00000100:00100000:3.0:1746147184.181593:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28767:x1830967463632256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.181604:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.181629:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e637c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.181656:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.181663:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.181665:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.181669:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.181696:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.181708:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 26 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.181720:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363264:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.181786:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.185216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.185548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.185716:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632512 00000100:00100000:0.0:1746147184.185724:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632512 00000100:00100000:0.0:1746147184.185777:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4128 00000100:00100000:0.0:1746147184.185784:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+331:28759:x1830967463632512:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147184.186492:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363264:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.186523:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.186543:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2aa00, rc 0) 00000100:00100000:3.0:1746147184.186587:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28767:x1830967463632256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4995us (5422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.186594:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11432 00000100:00100000:0.0:1746147184.187022:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+332:28759:x1830967463632512:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1237us (1815us total) trans 8589944189 rc 0/0 00000100:00080000:2.0:1746147184.187100:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147184.187171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.187337:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632768 00000100:00100000:3.0:1746147184.187342:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632768 00000100:00100000:3.0:1746147184.187369:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11433 00000100:00100000:3.0:1746147184.187375:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28763:x1830967463632768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147184.187386:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.187401:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6383 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.187421:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.187428:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.187430:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.187432:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.187457:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 31 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.187467:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 31 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.187483:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466363392:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.187524:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.187690:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632640 00000100:00100000:1.0:1746147184.187695:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632640 00002000:00100000:1.0:1746147184.187727:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2711552->3145727) req@ffff88009b6b8a80 x1830967463632640/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.187741:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8a80 with x1830967463632640 ext(2711552->3145727) 00010000:00010000:1.0:1746147184.187747:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 27 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.187761:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 27 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:0.0:1746147184.187764:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4128 00002000:00010000:1.0:1746147184.187766:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8a80 00000100:00100000:1.0:1746147184.187780:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1487 00000100:00100000:1.0:1746147184.187785:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463632640:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147184.192403:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466363392:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.192433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147184.192438:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.192455:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2a000, rc 0) 00000100:00100000:3.0:1746147184.192494:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28763:x1830967463632768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5118us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.192502:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11433 00000100:00100000:2.0:1746147184.192548:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463632896 00000100:00100000:2.0:1746147184.192555:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463632896 00002000:00100000:2.0:1746147184.192591:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2605055) req@ffff88008fc94e00 x1830967463632896/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.192647:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94e00 with x1830967463632896 ext(2097152->2605055) 00010000:00010000:2.0:1746147184.192654:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 32 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.192666:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 32 pid: 8478 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.192672:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc94e00 00000100:00100000:2.0:1746147184.192690:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1488 00000100:00100000:2.0:1746147184.192697:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463632896:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147184.194664:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463632640:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6870us (9107us total) trans 21474840580 rc 0/0 00000100:00100000:1.0:1746147184.194674:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1487 00002000:00100000:1.0:1746147184.194683:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2711552->3145727) req@ffff88009b6b8a80 x1830967463632640/t21474840580(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.194692:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8a80 with x1830967463632640 ext(2711552->3145727) 00010000:00010000:1.0:1746147184.194700:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.194712:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00002000:00010000:1.0:1746147184.194718:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8a80 00000100:00100000:2.0:1746147184.198318:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463632896:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5611us (5876us total) trans 17179873177 rc 0/0 00000100:00100000:2.0:1746147184.198330:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1488 00002000:00100000:2.0:1746147184.198339:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2605055) req@ffff88008fc94e00 x1830967463632896/t17179873177(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.198348:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94e00 with x1830967463632896 ext(2097152->2605055) 00010000:00010000:2.0:1746147184.198358:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.198900:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.198908:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc94e00 00000100:00100000:0.0:1746147184.201421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.201514:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463633024 00000100:00100000:2.0:1746147184.201522:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463633024 00010000:00010000:2.0:1746147184.201554:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.201710:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5622 00000100:00100000:2.0:1746147184.201718:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463633024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.201732:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.201752:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.201762:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.201784:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac5fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6367 expref: 34 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.201858:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.201860:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.201867:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.201875:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.201981:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.201993:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466363520:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.202077:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.202800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.202855:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463633152 00000100:00100000:1.0:1746147184.202860:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463633152 00010000:00010000:1.0:1746147184.202878:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.202908:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5623 00000100:00100000:1.0:1746147184.202914:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463633152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147184.202922:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147184.202964:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.202974:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.202988:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac5fb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6359 expref: 29 pid: 8478 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.203004:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.203005:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.203010:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.203017:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.203040:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.203049:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466363648:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147184.203986:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.204012:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466363648:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147184.204024:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147184.204045:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463633152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1132us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.204052:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5623 00000100:00100000:2.0:1746147184.205793:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466363520:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.205808:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.205840:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463633024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4122us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.205849:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5622 00000100:00100000:0.0:1746147184.206018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.206077:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463633408 00000100:00100000:3.0:1746147184.206084:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463633408 00002000:00100000:3.0:1746147184.206117:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2580480->2584575) req@ffff88008fc96a00 x1830967463633408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.206130:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96a00 with x1830967463633408 ext(2580480->2584575) 00002000:00010000:3.0:1746147184.206134:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96a00 00000100:00100000:3.0:1746147184.206185:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4324 00000100:00100000:3.0:1746147184.206192:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463633408:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147184.206493:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463633408:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 301us (475us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.206499:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4324 00002000:00100000:3.0:1746147184.206503:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2580480->2584575) req@ffff88008fc96a00 x1830967463633408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.206516:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96a00 with x1830967463633408 ext(2580480->2584575) 00002000:00010000:3.0:1746147184.206518:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96a00 00000100:00100000:0.0:1746147184.212405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.212576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.212879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.213035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.213109:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463633664 00000100:00100000:3.0:1746147184.213116:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463633664 00002000:00100000:3.0:1746147184.213157:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc94380 x1830967463633664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.213167:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94380 with x1830967463633664 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.213172:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc94380 00000100:00100000:3.0:1746147184.213195:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463633920 00000100:00100000:3.0:1746147184.213197:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463633920 00000100:00100000:1.0:1746147184.213311:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463634176 00000100:00100000:1.0:1746147184.213315:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463634176 00000100:00100000:1.0:1746147184.213325:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463634432 00000100:00100000:1.0:1746147184.213327:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463634432 00002000:00100000:1.0:1746147184.213343:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3149824->4194303) req@ffff88008fc96d80 x1830967463634432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.213350:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463634432 ext(3149824->4194303) 00002000:00010000:1.0:1746147184.213353:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96d80 00000100:00100000:1.0:1746147184.213365:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4325 00000100:00100000:1.0:1746147184.213371:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463633664:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147184.213387:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4326 00000100:00100000:2.0:1746147184.213397:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463634432:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:3.0:1746147184.213998:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fc96300 x1830967463633920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.214008:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96300 with x1830967463633920 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.214011:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96300 00000100:00100000:3.0:1746147184.214026:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4327 00000100:00100000:3.0:1746147184.214032:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463633920:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:1.0:1746147184.214657:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3149823) req@ffff88008fc97800 x1830967463634176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 504/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.214665:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463634176 ext(2097152->3149823) 00002000:00010000:1.0:1746147184.214668:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc97800 00000100:00100000:1.0:1746147184.214693:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4328 00000100:00100000:1.0:1746147184.214698:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463634176:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147184.223502:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463633664:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10120us (11095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.223520:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4325 00002000:00100000:1.0:1746147184.223532:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc94380 x1830967463633664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.223541:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94380 with x1830967463633664 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.223548:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc94380 00000100:00100000:2.0:1746147184.229588:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463634432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16183us (16543us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746147184.229601:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4326 00002000:00100000:2.0:1746147184.229612:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3149824->4194303) req@ffff88008fc96d80 x1830967463634432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.229633:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463634432 ext(3149824->4194303) 00002000:00010000:2.0:1746147184.229640:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc96d80 00000100:00100000:3.0:1746147184.231918:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463633920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17878us (19334us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.231929:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4327 00002000:00100000:3.0:1746147184.231962:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fc96300 x1830967463633920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.231972:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96300 with x1830967463633920 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.231977:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96300 00000100:00100000:1.0:1746147184.234209:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463634176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 19502us (21322us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.234219:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4328 00002000:00100000:1.0:1746147184.234228:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3149823) req@ffff88008fc97800 x1830967463634176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 504/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.234237:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463634176 ext(2097152->3149823) 00002000:00010000:1.0:1746147184.234242:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc97800 00000100:00100000:2.0:1746147184.255765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.255932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.256014:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463634560 00000100:00100000:3.0:1746147184.256023:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463634560 00000100:00100000:1.0:1746147184.256058:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463634816 00000100:00100000:1.0:1746147184.256062:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463634816 00000100:00100000:3.0:1746147184.256074:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11434 00000100:00100000:3.0:1746147184.256081:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463634560:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147184.256085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:1.0:1746147184.256092:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009b6bbb80 x1830967463634816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147184.256095:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746147184.256100:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967463634816 ext(4194304->4870143) 00002000:00010000:1.0:1746147184.256106:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:2.0:1746147184.256108:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463634944 00000100:00100000:2.0:1746147184.256111:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463634944 00010000:00010000:3.0:1746147184.256112:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e638a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.256119:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4329 00000100:00100000:1.0:1746147184.256123:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463634816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.256126:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11435 00000100:00100000:2.0:1746147184.256130:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463634944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.256133:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.256135:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.256136:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.256143:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.256146:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac5fed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6391 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.256157:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.256167:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d3be00, rc 0) 00000100:00100000:2.0:1746147184.256183:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466363776:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.256208:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463634560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 128us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.256214:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11434 00000100:00100000:2.0:1746147184.256242:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746147184.259515:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147183 -> 1746147184 00002000:00010000:3.0:1746147184.259523:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147183 -> 1746147184 00002000:00010000:3.0:1746147184.259525:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147183 -> 1746147184 00000100:00100000:3.0:1746147184.259549:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466363776:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.259581:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac5fed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6391 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.259598:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac5fed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6391 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.259631:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20600, rc 0) 00000100:00100000:3.0:1746147184.259674:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463634944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3542us (3587us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.259682:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11435 00000100:00100000:1.0:1746147184.262211:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463634816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6077us (6269us total) trans 0 rc 675840/675840 00000100:00100000:1.0:1746147184.262223:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4329 00002000:00100000:1.0:1746147184.262235:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff88009b6bbb80 x1830967463634816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.262244:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967463634816 ext(4194304->4870143) 00002000:00010000:1.0:1746147184.262250:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:0.0:1746147184.268376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.268427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.268487:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635328 00000100:00100000:3.0:1746147184.268496:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635328 00000100:00100000:3.0:1746147184.268538:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11436 00000100:00100000:3.0:1746147184.268544:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28763:x1830967463635328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147184.268562:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.268580:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6398 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.268610:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.268627:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.268633:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.268635:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.268638:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.269575:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.269595:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 28 pid: 8481 timeout: 671 lvb_type: 1 00000100:00100000:3.0:1746147184.269608:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363904:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.269726:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.269734:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.269743:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364032:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.269763:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.269873:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635200 00000100:00100000:1.0:1746147184.269879:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635200 00002000:00100000:1.0:1746147184.269958:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc96680 x1830967463635200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.269969:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96680 with x1830967463635200 ext(2097152->3145727) 00010000:00010000:1.0:1746147184.269976:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:1.0:1746147184.269986:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00002000:00010000:1.0:1746147184.269992:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc96680 00000100:00100000:1.0:1746147184.270019:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1489 00000100:00100000:1.0:1746147184.270026:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463635200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.272686:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466363904:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.278739:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364032:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.278785:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 17 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.278803:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d3ae00, rc 0) 00000100:00100000:3.0:1746147184.278874:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28763:x1830967463635328:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10328us (10444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.278886:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11436 00000100:00100000:2.0:1746147184.279592:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463635200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9565us (11225us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.279600:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1489 00002000:00100000:2.0:1746147184.279608:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc96680 x1830967463635200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.279616:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96680 with x1830967463635200 ext(2097152->3145727) 00010000:00010000:2.0:1746147184.279633:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.279643:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00002000:00010000:2.0:1746147184.279648:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc96680 00000100:00100000:0.0:1746147184.280484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.280738:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635456 00000100:00100000:2.0:1746147184.280745:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635456 00010000:00010000:2.0:1746147184.280769:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.280797:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5624 00000100:00100000:2.0:1746147184.280802:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463635456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.280813:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.280829:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.280838:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.280859:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2aa00/0xb4b2209fbdac5fd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e637c expref: 17 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.280882:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.280910:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463635456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.280916:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5624 00000100:00100000:0.0:1746147184.285912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.287317:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635584 00000100:00100000:3.0:1746147184.287327:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635584 00000100:00100000:3.0:1746147184.287367:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11437 00000100:00100000:3.0:1746147184.287374:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:28773:x1830967463635584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.287391:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.287409:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e639f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.287437:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.287444:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.287446:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.287449:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.287475:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.287484:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 18 pid: 8481 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.287494:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466364160:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.287566:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.288311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.288891:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635712 00000100:00100000:1.0:1746147184.288897:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635712 00010000:00010000:1.0:1746147184.288918:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00000100:00100000:3.0:1746147184.289293:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466364160:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.289323:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.289334:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5349e00, rc 0) 00000100:00100000:3.0:1746147184.289364:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28773:x1830967463635584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1990us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.289371:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11437 00000100:00100000:2.0:1746147184.289732:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5625 00000100:00100000:2.0:1746147184.289740:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463635712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.289752:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.289773:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.289783:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.289803:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d3be00/0xb4b2209fbdac5fe6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e638a expref: 29 pid: 8481 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.290495:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.290498:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.290507:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.290516:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.290543:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.290554:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466364288:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.290639:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.291846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.292154:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463635840 00000100:00100000:2.0:1746147184.292160:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463635840 00002000:00100000:2.0:1746147184.292198:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2580480->3145727) req@ffff88008fc95500 x1830967463635840/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.292206:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95500 with x1830967463635840 ext(2580480->3145727) 00010000:00010000:2.0:1746147184.292215:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.292227:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 19 pid: 8481 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.292232:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc95500 00000100:00100000:2.0:1746147184.292260:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1490 00000100:00100000:2.0:1746147184.292267:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463635840:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147184.293074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.293131:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466364288:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147184.293199:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.293229:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463635712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3489us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.293237:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5625 00000100:00100000:3.0:1746147184.293269:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636096 00000100:00100000:3.0:1746147184.293272:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636096 00002000:00100000:3.0:1746147184.293290:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3194880->3198975) req@ffff880132e10000 x1830967463636096/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.293302:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10000 with x1830967463636096 ext(3194880->3198975) 00002000:00010000:3.0:1746147184.293305:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10000 00000100:00100000:3.0:1746147184.293318:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4330 00000100:00100000:3.0:1746147184.293323:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463636096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.293467:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463636096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 143us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.293472:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4330 00002000:00100000:3.0:1746147184.293477:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3194880->3198975) req@ffff880132e10000 x1830967463636096/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.293488:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10000 with x1830967463636096 ext(3194880->3198975) 00002000:00010000:3.0:1746147184.293490:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10000 00000100:00100000:3.0:1746147184.300271:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463635840:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7993us (8418us total) trans 17179873178 rc 0/0 00000100:00100000:3.0:1746147184.300285:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1490 00002000:00100000:3.0:1746147184.300296:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2580480->3145727) req@ffff88008fc95500 x1830967463635840/t17179873178(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.300304:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95500 with x1830967463635840 ext(2580480->3145727) 00010000:00010000:3.0:1746147184.300314:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.300330:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.300336:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc95500 00000100:00100000:1.0:1746147184.308034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.308070:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636224 00000100:00100000:3.0:1746147184.308078:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636224 00010000:00010000:3.0:1746147184.308114:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.308155:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5626 00000100:00100000:3.0:1746147184.308163:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463636224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.308178:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.308202:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.308214:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.308237:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2a000/0xb4b2209fbdac5fdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6383 expref: 21 pid: 8481 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.308265:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.308267:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.308275:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.308283:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.308318:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.308330:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466364416:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.308403:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.308857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.308962:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636480 00000100:00100000:2.0:1746147184.308967:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636480 00000100:00100000:2.0:1746147184.309004:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10448 00000100:00100000:2.0:1746147184.309010:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+332:28776:x1830967463636480:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.309032:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.309047:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac6002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63a6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.309135:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147184.309153:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147184.309163:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147184.309172:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9064448 00010000:00010000:2.0:1746147184.309283:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac6002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 335 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.309310:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 334 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.309317:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147184.309323:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147184.309325:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20a00, rc 0) 00000100:00100000:2.0:1746147184.309354:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+334:28776:x1830967463636480:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 344us (498us total) trans 8589944190 rc 0/0 00000100:00100000:2.0:1746147184.309360:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10448 00000100:00100000:3.0:1746147184.310561:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466364416:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147184.310583:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.310605:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463636224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2443us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.310612:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5626 00000100:00100000:0.0:1746147184.316430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.316588:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636736 00000100:00100000:3.0:1746147184.316604:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636736 00002000:00100000:3.0:1746147184.316680:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880132e13800 x1830967463636736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.316697:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967463636736 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.316702:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13800 00000100:00100000:3.0:1746147184.316736:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4331 00000100:00100000:3.0:1746147184.316743:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463636736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.330255:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463636736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13501us (13833us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.330271:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4331 00002000:00100000:3.0:1746147184.330283:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880132e13800 x1830967463636736/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.330292:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13800 with x1830967463636736 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.330299:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13800 00000100:00100000:0.0:1746147184.332933:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.333070:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636864 00000100:00100000:3.0:1746147184.333077:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636864 00000100:00100000:3.0:1746147184.333329:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11438 00000100:00100000:3.0:1746147184.333340:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28773:x1830967463636864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.333384:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.333399:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63ad expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.333424:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.333436:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.333437:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.333440:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.333467:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.333476:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 15 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.333486:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364544:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.333599:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.335636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.335677:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364544:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.335708:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.335720:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5348600, rc 0) 00000100:00100000:2.0:1746147184.335744:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463636992 00000100:00100000:2.0:1746147184.335752:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463636992 00000100:00100000:3.0:1746147184.335765:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28773:x1830967463636864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2425us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.335771:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11438 00002000:00100000:2.0:1746147184.335833:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3198975) req@ffff88009e681880 x1830967463636992/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.335843:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681880 with x1830967463636992 ext(3145728->3198975) 00010000:00010000:2.0:1746147184.335851:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 16 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.335864:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 16 pid: 4445 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.335871:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e681880 00000100:00100000:2.0:1746147184.335901:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1491 00000100:00100000:2.0:1746147184.335908:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463636992:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147184.337844:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463636992:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1928us (2206us total) trans 21474840581 rc 0/0 00000100:00100000:2.0:1746147184.337853:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1491 00002000:00100000:2.0:1746147184.337862:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3198975) req@ffff88009e681880 x1830967463636992/t21474840581(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.337871:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681880 with x1830967463636992 ext(3145728->3198975) 00010000:00010000:2.0:1746147184.337881:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.337893:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.337899:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e681880 00000100:00100000:0.0:1746147184.340978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.341077:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463637120 00000100:00100000:3.0:1746147184.341085:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463637120 00010000:00010000:3.0:1746147184.341119:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.341164:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5627 00000100:00100000:3.0:1746147184.341172:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463637120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.341185:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147184.341205:0:7121:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147183 -> 1746147184 00002000:00010000:3.0:1746147184.341208:0:7121:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147183 -> 1746147184 00010000:00010000:3.0:1746147184.341213:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.341225:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.341248:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d3ae00/0xb4b2209fbdac5ff4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6398 expref: 18 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.341281:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.341283:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.341290:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.341299:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.341331:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.341348:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466364672:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.342218:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.344323:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466364672:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147184.344342:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.344391:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463637120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3218us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.344400:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5627 00000100:00100000:0.0:1746147184.349493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.349795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.350172:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463637376 00000100:00100000:2.0:1746147184.350181:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463637376 00002000:00100000:2.0:1746147184.350220:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e680700 x1830967463637376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.350230:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967463637376 ext(3145728->4194303) 00002000:00010000:2.0:1746147184.350235:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680700 00000100:00100000:2.0:1746147184.350259:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463637632 00000100:00100000:2.0:1746147184.350261:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463637632 00002000:00100000:2.0:1746147184.350274:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e683480 x1830967463637632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.350281:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967463637632 ext(3145728->4194303) 00002000:00010000:2.0:1746147184.350284:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e683480 00000100:00100000:2.0:1746147184.350294:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4332 00000100:00100000:2.0:1746147184.350302:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463637376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.350303:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4333 00000100:00100000:3.0:1746147184.350312:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463637632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.358988:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463637632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8666us (9181us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.359001:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4333 00002000:00100000:3.0:1746147184.359011:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e683480 x1830967463637632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.359022:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967463637632 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.359028:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e683480 00000100:00100000:2.0:1746147184.363456:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463637376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13143us (13962us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.363468:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4332 00002000:00100000:2.0:1746147184.363478:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e680700 x1830967463637376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.363487:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967463637376 ext(3145728->4194303) 00002000:00010000:2.0:1746147184.363494:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680700 00000100:00100000:0.0:1746147184.369255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.369320:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463637888 00000100:00100000:2.0:1746147184.369328:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463637888 00002000:00100000:2.0:1746147184.369376:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4671f80 x1830967463637888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.369393:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671f80 with x1830967463637888 ext(4194304->4870143) 00002000:00010000:2.0:1746147184.369399:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671f80 00000100:00100000:2.0:1746147184.370396:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4334 00000100:00100000:2.0:1746147184.370408:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463637888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.375039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.375107:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638016 00000100:00100000:3.0:1746147184.375115:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638016 00000100:00100000:3.0:1746147184.375163:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11439 00000100:00100000:3.0:1746147184.375170:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28776:x1830967463638016:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147184.375191:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.375209:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63b4 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375239:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375248:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.375255:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375260:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.375261:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.375264:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1069056->1695743] (req 1069056->1695743) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 32 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375292:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 32 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375303:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 32 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.375313:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364800:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.375404:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.375413:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 11 pid: 21080 timeout: 671 lvb_type: 1 00000100:00100000:3.0:1746147184.375422:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364928:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.375455:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.375463:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 16 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.375470:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466365056:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.375496:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.375859:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463637888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5453us (6611us total) trans 0 rc 675840/675840 00000100:00100000:2.0:1746147184.375869:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4334 00002000:00100000:2.0:1746147184.375878:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4870143) req@ffff8800a4671f80 x1830967463637888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.375887:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671f80 with x1830967463637888 ext(4194304->4870143) 00002000:00010000:2.0:1746147184.375891:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671f80 00000100:00100000:3.0:1746147184.376576:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364800:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.376588:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466364928:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.376599:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466365056:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.376638:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1069056->1695743] (req 1069056->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.376650:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b470600, rc 0) 00000100:00100000:3.0:1746147184.376686:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28776:x1830967463638016:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1516us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.376693:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11439 00000100:00100000:0.0:1746147184.378650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.378697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.378780:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638144 00000100:00100000:3.0:1746147184.378787:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638144 00010000:00010000:3.0:1746147184.378816:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 12 pid: 21080 timeout: 671 lvb_type: 1 00000100:00100000:3.0:1746147184.378852:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638272 00000100:00100000:3.0:1746147184.378854:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638272 00010000:00010000:3.0:1746147184.378863:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 17 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.378876:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5628 00000100:00100000:3.0:1746147184.378882:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463638144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.378894:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147184.378962:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5629 00000100:00100000:2.0:1746147184.378970:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463638272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.378979:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.379025:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 12 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.379025:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 17 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.379036:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 17 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.379074:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 12 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.379097:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092904000/0xb4b2209fbdac5ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62d4 expref: 17 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.379101:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095370a00/0xb4b2209fbdac5f45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e631a expref: 12 pid: 21080 timeout: 671 lvb_type: 1 00010000:00010000:3.0:1746147184.379372:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147184.379372:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.379411:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463638144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 528us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.379412:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463638272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 442us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.379418:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5628 00000100:00100000:2.0:1746147184.379421:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5629 00000100:00100000:2.0:1746147184.379714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.379729:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638400 00000100:00100000:0.0:1746147184.379732:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638400 00010000:00010000:0.0:1746147184.379745:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 30 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:0.0:1746147184.379772:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5630 00000100:00100000:0.0:1746147184.379778:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463638400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147184.379785:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147184.379794:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 30 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.379802:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 30 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.379815:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092905800/0xb4b2209fbdac5ef8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62db expref: 30 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.379833:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147184.379835:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147184.379841:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.379849:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.379880:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147184.379892:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466365184:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147184.379973:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.380377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.380423:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638528 00000100:00100000:3.0:1746147184.380426:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638528 00000100:00100000:3.0:1746147184.380444:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11440 00000100:00100000:3.0:1746147184.380450:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463638528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.380466:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.380476:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac6025 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63bb expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.380504:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466365312:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.380537:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.382022:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dded500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466365184:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.382040:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.382083:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463638400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2303us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.382091:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5630 00002000:00010000:3.0:1746147184.382180:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147183 -> 1746147184 00002000:00010000:3.0:1746147184.382184:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147183 -> 1746147184 00002000:00010000:3.0:1746147184.382186:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147183 -> 1746147184 00000100:00100000:3.0:1746147184.382201:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466365312:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.382233:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac6025 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63bb expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.382244:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e58800/0xb4b2209fbdac6025 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63bb expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.382253:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e58800, rc 0) 00000100:00100000:3.0:1746147184.382271:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463638528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1822us (1896us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.382276:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11440 00000100:00100000:1.0:1746147184.382388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.382460:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463638784 00000100:00100000:3.0:1746147184.382465:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463638784 00002000:00100000:3.0:1746147184.382491:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1069056->1073151) req@ffff88009ef7ce00 x1830967463638784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.382501:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ce00 with x1830967463638784 ext(1069056->1073151) 00002000:00010000:3.0:1746147184.382506:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7ce00 00000100:00100000:3.0:1746147184.382531:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4335 00000100:00100000:3.0:1746147184.382538:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463638784:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147184.382813:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463638784:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 274us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.382819:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4335 00002000:00100000:3.0:1746147184.382824:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1069056->1073151) req@ffff88009ef7ce00 x1830967463638784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.382830:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ce00 with x1830967463638784 ext(1069056->1073151) 00002000:00010000:3.0:1746147184.382833:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7ce00 00000100:00100000:0.0:1746147184.390547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.391006:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639040 00000100:00100000:3.0:1746147184.391014:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639040 00002000:00100000:3.0:1746147184.391060:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1691648->1695743) req@ffff88008ddeed80 x1830967463639040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.391071:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeed80 with x1830967463639040 ext(1691648->1695743) 00002000:00010000:3.0:1746147184.391076:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddeed80 00000100:00100000:3.0:1746147184.391096:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4336 00000100:00100000:3.0:1746147184.391104:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463639040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.391984:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463639040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 878us (1445us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.391992:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4336 00002000:00100000:3.0:1746147184.391999:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1691648->1695743) req@ffff88008ddeed80 x1830967463639040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.392006:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeed80 with x1830967463639040 ext(1691648->1695743) 00002000:00010000:3.0:1746147184.392011:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddeed80 00000100:00100000:0.0:1746147184.506242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.506292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.506339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.506437:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639296 00000100:00100000:1.0:1746147184.506445:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639296 00000100:00100000:2.0:1746147184.506458:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639168 00000100:00100000:2.0:1746147184.506465:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639168 00000100:00100000:1.0:1746147184.506485:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639424 00000100:00100000:1.0:1746147184.506487:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639424 00000100:00100000:1.0:1746147184.506505:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11441 00000100:00100000:1.0:1746147184.506511:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463639296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.506538:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.506555:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63c9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.506577:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.506579:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.506587:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.506603:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.506613:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55400, rc 0) 00000100:00100000:1.0:1746147184.506691:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463639296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 179us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.506808:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11442 00000100:00100000:1.0:1746147184.506816:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11441 00000100:00100000:2.0:1746147184.506819:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463639168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.506830:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.506840:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6033 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63c2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.506843:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11443 00000100:00100000:1.0:1746147184.506848:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463639424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.506856:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.506866:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63d0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.506877:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.506879:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.506882:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147184.506888:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466365440:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147184.506891:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 21 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.506898:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54000, rc 0) 00000100:00100000:1.0:1746147184.506917:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463639424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.506922:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11443 00000100:00100000:2.0:1746147184.506994:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.529042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.529253:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466365440:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147184.529287:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6033 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c2 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.529307:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6033 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c2 expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147184.529320:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639680 00010000:00010000:2.0:1746147184.529322:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20200, rc 0) 00000100:00100000:3.0:1746147184.529326:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639680 00002000:00100000:3.0:1746147184.529362:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008dded180 x1830967463639680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 504/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.529371:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dded180 with x1830967463639680 ext(1048576->2097151) 00002000:00010000:3.0:1746147184.529375:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dded180 00000100:00100000:2.0:1746147184.529382:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463639168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 22566us (23090us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.529388:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11442 00000100:00100000:3.0:1746147184.529391:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4337 00000100:00100000:3.0:1746147184.529397:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463639680:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.534067:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466365568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147184.534129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147184.534210:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466365568 00000100:00100000:2.0:1746147184.534216:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466365568 00000100:00100000:2.0:1746147184.534258:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1746147184.534264:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466365568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746147184.534289:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 445841408 pending 20447232 free 3839885312 avail 3837788160 00000100:00100000:2.0:1746147184.534318:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466365568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.534324:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1746147184.534342:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147184.534359:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840562 gen 2 00000004:00080000:2.0:1746147184.534364:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5e300, transno 21474840501 00000004:00080000:2.0:1746147184.534370:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecefb80, transno 21474840502 00000004:00080000:2.0:1746147184.534373:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecef800, transno 21474840503 00000004:00080000:2.0:1746147184.534375:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecedf80, transno 21474840504 00000004:00080000:2.0:1746147184.534377:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012eced500, transno 21474840505 00000004:00080000:2.0:1746147184.534379:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012eceea00, transno 21474840506 00000004:00080000:2.0:1746147184.534382:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecef100, transno 21474840507 00000004:00080000:2.0:1746147184.534385:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b52e3100, transno 21474840508 00000004:00080000:2.0:1746147184.534387:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ececa80, transno 21474840509 00000004:00080000:2.0:1746147184.534389:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5dd880, transno 21474840520 00000004:00080000:2.0:1746147184.534392:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80d500, transno 21474840521 00000004:00080000:2.0:1746147184.534394:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80d180, transno 21474840522 00000004:00080000:2.0:1746147184.534396:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448a80, transno 21474840523 00000004:00080000:2.0:1746147184.534398:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc9880, transno 21474840524 00000004:00080000:2.0:1746147184.534400:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80ce00, transno 21474840525 00000004:00080000:2.0:1746147184.534402:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcb100, transno 21474840526 00000004:00080000:2.0:1746147184.534404:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5ded80, transno 21474840527 00000004:00080000:2.0:1746147184.534406:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80df80, transno 21474840528 00000004:00080000:2.0:1746147184.534408:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80f100, transno 21474840529 00000004:00080000:2.0:1746147184.534411:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e11880, transno 21474840530 00000004:00080000:2.0:1746147184.534413:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80e680, transno 21474840531 00000004:00080000:2.0:1746147184.534414:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80ed80, transno 21474840532 00000004:00080000:2.0:1746147184.534417:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80fb80, transno 21474840533 00000004:00080000:2.0:1746147184.534419:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80ea00, transno 21474840534 00000004:00080000:2.0:1746147184.534421:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80f800, transno 21474840535 00000004:00080000:2.0:1746147184.534423:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008daadc00, transno 21474840536 00000004:00080000:2.0:1746147184.534425:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80f480, transno 21474840537 00000004:00080000:2.0:1746147184.534427:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7cca80, transno 21474840545 00000004:00080000:2.0:1746147184.534429:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d01f80, transno 21474840546 00000004:00080000:2.0:1746147184.534431:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7cc000, transno 21474840547 00000004:00080000:2.0:1746147184.534432:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d03100, transno 21474840548 00000004:00080000:2.0:1746147184.534435:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7cf100, transno 21474840549 00000004:00080000:2.0:1746147184.534437:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7ce300, transno 21474840550 00000004:00080000:2.0:1746147184.534439:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d03b80, transno 21474840551 00000004:00080000:2.0:1746147184.534441:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d02300, transno 21474840552 00000004:00080000:2.0:1746147184.534443:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e13b80, transno 21474840553 00000004:00080000:2.0:1746147184.534445:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e10380, transno 21474840554 00000004:00080000:2.0:1746147184.534447:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5ed80, transno 21474840555 00000004:00080000:2.0:1746147184.534449:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e11f80, transno 21474840556 00000004:00080000:2.0:1746147184.534450:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5d180, transno 21474840557 00000004:00080000:2.0:1746147184.534452:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e12300, transno 21474840558 00000004:00080000:2.0:1746147184.534454:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5dc00, transno 21474840559 00000004:00080000:2.0:1746147184.534455:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e10700, transno 21474840560 00000004:00080000:2.0:1746147184.534457:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5ce00, transno 21474840561 00000004:00080000:2.0:1746147184.534458:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee5c000, transno 21474840562 00000100:00100000:2.0:1746147184.534467:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466365568:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746147184.534918:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00100000:2.0:1746147184.537431:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147184.537452:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466365696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746147184.537523:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147184.537733:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466365696 00000100:00100000:1.0:1746147184.537739:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466365696 00000100:00100000:1.0:1746147184.537791:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1746147184.537798:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466365696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147184.537819:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 391184384 pending 20447232 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746147184.537868:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466365696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.537874:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1746147184.537960:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147184.538012:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873162 gen 2 00000004:00080000:3.0:1746147184.538018:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b5500, transno 17179873119 00000004:00080000:3.0:1746147184.538026:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b6680, transno 17179873120 00000004:00080000:3.0:1746147184.538028:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b7480, transno 17179873121 00000004:00080000:3.0:1746147184.538030:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fa97480, transno 17179873122 00000004:00080000:3.0:1746147184.538033:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fa96300, transno 17179873123 00000004:00080000:3.0:1746147184.538035:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b5f80, transno 17179873124 00000004:00080000:3.0:1746147184.538038:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fa97b80, transno 17179873125 00000004:00080000:3.0:1746147184.538040:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b5c00, transno 17179873126 00000004:00080000:3.0:1746147184.538042:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a9c00, transno 17179873127 00000004:00080000:3.0:1746147184.538044:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47aaa00, transno 17179873128 00000004:00080000:3.0:1746147184.538047:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47aa680, transno 17179873129 00000004:00080000:3.0:1746147184.538049:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47ab480, transno 17179873130 00000004:00080000:3.0:1746147184.538051:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a9f80, transno 17179873131 00000004:00080000:3.0:1746147184.538053:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47aa300, transno 17179873132 00000004:00080000:3.0:1746147184.538055:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47ab100, transno 17179873133 00000004:00080000:3.0:1746147184.538057:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47aad80, transno 17179873134 00000004:00080000:3.0:1746147184.538059:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f0a80, transno 17179873147 00000004:00080000:3.0:1746147184.538063:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3800, transno 17179873148 00000004:00080000:3.0:1746147184.538065:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2300, transno 17179873149 00000004:00080000:3.0:1746147184.538067:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2a00, transno 17179873150 00000004:00080000:3.0:1746147184.538070:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2d80, transno 17179873151 00000004:00080000:3.0:1746147184.538072:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f0e00, transno 17179873152 00000004:00080000:3.0:1746147184.538074:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f3b80, transno 17179873153 00000004:00080000:3.0:1746147184.538076:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c9f2680, transno 17179873154 00000004:00080000:3.0:1746147184.538079:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d00e00, transno 17179873155 00000004:00080000:3.0:1746147184.538081:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f731880, transno 17179873156 00000004:00080000:3.0:1746147184.538083:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d01c00, transno 17179873157 00000004:00080000:3.0:1746147184.538086:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f733480, transno 17179873158 00000004:00080000:3.0:1746147184.538088:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d00a80, transno 17179873159 00000004:00080000:3.0:1746147184.538091:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f730a80, transno 17179873160 00000004:00080000:3.0:1746147184.538093:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d00000, transno 17179873161 00000004:00080000:3.0:1746147184.538095:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d03800, transno 17179873162 00000100:00100000:3.0:1746147184.538107:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466365696:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1746147184.538548:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:3.0:1746147184.543343:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463639680:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13932us (14296us total) trans 0 rc 421888/421888 00000100:00100000:3.0:1746147184.543355:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4337 00002000:00100000:3.0:1746147184.543368:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008dded180 x1830967463639680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 504/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 421888/421888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.543378:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dded180 with x1830967463639680 ext(1048576->2097151) 00002000:00010000:3.0:1746147184.543385:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dded180 00000100:00100000:3.0:1746147184.549121:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967466365952:0@lo:400:kworker.0 00000100:00100000:2.0:1746147184.549121:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466366208:0@lo:400:kworker.0 00000100:00100000:1.0:1746147184.549180:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b57d6275-d138-4373-818f-9bad59bb9e6f:3293:1830967466365824:0@lo:400:kworker.0 00000100:00100000:3.0:1746147184.549241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147184.549259:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466365952 00000100:00100000:2.0:1746147184.549265:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466365952 00000100:00100000:2.0:1746147184.549310:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1746147184.549316:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466365952:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1746147184.549335:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147184.549353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147184.549356:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830967466365952:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.549361:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1746147184.549371:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466366208 00000100:00100000:2.0:1746147184.549373:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466366208 00000100:00100000:2.0:1746147184.549386:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1746147184.549394:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466366208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147184.549419:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466366208:12345-0@lo:400:kworker.0 Request processed in 25us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.549424:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1746147184.549438:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830967466366080:0@lo:400:kworker.0 00000100:00100000:2.0:1746147184.549456:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147184.549467:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466366080 00000100:00100000:2.0:1746147184.549469:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466366080 00000100:00100000:2.0:1746147184.549488:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1746147184.549491:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830967466366080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147184.549511:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830967466366080:12345-0@lo:400:kworker.0 Request processed in 20us (55us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.549515:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1746147184.549526:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147184.549714:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147184.549736:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466365824 00000100:00100000:1.0:1746147184.549739:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466365824 00000100:00100000:1.0:1746147184.549773:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1746147184.549778:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3293:x1830967466365824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147184.549805:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3293:x1830967466365824:12345-0@lo:400:kworker.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.549814:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1746147184.549999:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830967466365952:0@lo:400:kworker.0 00000100:00100000:1.0:1746147184.550074:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466366208:0@lo:400:kworker.0 00000100:00100000:2.0:1746147184.550125:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830967466366080:0@lo:400:kworker.0 00000100:00100000:1.0:1746147184.550168:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b57d6275-d138-4373-818f-9bad59bb9e6f:3293:1830967466365824:0@lo:400:kworker.0 00000100:00100000:1.0:1746147184.550238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.550281:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463639808 00000100:00100000:2.0:1746147184.550284:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463639808 00000100:00100000:2.0:1746147184.550316:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11444 00000100:00100000:2.0:1746147184.550321:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28785:x1830967463639808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.550333:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.550349:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63d7 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.550376:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.550383:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.550386:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.550389:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.550412:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.550424:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 28 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.550433:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466366336:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.550484:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.555417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.555691:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640064 00000100:00100000:3.0:1746147184.555700:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640064 00002000:00100000:3.0:1746147184.555737:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008ddefb80 x1830967463640064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.555747:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddefb80 with x1830967463640064 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.555752:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddefb80 00000100:00100000:3.0:1746147184.555781:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4338 00000100:00100000:3.0:1746147184.555788:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463640064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.555894:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466366336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147184.555923:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.555971:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54800, rc 0) 00000100:00100000:2.0:1746147184.556074:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28785:x1830967463639808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5752us (5841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.556080:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11444 00000100:00100000:0.0:1746147184.562428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.562497:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640320 00000100:00100000:2.0:1746147184.562506:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640320 00000100:00100000:2.0:1746147184.562549:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11445 00000100:00100000:2.0:1746147184.562556:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28788:x1830967463640320:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.562575:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.562593:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63de expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.562635:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.562642:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.562648:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147184.562652:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1642496->2080767] (req 1642496->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.562687:0:21080:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.562698:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1642496->2080767] (req 1642496->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.562707:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55000, rc 0) 00000100:00100000:2.0:1746147184.563789:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28788:x1830967463640320:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1230us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.563796:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11445 00000100:00100000:1.0:1746147184.563875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.563923:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640192 00000100:00100000:3.0:1746147184.563928:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640192 00002000:00100000:3.0:1746147184.563970:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1069056->1695743) req@ffff88009ef7f800 x1830967463640192/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.563979:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f800 with x1830967463640192 ext(1069056->1695743) 00010000:00010000:3.0:1746147184.563985:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 32 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.563996:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 32 pid: 4445 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.564003:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7f800 00000100:00100000:3.0:1746147184.564024:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1492 00000100:00100000:3.0:1746147184.564029:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463640192:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147184.564368:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463640064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8579us (8959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.564374:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4338 00002000:00100000:1.0:1746147184.564380:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008ddefb80 x1830967463640064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.564387:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddefb80 with x1830967463640064 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.564390:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddefb80 00000100:00100000:3.0:1746147184.576165:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463640192:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12124us (12278us total) trans 21474840582 rc 0/0 00000100:00100000:3.0:1746147184.576177:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1492 00002000:00100000:3.0:1746147184.576189:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1069056->1695743) req@ffff88009ef7f800 x1830967463640192/t21474840582(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.576199:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f800 with x1830967463640192 ext(1069056->1695743) 00010000:00010000:3.0:1746147184.576209:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 32 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.576226:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 32 pid: 4445 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.576233:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7f800 00000100:00100000:0.0:1746147184.577313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.578557:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640448 00000100:00100000:1.0:1746147184.578570:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640448 00000100:00100000:1.0:1746147184.578641:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11446 00000100:00100000:1.0:1746147184.578649:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463640448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.578668:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.578856:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57b1a00/0xb4b2209fbdac604f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63e5 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.578920:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466366592:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147184.580790:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.581161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.581220:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640576 00000100:00100000:2.0:1746147184.581231:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640576 00010000:00010000:2.0:1746147184.581266:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.581311:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5631 00000100:00100000:2.0:1746147184.581318:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463640576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.581330:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.581347:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.581358:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.581376:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.581378:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.581384:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.581390:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.581417:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.581426:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 17 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.581436:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466366720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.581528:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00010000:00010000:1.0:1746147184.588688:0:17530:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009ef7ed80 x1830967466366592) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.588733:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b470600/0xb4b2209fbdac601e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1069056->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63b4 expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.588761:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466366592:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147184.588796:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b1a00/0xb4b2209fbdac604f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63e5 expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.588808:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b1a00/0xb4b2209fbdac604f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63e5 expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.588815:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b1a00, rc 0) 00000100:00100000:1.0:1746147184.588859:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463640448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10210us (11548us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147184.588866:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11446 00000100:00100000:0.0:1746147184.588981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.589019:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640832 00000100:00100000:0.0:1746147184.589024:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640832 00002000:00100000:0.0:1746147184.589054:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddeca80 x1830967463640832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147184.589062:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeca80 with x1830967463640832 ext(1048576->2097151) 00010000:00010000:0.0:1746147184.589068:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.589079:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:0.0:1746147184.589084:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ddeca80 00000100:00100000:0.0:1746147184.589097:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1493 00000100:00100000:0.0:1746147184.589102:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463640832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.589750:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466366720:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.589762:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.589782:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463640576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8466us (8625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.589789:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5631 00000100:00100000:2.0:1746147184.591844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.591962:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463640960 00000100:00100000:0.0:1746147184.591970:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463640960 00000100:00100000:0.0:1746147184.592015:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11447 00000100:00100000:0.0:1746147184.592021:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28781:x1830967463640960:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147184.592037:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147184.592057:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63ec expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.592085:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.592098:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147184.592104:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147184.592105:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147184.592109:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.592136:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147184.592146:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 671 lvb_type: 1 00000100:00100000:0.0:1746147184.592158:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466366848:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147184.592731:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147184.592740:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 33 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:0.0:1746147184.592748:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466366976:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.592777:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.593902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.594005:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641088 00000100:00100000:3.0:1746147184.594012:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641088 00000100:00100000:3.0:1746147184.594054:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11448 00000100:00100000:3.0:1746147184.594061:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463641088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.594080:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.594094:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5348800/0xb4b2209fbdac605d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63f3 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.594113:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.594123:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5348800/0xb4b2209fbdac605d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63f3 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.594133:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5348800/0xb4b2209fbdac605d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63f3 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.594363:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5348800, rc 0) 00000100:00100000:3.0:1746147184.594405:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463641088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 344us (506us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.594411:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11448 00000100:00100000:1.0:1746147184.595356:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466366848:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.595967:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463640832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6864us (6984us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.595977:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1493 00002000:00100000:1.0:1746147184.595985:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddeca80 x1830967463640832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.595993:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeca80 with x1830967463640832 ext(1048576->2097151) 00010000:00010000:1.0:1746147184.596002:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.596014:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 18 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:1.0:1746147184.596020:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ddeca80 00000100:00100000:1.0:1746147184.596525:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ddec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466366976:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.596553:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.596565:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095370e00, rc 0) 00000100:00100000:1.0:1746147184.596595:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28781:x1830967463640960:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4574us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.596601:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11447 00000100:00100000:0.0:1746147184.599224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.599261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.599288:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641216 00000100:00100000:2.0:1746147184.599297:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641216 00010000:00010000:2.0:1746147184.599331:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.599360:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641344 00000100:00100000:2.0:1746147184.599363:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641344 00010000:00010000:2.0:1746147184.599373:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.599386:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5632 00000100:00100000:3.0:1746147184.599401:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463641216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.599413:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.599435:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:3.0:1746147184.599446:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:3.0:1746147184.599470:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54000/0xb4b2209fbdac603a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d0 expref: 22 pid: 8478 timeout: 671 lvb_type: 1 00000100:00100000:0.0:1746147184.599508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.599545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147184.599585:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.599636:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463641216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.599667:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5633 00000100:00100000:2.0:1746147184.599675:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463641344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.599682:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.599691:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.599693:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641472 00000100:00100000:1.0:1746147184.599697:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641472 00010000:00010000:2.0:1746147184.599701:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.599714:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5349e00/0xb4b2209fbdac5ffb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e639f expref: 34 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.599716:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641600 00000100:00100000:1.0:1746147184.599718:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641600 00010000:00010000:2.0:1746147184.599730:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.599732:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147184.599732:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11449 00000100:00100000:1.0:1746147184.599737:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463641472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.599740:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.599750:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.599753:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.599763:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e20c00/0xb4b2209fbdac6064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e63fa expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.599778:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.599782:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.599785:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e20c00/0xb4b2209fbdac6064 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63fa expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147184.599793:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466367104:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147184.599799:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e20c00/0xb4b2209fbdac6064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63fa expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.599812:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e20c00, rc 0) 00000100:00100000:1.0:1746147184.599831:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463641472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 94us (323us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.599836:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.599837:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11449 00000100:00100000:1.0:1746147184.599854:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11450 00000100:00100000:1.0:1746147184.599859:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463641600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.599865:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.599872:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac606b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6401 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.599897:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466367232:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147184.599918:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.600241:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5632 00000100:00100000:0.0:1746147184.602628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.602692:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641856 00000100:00100000:1.0:1746147184.602701:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641856 00002000:00100000:1.0:1746147184.602741:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba58a80 x1830967463641856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.602750:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58a80 with x1830967463641856 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.602755:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58a80 00000100:00100000:1.0:1746147184.602784:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4339 00000100:00100000:1.0:1746147184.602791:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463641856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.604820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.604866:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463641984 00000100:00100000:3.0:1746147184.604872:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463641984 00010000:00010000:3.0:1746147184.604895:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 20 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.604922:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5634 00000100:00100000:3.0:1746147184.604927:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463641984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.604950:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.604967:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 20 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.604976:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 20 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.604994:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63d7 expref: 20 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.605005:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.605006:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.605012:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.605018:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.605042:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.605051:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466367360:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.605099:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.605909:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466367104:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.605930:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.605979:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463641344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6304us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.605986:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5633 00000100:00100000:1.0:1746147184.609690:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466367232:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147184.609724:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac606b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6401 expref: 34 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.609738:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac606b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6401 expref: 34 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.609759:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e20000, rc 0) 00000100:00100000:1.0:1746147184.609805:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463641600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9945us (10264us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147184.609813:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11450 00000100:00100000:0.0:1746147184.609822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.609862:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463642240 00000100:00100000:2.0:1746147184.609869:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463642240 00002000:00100000:2.0:1746147184.609901:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3883008->3887103) req@ffff88012ba59180 x1830967463642240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.609909:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59180 with x1830967463642240 ext(3883008->3887103) 00002000:00010000:2.0:1746147184.609914:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba59180 00000100:00100000:2.0:1746147184.609958:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4340 00000100:00100000:2.0:1746147184.609964:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463642240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.610100:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463642240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 136us (439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147184.610108:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4340 00002000:00100000:2.0:1746147184.610113:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3883008->3887103) req@ffff88012ba59180 x1830967463642240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.610119:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59180 with x1830967463642240 ext(3883008->3887103) 00002000:00010000:2.0:1746147184.610122:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba59180 00000100:00100000:1.0:1746147184.611077:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463641856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8284us (8467us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.611084:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4339 00002000:00100000:1.0:1746147184.611090:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba58a80 x1830967463641856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.611098:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58a80 with x1830967463641856 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.611102:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58a80 00000100:00100000:3.0:1746147184.611148:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466367360:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147184.611166:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.611395:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463641984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6466us (6581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.611403:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5634 00000100:00100000:2.0:1746147184.611412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.612107:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463642496 00000100:00100000:1.0:1746147184.612112:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463642496 00002000:00100000:1.0:1746147184.612134:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1642496->1646591) req@ffff880132e10380 x1830967463642496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.612142:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967463642496 ext(1642496->1646591) 00002000:00010000:1.0:1746147184.612145:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:1.0:1746147184.612167:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4341 00000100:00100000:1.0:1746147184.612173:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463642496:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.612292:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463642496:12345-192.168.203.36@tcp:3:cat.0 Request processed in 119us (880us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147184.612298:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4341 00002000:00100000:1.0:1746147184.612302:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1642496->1646591) req@ffff880132e10380 x1830967463642496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.612309:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967463642496 ext(1642496->1646591) 00002000:00010000:1.0:1746147184.612311:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:1.0:1746147184.615417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.615526:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463642752 00000100:00100000:2.0:1746147184.615535:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463642752 00002000:00100000:2.0:1746147184.615574:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ef7ed80 x1830967463642752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.615583:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ed80 with x1830967463642752 ext(2097152->3145727) 00002000:00010000:2.0:1746147184.615589:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7ed80 00000100:00100000:2.0:1746147184.615630:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4342 00000100:00100000:2.0:1746147184.615640:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463642752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.620659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.620721:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643008 00000100:00100000:1.0:1746147184.620729:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643008 00002000:00100000:1.0:1746147184.620771:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137b80 x1830967463643008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.620780:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137b80 with x1830967463643008 ext(3145728->4194303) 00002000:00010000:1.0:1746147184.620786:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137b80 00000100:00100000:1.0:1746147184.620821:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4343 00000100:00100000:1.0:1746147184.620828:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463643008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.621687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.621711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.621751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.623149:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643264 00000100:00100000:2.0:1746147184.623158:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643264 00002000:00100000:2.0:1746147184.623213:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3883007) req@ffff88012ba5b480 x1830967463643264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.623222:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b480 with x1830967463643264 ext(3145728->3883007) 00002000:00010000:2.0:1746147184.623227:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5b480 00000100:00100000:2.0:1746147184.623240:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643648 00000100:00100000:2.0:1746147184.623243:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643648 00000100:00100000:3.0:1746147184.623245:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4344 00000100:00100000:3.0:1746147184.623253:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463643264:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147184.623255:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (2076672->2080767) req@ffff88012ba5b800 x1830967463643648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.623266:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b800 with x1830967463643648 ext(2076672->2080767) 00002000:00010000:2.0:1746147184.623269:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5b800 00000100:00100000:2.0:1746147184.623278:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4345 00000100:00100000:2.0:1746147184.623282:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463643648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.623399:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463643648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 115us (1646us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147184.623404:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4345 00002000:00100000:2.0:1746147184.623408:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (2076672->2080767) req@ffff88012ba5b800 x1830967463643648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.623414:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b800 with x1830967463643648 ext(2076672->2080767) 00002000:00010000:2.0:1746147184.623416:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5b800 00000100:00100000:1.0:1746147184.625042:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643392 00000100:00100000:1.0:1746147184.625052:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643392 00000100:00100000:1.0:1746147184.625682:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11451 00000100:00100000:1.0:1746147184.625691:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28781:x1830967463643392:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147184.625706:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.625723:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6408 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.625751:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.625760:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.625766:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.625768:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147184.625771:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4927487] (req 4194304->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.625802:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.625814:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 20 pid: 8478 timeout: 671 lvb_type: 1 00000100:00100000:1.0:1746147184.625825:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367488:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.625909:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.625917:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 30 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.625925:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367616:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.625965:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.630564:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463642752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14914us (15144us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147184.630577:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4342 00002000:00100000:2.0:1746147184.630588:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ef7ed80 x1830967463642752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.630598:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ed80 with x1830967463642752 ext(2097152->3145727) 00002000:00010000:2.0:1746147184.630604:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7ed80 00000100:00100000:1.0:1746147184.630631:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367488:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.630645:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367616:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147184.630672:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4927487] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.630686:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e20000, rc 0) 00000100:00100000:1.0:1746147184.630719:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28781:x1830967463643392:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5029us (9006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.630727:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11451 00000100:00100000:3.0:1746147184.632892:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463643264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9632us (11199us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746147184.632903:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4344 00002000:00100000:3.0:1746147184.632914:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3883007) req@ffff88012ba5b480 x1830967463643264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.632922:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b480 with x1830967463643264 ext(3145728->3883007) 00002000:00010000:3.0:1746147184.632928:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5b480 00000100:00100000:0.0:1746147184.634036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.634157:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643776 00000100:00100000:3.0:1746147184.634164:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643776 00010000:00010000:3.0:1746147184.634188:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 31 pid: 4445 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.634215:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5635 00000100:00100000:3.0:1746147184.634220:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463643776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.634230:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.634247:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 31 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.634254:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 31 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.634272:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5348600/0xb4b2209fbdac6017 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ad expref: 31 pid: 4445 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.634292:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.634315:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463643776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.634318:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5635 00000100:00100000:1.0:1746147184.634916:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463643008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14086us (14263us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.634925:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4343 00002000:00100000:1.0:1746147184.634932:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137b80 x1830967463643008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.634965:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137b80 with x1830967463643008 ext(3145728->4194303) 00010000:00010000:1.0:1746147184.634973:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:1.0:1746147184.634983:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00002000:00010000:1.0:1746147184.634989:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e137b80 00000100:00100000:0.0:1746147184.638920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.639062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.639242:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463643904 00000100:00100000:2.0:1746147184.639251:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463643904 00010000:00010000:2.0:1746147184.639284:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.639332:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5636 00000100:00100000:2.0:1746147184.639340:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463643904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.639354:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.639377:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.639389:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.639411:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac602c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63c9 expref: 18 pid: 8478 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.639430:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.639432:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.639439:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.639446:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.639477:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.639489:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466367744:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.639566:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.639653:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463644032 00000100:00100000:1.0:1746147184.639658:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463644032 00000100:00100000:1.0:1746147184.639684:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11452 00000100:00100000:1.0:1746147184.639690:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28785:x1830967463644032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.639705:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.639717:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e640f expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.639735:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.639742:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147184.639743:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147184.639746:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.639764:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.639773:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 19 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.639781:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367872:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.639806:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.643710:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466367872:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147184.643710:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466367744:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147184.643729:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147184.643771:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463643904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4430us (4861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147184.643782:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5636 00010000:00010000:1.0:1746147184.643871:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147184.643884:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199000, rc 0) 00000100:00100000:1.0:1746147184.643903:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28785:x1830967463644032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4214us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147184.643908:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11452 00000100:00100000:0.0:1746147184.649596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.649832:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463644288 00000100:00100000:1.0:1746147184.649840:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463644288 00002000:00100000:1.0:1746147184.649885:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4926335) req@ffff88012ba58700 x1830967463644288/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.649895:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58700 with x1830967463644288 ext(4194304->4926335) 00010000:00010000:1.0:1746147184.649904:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 18 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.649917:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 18 pid: 17530 timeout: 671 lvb_type: 0 00002000:00010000:1.0:1746147184.649923:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba58700 00000100:00100000:1.0:1746147184.649981:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1494 00000100:00100000:1.0:1746147184.649988:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463644288:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147184.660379:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463644288:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10382us (10785us total) trans 21474840583 rc 0/0 00000100:00100000:1.0:1746147184.660390:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1494 00002000:00100000:1.0:1746147184.660402:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4926335) req@ffff88012ba58700 x1830967463644288/t21474840583(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.660411:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58700 with x1830967463644288 ext(4194304->4926335) 00010000:00010000:1.0:1746147184.660420:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:1.0:1746147184.660439:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00002000:00010000:1.0:1746147184.660446:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba58700 00000100:00100000:0.0:1746147184.662593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.662683:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463644416 00000100:00100000:2.0:1746147184.662694:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463644416 00010000:00010000:2.0:1746147184.662735:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.662783:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5637 00000100:00100000:2.0:1746147184.662791:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463644416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.662805:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147184.662825:0:16058:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4870144 -> 4926336 00010000:00010000:2.0:1746147184.662831:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.662844:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.662866:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6072 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6408 expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.662901:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.662904:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.662911:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.662919:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.662985:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.663002:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466368000:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.663117:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.665064:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466368000:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.665084:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.665117:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463644416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2327us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.665126:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5637 00000100:00100000:0.0:1746147184.671337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.671447:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463644672 00000100:00100000:1.0:1746147184.671456:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463644672 00002000:00100000:1.0:1746147184.671503:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ba58e00 x1830967463644672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.671512:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58e00 with x1830967463644672 ext(3145728->4194303) 00002000:00010000:1.0:1746147184.671517:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58e00 00000100:00100000:1.0:1746147184.671550:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4346 00000100:00100000:1.0:1746147184.671557:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463644672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.679687:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463644672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8119us (8348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.679700:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4346 00002000:00100000:1.0:1746147184.680537:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ba58e00 x1830967463644672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.680547:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58e00 with x1830967463644672 ext(3145728->4194303) 00002000:00010000:1.0:1746147184.680552:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58e00 00000100:00100000:0.0:1746147184.687130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.687428:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463644800 00000100:00100000:1.0:1746147184.687436:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463644800 00000100:00100000:1.0:1746147184.687542:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11453 00000100:00100000:1.0:1746147184.687550:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463644800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147184.687572:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147184.687592:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0ee000/0xb4b2209fbdac6080 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6416 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147184.687656:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368128:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147184.687753:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147184.689807:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368128:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147184.689842:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0ee000/0xb4b2209fbdac6080 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6416 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.689857:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0ee000/0xb4b2209fbdac6080 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6416 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147184.689881:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0ee000, rc 0) 00000100:00100000:1.0:1746147184.689923:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463644800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2374us (2802us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147184.689930:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11453 00000100:00100000:0.0:1746147184.692682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.692787:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645056 00000100:00100000:1.0:1746147184.692795:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645056 00002000:00100000:1.0:1746147184.692837:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88012ba5bb80 x1830967463645056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.692847:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5bb80 with x1830967463645056 ext(4194304->4927487) 00002000:00010000:1.0:1746147184.692852:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5bb80 00000100:00100000:1.0:1746147184.692887:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4347 00000100:00100000:1.0:1746147184.692894:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463645056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.700658:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463645056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7750us (7972us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746147184.700670:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4347 00002000:00100000:1.0:1746147184.700682:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88012ba5bb80 x1830967463645056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.700692:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5bb80 with x1830967463645056 ext(4194304->4927487) 00002000:00010000:1.0:1746147184.700699:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5bb80 00000100:00100000:1.0:1746147184.705051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.705519:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645184 00000100:00100000:2.0:1746147184.705528:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645184 00000100:00100000:2.0:1746147184.705575:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11454 00000100:00100000:2.0:1746147184.705582:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463645184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.705597:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.705624:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac6087 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e641d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.705678:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368256:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147184.706660:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.707848:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368256:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147184.707877:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac6087 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e641d expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.707889:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac6087 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e641d expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.707919:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55400, rc 0) 00000100:00100000:2.0:1746147184.707975:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463645184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2393us (2933us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.707982:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11454 00000100:00100000:0.0:1746147184.712599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.712715:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645312 00000100:00100000:2.0:1746147184.712723:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645312 00000100:00100000:2.0:1746147184.712765:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11455 00000100:00100000:2.0:1746147184.712772:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463645312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.712790:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.712807:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac608e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6424 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.712857:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368384:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147184.713769:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.714715:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466368384:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147184.714741:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac608e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6424 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.714753:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac608e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6424 expref: 20 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.714763:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54200, rc 0) 00000100:00100000:2.0:1746147184.714797:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463645312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2025us (2207us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.714807:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11455 00000100:00100000:0.0:1746147184.728724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.728819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.728886:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645440 00000100:00100000:2.0:1746147184.728896:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645440 00000100:00100000:2.0:1746147184.728985:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645568 00000100:00100000:2.0:1746147184.728988:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645568 00000100:00100000:2.0:1746147184.729005:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11456 00000100:00100000:2.0:1746147184.729012:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463645440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.729030:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.729048:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e642b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.729070:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.729072:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.729081:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.729096:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.729108:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54800, rc 0) 00000100:00100000:2.0:1746147184.729157:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463645440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147184.729240:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11457 00000100:00100000:2.0:1746147184.729246:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11456 00000100:00100000:0.0:1746147184.729249:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463645568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147184.729259:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147184.729269:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac609c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6432 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147184.729308:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466368512:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147184.729520:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.731805:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466368512:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147184.731838:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac609c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6432 expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.731857:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac609c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6432 expref: 34 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.731872:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fa9400, rc 0) 00000100:00100000:2.0:1746147184.731924:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463645568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2676us (3104us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147184.731931:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11457 00000100:00100000:0.0:1746147184.740564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.742104:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463645824 00000100:00100000:1.0:1746147184.742114:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463645824 00002000:00100000:1.0:1746147184.742158:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800937ef100 x1830967463645824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 504/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.742168:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ef100 with x1830967463645824 ext(1048576->2097151) 00002000:00010000:1.0:1746147184.742173:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ef100 00000100:00100000:1.0:1746147184.742208:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4348 00000100:00100000:1.0:1746147184.742215:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463645824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.756302:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463645824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14076us (15735us total) trans 0 rc 610304/610304 00000100:00100000:1.0:1746147184.756315:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4348 00002000:00100000:1.0:1746147184.756326:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800937ef100 x1830967463645824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 504/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.756336:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ef100 with x1830967463645824 ext(1048576->2097151) 00002000:00010000:1.0:1746147184.756342:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ef100 00000100:00100000:0.0:1746147184.770369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.770557:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646080 00000100:00100000:1.0:1746147184.770565:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646080 00002000:00100000:1.0:1746147184.770607:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800937ef480 x1830967463646080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.770626:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ef480 with x1830967463646080 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.770631:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ef480 00000100:00100000:1.0:1746147184.770660:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4349 00000100:00100000:1.0:1746147184.770667:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463646080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.786785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.787253:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463646080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16584us (16892us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.787266:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4349 00002000:00100000:1.0:1746147184.787277:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800937ef480 x1830967463646080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.787287:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ef480 with x1830967463646080 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.787293:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ef480 00000100:00100000:2.0:1746147184.787550:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646208 00000100:00100000:2.0:1746147184.787558:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646208 00000100:00100000:2.0:1746147184.787602:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11458 00000100:00100000:2.0:1746147184.787608:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:28798:x1830967463646208:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.787631:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.787648:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6439 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.787674:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.787681:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.787683:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.787685:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.787711:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.787726:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 20 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.787736:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466368640:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.787814:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.792547:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466368640:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147184.792547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147184.792575:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.792593:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54200, rc 0) 00000100:00100000:0.0:1746147184.792602:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646336 00000100:00100000:0.0:1746147184.792609:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646336 00000100:00100000:2.0:1746147184.792656:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28798:x1830967463646208:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5047us (5881us total) trans 0 rc 0/0 00002000:00100000:0.0:1746147184.792659:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3883008->4194303) req@ffff88009ef7ca80 x1830967463646336/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147184.792665:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11458 00002000:00100000:0.0:1746147184.792668:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ca80 with x1830967463646336 ext(3883008->4194303) 00010000:00010000:0.0:1746147184.792675:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 21 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:0.0:1746147184.792687:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 21 pid: 17530 timeout: 671 lvb_type: 0 00002000:00010000:0.0:1746147184.792693:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7ca80 00000100:00100000:0.0:1746147184.792721:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1495 00000100:00100000:0.0:1746147184.792728:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463646336:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147184.795758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.795857:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646464 00000100:00100000:2.0:1746147184.795864:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646464 00000100:00100000:2.0:1746147184.798018:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11459 00000100:00100000:2.0:1746147184.798031:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28795:x1830967463646464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.798049:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.798067:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6440 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.798095:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.798101:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.798112:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147184.798116:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.798149:0:21080:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.798160:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.798169:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54a00, rc 0) 00000100:00100000:2.0:1746147184.798712:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28795:x1830967463646464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 684us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.798719:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11459 00000100:00100000:2.0:1746147184.801491:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463646336:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8753us (8940us total) trans 17179873179 rc 0/0 00000100:00100000:2.0:1746147184.801503:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1495 00002000:00100000:2.0:1746147184.801513:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3883008->4194303) req@ffff88009ef7ca80 x1830967463646336/t17179873179(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.801523:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7ca80 with x1830967463646336 ext(3883008->4194303) 00010000:00010000:2.0:1746147184.801533:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.801549:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.801557:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7ca80 00000100:00100000:0.0:1746147184.807915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.808091:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646592 00000100:00100000:2.0:1746147184.808100:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646592 00010000:00010000:2.0:1746147184.808134:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.808171:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5638 00000100:00100000:2.0:1746147184.808181:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463646592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.808197:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.808219:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.808229:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.808252:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095370e00/0xb4b2209fbdac6056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63ec expref: 23 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.808269:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.808271:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.808278:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.808285:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.808321:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.808332:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 34 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.808344:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466368896:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.808418:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.809661:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466368896:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.809674:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.809709:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463646592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1528us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.809715:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5638 00000100:00100000:1.0:1746147184.811010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.811290:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463646848 00000100:00100000:2.0:1746147184.811297:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463646848 00002000:00100000:2.0:1746147184.811331:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2617344->2621439) req@ffff88009ef7e680 x1830967463646848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.811340:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7e680 with x1830967463646848 ext(2617344->2621439) 00010000:00010000:2.0:1746147184.811348:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.811361:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.811373:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7e680 00000100:00100000:2.0:1746147184.811389:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1496 00000100:00100000:2.0:1746147184.811394:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463646848:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147184.811544:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463646848:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 150us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147184.811550:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1496 00002000:00100000:2.0:1746147184.811555:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2617344->2621439) req@ffff88009ef7e680 x1830967463646848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.811561:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7e680 with x1830967463646848 ext(2617344->2621439) 00010000:00010000:2.0:1746147184.811566:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.811574:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.811579:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7e680 00000100:00100000:0.0:1746147184.817242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.817441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.817537:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647232 00000100:00100000:3.0:1746147184.817545:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647232 00002000:00100000:3.0:1746147184.817588:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2617344->3145727) req@ffff8800937eed80 x1830967463647232/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.817598:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eed80 with x1830967463647232 ext(2617344->3145727) 00010000:00010000:3.0:1746147184.817607:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.817630:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.817637:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937eed80 00000100:00100000:3.0:1746147184.817656:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1497 00000100:00100000:3.0:1746147184.817663:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463647232:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147184.818213:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647104 00000100:00100000:2.0:1746147184.818218:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647104 00000100:00100000:2.0:1746147184.818242:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11460 00000100:00100000:2.0:1746147184.818247:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28798:x1830967463647104:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.818256:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.818272:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6447 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.818300:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.818308:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.818314:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.818316:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.818319:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3162111] (req 3145728->3162111) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.818344:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 32 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.818354:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 32 pid: 17530 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.818364:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369024:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147184.818442:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.818450:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 18 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.818457:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.818477:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a000 going to sleep for 11 seconds 00010000:00010000:2.0:1746147184.819047:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147184.822752:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.824292:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463647232:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 6625us (6846us total) trans 17179873180 rc 0/0 00000100:00100000:3.0:1746147184.824303:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1497 00002000:00100000:3.0:1746147184.824312:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2617344->3145727) req@ffff8800937eed80 x1830967463647232/t17179873180(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.824326:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eed80 with x1830967463647232 ext(2617344->3145727) 00010000:00010000:3.0:1746147184.824337:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.824350:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.824356:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937eed80 00000100:00100000:0.0:1746147184.824966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.825020:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647360 00000100:00100000:2.0:1746147184.825026:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647360 00010000:00010000:2.0:1746147184.825059:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 33 pid: 17530 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.825094:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5639 00000100:00100000:2.0:1746147184.825100:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463647360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.825112:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.825129:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 33 pid: 17530 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.825138:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 33 pid: 17530 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.825159:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54800/0xb4b2209fbdac6095 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e642b expref: 33 pid: 17530 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.825187:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.825211:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463647360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.825217:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5639 00000100:00100000:3.0:1746147184.825398:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369152:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.825426:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->3162111] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.825436:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55a00, rc 0) 00000100:00100000:3.0:1746147184.825459:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28798:x1830967463647104:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7212us (8228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.825465:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11460 00000100:00100000:0.0:1746147184.826389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.827333:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647488 00000100:00100000:2.0:1746147184.827340:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647488 00010000:00010000:2.0:1746147184.827366:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.827399:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5640 00000100:00100000:2.0:1746147184.827405:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463647488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.827417:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.827435:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.827445:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 671 lvb_type: 0 00000100:00100000:1.0:1746147184.827840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.828062:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647616 00000100:00100000:3.0:1746147184.828067:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647616 00010000:00010000:3.0:1746147184.828085:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.828114:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5641 00000100:00100000:3.0:1746147184.828121:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463647616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.828130:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.828146:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.828157:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.828172:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6439 expref: 37 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.828189:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.828191:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.828199:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.828207:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.828241:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.828253:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466369280:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.828331:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147184.828397:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f199000/0xb4b2209fbdac6079 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e640f expref: 19 pid: 17530 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.828412:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.828413:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.828417:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.828424:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.828443:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 30 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.828451:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466369408:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.828489:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.834353:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466369408:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.834373:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147184.834402:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466369280:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147184.834419:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.834602:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463647488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7194us (8213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.834606:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463647616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6479us (6759us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.834612:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5640 00000100:00100000:3.0:1746147184.834625:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5641 00000100:00100000:2.0:1746147184.834736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.834966:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463647872 00000100:00100000:3.0:1746147184.834972:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463647872 00002000:00100000:3.0:1746147184.835003:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3158016->3162111) req@ffff880132e10700 x1830967463647872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.835013:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10700 with x1830967463647872 ext(3158016->3162111) 00002000:00010000:3.0:1746147184.835018:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10700 00000100:00100000:3.0:1746147184.835045:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4350 00000100:00100000:3.0:1746147184.835053:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463647872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147184.835227:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463647872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 174us (492us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.835234:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4350 00002000:00100000:3.0:1746147184.835239:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3158016->3162111) req@ffff880132e10700 x1830967463647872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.835246:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10700 with x1830967463647872 ext(3158016->3162111) 00002000:00010000:3.0:1746147184.835249:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10700 00000100:00100000:0.0:1746147184.835789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.836515:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463648128 00000100:00100000:3.0:1746147184.836520:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463648128 00002000:00100000:3.0:1746147184.836541:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937ed500 x1830967463648128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.836553:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ed500 with x1830967463648128 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.836557:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937ed500 00000100:00100000:3.0:1746147184.836581:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4351 00000100:00100000:3.0:1746147184.836587:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463648128:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147184.846096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.846195:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463648256 00000100:00100000:3.0:1746147184.846204:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463648256 00000100:00100000:3.0:1746147184.846244:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11461 00000100:00100000:3.0:1746147184.846251:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463648256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.846270:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.846288:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e644e expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.846342:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369536:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.846818:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.852362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.852413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.852509:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463648384 00000100:00100000:3.0:1746147184.852517:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463648384 00000100:00100000:3.0:1746147184.852551:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463648512 00000100:00100000:3.0:1746147184.852553:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463648512 00000100:00100000:3.0:1746147184.852568:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11462 00000100:00100000:3.0:1746147184.852574:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463648384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.852594:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.852624:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac60bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6455 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.852680:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466369664:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.852765:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.854570:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11463 00000100:00100000:3.0:1746147184.854582:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463648512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.854596:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.854610:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e645c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.854649:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.854651:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.854659:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.854674:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.854684:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064400, rc 0) 00000100:00100000:3.0:1746147184.854723:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463648512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 146us (2310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.854729:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11463 00000100:00100000:3.0:1746147184.856388:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466369536:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.856414:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60b8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e644e expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.856426:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac60b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e644e expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.856452:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54200, rc 0) 00000100:00100000:3.0:1746147184.856483:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463648256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10231us (10397us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.856489:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11461 00000100:00100000:3.0:1746147184.856767:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463648128:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 20180us (20980us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.857189:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4351 00002000:00100000:3.0:1746147184.857198:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937ed500 x1830967463648128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.857207:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ed500 with x1830967463648128 ext(2097152->3145727) 00002000:00010000:3.0:1746147184.857212:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937ed500 00002000:00010000:3.0:1746147184.857457:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147183 -> 1746147184 00000100:00100000:3.0:1746147184.857469:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466369664:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.857489:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac60bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6455 expref: 19 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.857498:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac60bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6455 expref: 19 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.857507:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9000, rc 0) 00000100:00100000:3.0:1746147184.857529:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463648384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4955us (5177us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.857534:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11462 00000100:00100000:0.0:1746147184.866747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.866818:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463648896 00000100:00100000:0.0:1746147184.866820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.866827:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463648896 00002000:00100000:3.0:1746147184.866870:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3162112->4194303) req@ffff8800937edc00 x1830967463648896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.866880:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edc00 with x1830967463648896 ext(3162112->4194303) 00002000:00010000:3.0:1746147184.866885:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937edc00 00000100:00100000:3.0:1746147184.866915:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649024 00000100:00100000:3.0:1746147184.866917:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649024 00002000:00100000:3.0:1746147184.866929:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800937eea00 x1830967463649024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.866964:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eea00 with x1830967463649024 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.866967:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eea00 00000100:00100000:3.0:1746147184.866979:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4352 00000100:00100000:3.0:1746147184.866985:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463648896:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147184.867313:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4353 00000100:00100000:1.0:1746147184.867321:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463649024:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147184.868760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.872538:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649152 00000100:00100000:3.0:1746147184.872548:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649152 00000100:00100000:3.0:1746147184.872601:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11464 00000100:00100000:3.0:1746147184.872608:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28805:x1830967463649152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.872639:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.872656:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6463 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.872686:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.872694:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.872696:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147184.872699:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.872728:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 31 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.872739:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 31 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.872750:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466369792:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147184.878318:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.880604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.880681:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649280 00000100:00100000:2.0:1746147184.880689:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649280 00002000:00100000:2.0:1746147184.880731:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1642496->2080767) req@ffff8800937ed880 x1830967463649280/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.880740:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ed880 with x1830967463649280 ext(1642496->2080767) 00010000:00010000:2.0:1746147184.880749:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.880764:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.880771:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937ed880 00000100:00100000:2.0:1746147184.880791:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1498 00000100:00100000:2.0:1746147184.880797:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463649280:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147184.881054:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466369792:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147184.881080:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.881095:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064c00, rc 0) 00000100:00100000:3.0:1746147184.881138:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28805:x1830967463649152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8530us (12382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.881145:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11464 00000100:00100000:1.0:1746147184.885322:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463649024:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17990us (18491us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.885335:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4353 00002000:00100000:1.0:1746147184.885346:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800937eea00 x1830967463649024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.885356:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eea00 with x1830967463649024 ext(3145728->4194303) 00002000:00010000:1.0:1746147184.885362:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eea00 00000100:00100000:3.0:1746147184.887631:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463648896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 20629us (20881us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1746147184.887643:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4352 00002000:00100000:3.0:1746147184.887653:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3162112->4194303) req@ffff8800937edc00 x1830967463648896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.887664:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edc00 with x1830967463648896 ext(3162112->4194303) 00002000:00010000:3.0:1746147184.887670:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937edc00 00000100:00100000:2.0:1746147184.897828:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463649280:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 17020us (17222us total) trans 21474840584 rc 0/0 00000100:00100000:2.0:1746147184.897841:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1498 00002000:00100000:2.0:1746147184.897851:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1642496->2080767) req@ffff8800937ed880 x1830967463649280/t21474840584(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.897867:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ed880 with x1830967463649280 ext(1642496->2080767) 00010000:00010000:2.0:1746147184.897877:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.897893:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:2.0:1746147184.897900:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937ed880 00000100:00100000:0.0:1746147184.903711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.903859:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649408 00000100:00100000:3.0:1746147184.903866:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649408 00010000:00010000:3.0:1746147184.903901:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:3.0:1746147184.903934:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5642 00000100:00100000:3.0:1746147184.903970:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463649408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147184.903984:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147184.904005:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.904016:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.904037:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac6048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63de expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.904064:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.904065:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.904073:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.904080:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.904107:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.904117:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466369920:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147184.904190:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.905170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.905285:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466369920:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.905301:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.905325:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463649408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1355us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.905332:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5642 00000100:00100000:3.0:1746147184.905396:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649536 00000100:00100000:3.0:1746147184.905400:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649536 00000100:00100000:3.0:1746147184.905424:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11465 00000100:00100000:3.0:1746147184.905430:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463649536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.905444:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.905457:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e646a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147184.905472:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.905473:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147184.905478:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.905489:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.905497:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065000, rc 0) 00000100:00100000:3.0:1746147184.905515:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463649536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147184.905519:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11465 00000100:00100000:0.0:1746147184.907508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.907591:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463649792 00000100:00100000:2.0:1746147184.907598:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463649792 00002000:00100000:2.0:1746147184.907665:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edcb100 x1830967463649792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.907675:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830967463649792 ext(4194304->4927487) 00002000:00010000:2.0:1746147184.907680:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcb100 00000100:00100000:2.0:1746147184.907706:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4354 00000100:00100000:2.0:1746147184.907713:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463649792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147184.911089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.911479:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650048 00000100:00100000:3.0:1746147184.911487:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650048 00002000:00100000:3.0:1746147184.911527:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009edc8700 x1830967463650048/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.911538:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830967463650048 ext(1048576->2097151) 00002000:00010000:3.0:1746147184.911543:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8700 00000100:00100000:3.0:1746147184.911570:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4355 00000100:00100000:3.0:1746147184.911577:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463650048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.913100:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463649792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5381us (5590us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147184.913110:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4354 00002000:00100000:2.0:1746147184.913120:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edcb100 x1830967463649792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.913129:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830967463649792 ext(4194304->4927487) 00002000:00010000:2.0:1746147184.913134:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcb100 00000100:00100000:3.0:1746147184.924886:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463650048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13297us (13794us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.924899:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4355 00002000:00100000:3.0:1746147184.924911:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009edc8700 x1830967463650048/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.924921:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830967463650048 ext(1048576->2097151) 00002000:00010000:3.0:1746147184.924927:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8700 00000100:00100000:0.0:1746147184.932932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.933045:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650176 00000100:00100000:2.0:1746147184.933054:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650176 00000100:00100000:2.0:1746147184.933114:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11466 00000100:00100000:2.0:1746147184.933122:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28800:x1830967463650176:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.933141:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.933159:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6471 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.933188:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.933194:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.933196:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.933199:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3874816->4194303] (req 3874816->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.933226:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 32 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.933236:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 32 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.933246:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466370048:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.933335:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147184.936816:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466370048:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147184.936847:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3874816->4194303] (req 3874816->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.936864:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b2800, rc 0) 00000100:00100000:2.0:1746147184.936922:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28800:x1830967463650176:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3802us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.936930:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11466 00000100:00100000:0.0:1746147184.937587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.937658:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650304 00000100:00100000:3.0:1746147184.937664:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650304 00002000:00100000:3.0:1746147184.937698:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3162111) req@ffff88009050a300 x1830967463650304/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 16872/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.937707:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050a300 with x1830967463650304 ext(3145728->3162111) 00010000:00010000:3.0:1746147184.937714:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.937726:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 33 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.937733:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009050a300 00000100:00100000:3.0:1746147184.937761:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1499 00000100:00100000:3.0:1746147184.937769:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463650304:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147184.938189:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463650304:12345-192.168.203.36@tcp:4:cat.0 Request processed in 420us (602us total) trans 21474840585 rc 0/0 00000100:00100000:3.0:1746147184.938196:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1499 00002000:00100000:3.0:1746147184.938202:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3162111) req@ffff88009050a300 x1830967463650304/t21474840585(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:560/0 lens 16872/448 e 0 to 0 dl 1746147195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.938215:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050a300 with x1830967463650304 ext(3145728->3162111) 00010000:00010000:3.0:1746147184.938219:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:3.0:1746147184.938228:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00002000:00010000:3.0:1746147184.938233:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009050a300 00000100:00100000:0.0:1746147184.939829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.939931:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650432 00000100:00100000:2.0:1746147184.940156:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650432 00000100:00100000:2.0:1746147184.941969:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11467 00000100:00100000:2.0:1746147184.941982:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28805:x1830967463650432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147184.942000:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.942017:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6478 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.942045:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.942047:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147184.942052:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.942064:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.942074:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3e00, rc 0) 00000100:00100000:2.0:1746147184.942135:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28805:x1830967463650432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 157us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.942142:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11467 00000100:00100000:0.0:1746147184.942919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.943077:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650560 00000100:00100000:2.0:1746147184.943082:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650560 00010000:00010000:2.0:1746147184.943107:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.943128:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5643 00000100:00100000:2.0:1746147184.943133:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463650560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.943145:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.943168:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.943178:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.943196:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55a00/0xb4b2209fbdac60b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6447 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.943215:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.943216:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.943221:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.943228:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.943239:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.943240:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.943242:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.943249:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.943275:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.943286:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466370176:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.943359:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.943366:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466370304:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.943391:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.952218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.952325:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466370176:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.952335:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466370304:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.952355:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.952399:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463650560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9266us (9482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.952411:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5643 00000100:00100000:3.0:1746147184.952493:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463650816 00000100:00100000:3.0:1746147184.952499:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463650816 00002000:00100000:3.0:1746147184.952535:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3874816->3878911) req@ffff880090508e00 x1830967463650816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.952544:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967463650816 ext(3874816->3878911) 00002000:00010000:3.0:1746147184.952549:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:3.0:1746147184.952563:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4356 00000100:00100000:3.0:1746147184.952570:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463650816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147184.952751:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463650816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 180us (542us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147184.952756:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4356 00002000:00100000:3.0:1746147184.952761:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3874816->3878911) req@ffff880090508e00 x1830967463650816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.952768:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967463650816 ext(3874816->3878911) 00002000:00010000:3.0:1746147184.952771:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:0.0:1746147184.961384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.961455:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463651072 00000100:00100000:2.0:1746147184.961467:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463651072 00002000:00100000:2.0:1746147184.961506:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090509500 x1830967463651072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147184.961515:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967463651072 ext(2097152->3145727) 00002000:00010000:2.0:1746147184.961523:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509500 00000100:00100000:2.0:1746147184.961544:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4357 00000100:00100000:2.0:1746147184.961555:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463651072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.965015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.965077:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463651328 00000100:00100000:3.0:1746147184.965085:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463651328 00002000:00100000:3.0:1746147184.965121:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ef7c700 x1830967463651328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 504/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.965129:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7c700 with x1830967463651328 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.965133:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7c700 00000100:00100000:3.0:1746147184.965151:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4358 00000100:00100000:3.0:1746147184.965157:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463651328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.966745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147184.966780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.966780:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463651712 00000100:00100000:0.0:1746147184.966786:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463651712 00000100:00100000:0.0:1746147184.966797:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463651584 00000100:00100000:0.0:1746147184.966798:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463651584 00002000:00100000:0.0:1746147184.966819:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ef7fb80 x1830967463651584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147184.966826:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7fb80 with x1830967463651584 ext(2097152->3145727) 00002000:00010000:0.0:1746147184.966830:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7fb80 00000100:00100000:0.0:1746147184.966857:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4359 00000100:00100000:0.0:1746147184.966863:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463651584:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147184.970332:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ef7d500 x1830967463651712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.970349:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7d500 with x1830967463651712 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.970354:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7d500 00000100:00100000:3.0:1746147184.970467:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4360 00000100:00100000:3.0:1746147184.970475:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463651712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147184.970826:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463651072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9270us (9450us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147184.970834:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4357 00002000:00100000:1.0:1746147184.970839:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090509500 x1830967463651072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147184.970846:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967463651072 ext(2097152->3145727) 00002000:00010000:1.0:1746147184.970849:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509500 00000100:00100000:3.0:1746147184.981839:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463651328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16673us (16824us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746147184.981849:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4358 00002000:00100000:3.0:1746147184.981860:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ef7c700 x1830967463651328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 504/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.981869:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7c700 with x1830967463651328 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.981875:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7c700 00000100:00100000:0.0:1746147184.982174:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463651584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15309us (15391us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147184.982181:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4359 00002000:00100000:0.0:1746147184.982187:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ef7fb80 x1830967463651584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147184.982194:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7fb80 with x1830967463651584 ext(2097152->3145727) 00002000:00010000:0.0:1746147184.982197:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7fb80 00000100:00100000:3.0:1746147184.983309:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463651712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12833us (16566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147184.983316:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4360 00002000:00100000:3.0:1746147184.983322:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ef7d500 x1830967463651712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.983328:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7d500 with x1830967463651712 ext(3145728->4194303) 00002000:00010000:3.0:1746147184.983331:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7d500 00000100:00100000:0.0:1746147184.987988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147184.988290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.988367:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463651968 00000100:00100000:2.0:1746147184.988376:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463651968 00000100:00100000:2.0:1746147184.988411:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652096 00000100:00100000:2.0:1746147184.988412:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652096 00000100:00100000:2.0:1746147184.988426:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11468 00000100:00100000:2.0:1746147184.988433:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28800:x1830967463651968:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147184.988448:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147184.988461:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e647f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.988487:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.988494:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.988500:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.988501:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.988504:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3674111] (req 3145728->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.988532:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147184.988542:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.988552:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466370432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147184.988631:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.988638:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 35 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.988646:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466370560:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.988664:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.988699:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11469 00000100:00100000:3.0:1746147184.988707:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463652096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147184.988714:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147184.988723:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e813400/0xb4b2209fbdac60f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6486 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147184.988748:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466370688:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147184.988774:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147184.991287:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466370688:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147184.991310:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e813400/0xb4b2209fbdac60f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6486 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147184.991321:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e813400/0xb4b2209fbdac60f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6486 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147184.991419:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466370432:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147184.991427:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466370560:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147184.991441:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3674111] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.991452:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55800, rc 0) 00000100:00100000:2.0:1746147184.991485:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28800:x1830967463651968:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3052us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.991496:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11468 00010000:00010000:3.0:1746147184.991869:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e813400, rc 0) 00000100:00100000:3.0:1746147184.991903:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463652096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3196us (3613us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147184.991908:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11469 00000100:00100000:0.0:1746147184.993796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.993897:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652224 00000100:00100000:2.0:1746147184.993905:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652224 00010000:00010000:2.0:1746147184.993930:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 671 lvb_type: 1 00000100:00100000:2.0:1746147184.993975:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5644 00000100:00100000:2.0:1746147184.993980:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463652224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.993991:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.994006:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.994015:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.994032:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac60c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e645c expref: 24 pid: 17548 timeout: 671 lvb_type: 1 00010000:00010000:2.0:1746147184.994056:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.994337:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463652224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 355us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.994343:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5644 00000100:00100000:0.0:1746147184.995372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147184.995519:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652352 00000100:00100000:2.0:1746147184.995524:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652352 00010000:00010000:2.0:1746147184.995540:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 671 lvb_type: 0 00000100:00100000:2.0:1746147184.995574:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5645 00000100:00100000:2.0:1746147184.995580:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463652352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147184.995588:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147184.995598:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.995607:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.995630:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac60aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6440 expref: 36 pid: 21080 timeout: 671 lvb_type: 0 00010000:00010000:2.0:1746147184.995640:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.995642:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147184.995647:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.995654:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147184.995680:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147184.995691:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466370816:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147184.995748:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147184.995827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147184.995866:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652608 00000100:00100000:3.0:1746147184.995871:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652608 00002000:00100000:3.0:1746147184.995895:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a0448000 x1830967463652608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/0 e 0 to 0 dl 1746147195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147184.995904:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463652608 ext(4194304->4927487) 00002000:00010000:3.0:1746147184.995908:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:3.0:1746147184.995920:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4361 00000100:00100000:3.0:1746147184.995926:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463652608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147184.999713:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466370816:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147184.999732:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147184.999767:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463652352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4186us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147184.999776:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5645 00000100:00100000:2.0:1746147185.004531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.004662:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463652608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8732us (8831us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147185.004672:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4361 00002000:00100000:3.0:1746147185.004683:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a0448000 x1830967463652608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:560/0 lens 488/440 e 0 to 0 dl 1746147195 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.004691:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463652608 ext(4194304->4927487) 00002000:00010000:3.0:1746147185.004695:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:3.0:1746147185.004715:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652864 00000100:00100000:3.0:1746147185.004722:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652864 00002000:00100000:3.0:1746147185.004761:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3670016->3674111) req@ffff880132e12300 x1830967463652864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.004768:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967463652864 ext(3670016->3674111) 00002000:00010000:3.0:1746147185.004771:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12300 00000100:00100000:3.0:1746147185.004785:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4362 00000100:00100000:3.0:1746147185.004792:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463652864:12345-192.168.203.36@tcp:3:cat.0 00000100:00080000:2.0:1746147185.004882:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147185.005070:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463652864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 278us (546us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147185.005075:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4362 00002000:00100000:3.0:1746147185.005080:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3670016->3674111) req@ffff880132e12300 x1830967463652864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.005086:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12300 with x1830967463652864 ext(3670016->3674111) 00002000:00010000:3.0:1746147185.005089:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12300 00000100:00100000:0.0:1746147185.009243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.009362:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463652992 00000100:00100000:3.0:1746147185.009372:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463652992 00000100:00080000:2.0:1746147185.009433:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147185.009692:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11470 00000100:00100000:3.0:1746147185.009701:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463652992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.009719:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.009732:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e812800/0xb4b2209fbdac60f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e648d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.009776:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466370944:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.009856:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.012104:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466370944:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147185.012130:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e812800/0xb4b2209fbdac60f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e648d expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.012141:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e812800/0xb4b2209fbdac60f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e648d expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.012231:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e812800, rc 0) 00000100:00100000:3.0:1746147185.012434:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463652992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2733us (3196us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147185.012441:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11470 00000100:00100000:0.0:1746147185.014183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.014231:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463653120 00000100:00100000:3.0:1746147185.014239:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463653120 00000100:00100000:3.0:1746147185.014275:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11471 00000100:00100000:3.0:1746147185.014282:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463653120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.014295:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.014306:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e812c00/0xb4b2209fbdac60fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6494 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.014346:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466371072:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.014408:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.015518:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466371072:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147185.015535:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e812c00/0xb4b2209fbdac60fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6494 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.015542:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e812c00/0xb4b2209fbdac60fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6494 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.015557:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e812c00, rc 0) 00000100:00100000:3.0:1746147185.015581:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463653120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1299us (1400us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147185.015586:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11471 00000100:00100000:0.0:1746147185.027652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.027711:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463653248 00000100:00100000:1.0:1746147185.027720:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463653248 00000100:00100000:1.0:1746147185.027792:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10449 00000100:00100000:1.0:1746147185.027801:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:28809:x1830967463653248:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147185.027823:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.027838:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569400/0xb4b2209fbdac6105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e649b expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746147185.027861:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147185.027883:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.027893:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.027905:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.027917:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.027922:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.027926:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.028043:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.028053:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.028061:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 333 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.028066:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.028093:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 333 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.028102:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 333 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.028112:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.029263:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.029274:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 42 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.029282:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.029331:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.029953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.030185:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371200:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.030206:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463653504 00000100:00100000:2.0:1746147185.030212:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463653504 00000100:00100000:2.0:1746147185.030253:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4129 00000100:00100000:2.0:1746147185.030260:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+334:27370:x1830967463653504:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1746147185.030504:0:14051:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589944191 00000100:00100000:2.0:1746147185.030569:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+336:27370:x1830967463653504:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 309us (632us total) trans 8589944192 rc 0/0 00000100:00100000:2.0:1746147185.030574:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4129 00000020:00080000:2.0:1746147185.030578:0:14051:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746147185.033039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.033104:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463653760 00000100:00100000:2.0:1746147185.033111:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463653760 00000100:00100000:0.0:1746147185.033124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.033141:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4130 00000100:00100000:2.0:1746147185.033147:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+43:19601:x1830967463653760:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147185.033279:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463653888 00000100:00100000:3.0:1746147185.033283:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463653888 00000100:00100000:2.0:1746147185.033284:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+44:19601:x1830967463653760:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 136us (251us total) trans 8589944193 rc 0/0 00000100:00100000:2.0:1746147185.033290:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4130 00010000:00010000:3.0:1746147185.033301:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 336 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.033341:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5646 00000100:00100000:3.0:1746147185.033346:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+336:1959:x1830967463653888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.033354:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.033359:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 336 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.033367:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 336 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.033379:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371328:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.033383:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6009 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e63a6 expref: 336 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.033397:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.033402:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.033508:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.033513:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.033517:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147185.033522:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147185.033749:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+335:1959:x1830967463653888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 400us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.033755:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5646 00000100:00100000:0.0:1746147185.035405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.035494:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654016 00000100:00100000:3.0:1746147185.035502:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654016 00010000:00010000:3.0:1746147185.035523:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.035558:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5647 00000100:00100000:3.0:1746147185.035564:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1957:x1830967463654016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.035574:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.035578:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.035588:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.035602:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54600/0xb4b2209fbdac5fa7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6352 expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.035624:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.035629:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.035636:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.035641:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.035668:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.035694:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+43:1957:x1830967463654016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.035700:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5647 00010000:00010000:0.0:1746147185.035913:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.035920:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147185.035966:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:0.0:1746147185.035970:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147185.035983:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.035992:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036000:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036005:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036010:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036013:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f569200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147185.036016:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036021:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036028:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147185.036031:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.036033:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036037:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac610c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036064:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036070:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036074:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036079:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f568000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147185.036081:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036085:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036091:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98ff00) 00010000:00010000:0.0:1746147185.036093:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.036095:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036100:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f568000/0xb4b2209fbdac6113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.036409:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569400/0xb4b2209fbdac6105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.036422:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.036428:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.036430:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147185.036432:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569600, rc 0) 00000100:00100000:0.0:1746147185.036531:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:28809:x1830967463653248:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8731us (8887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.036538:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10449 00000100:00100000:0.0:1746147185.040277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.040353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.040409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.040431:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654144 00000100:00100000:0.0:1746147185.040440:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654144 00000100:00080000:2.0:1746147185.040557:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147185.040731:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654272 00000100:00100000:0.0:1746147185.040734:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654272 00000100:00100000:3.0:1746147185.040800:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654400 00000100:00100000:3.0:1746147185.040803:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654400 00000100:00100000:3.0:1746147185.040838:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11472 00000100:00100000:3.0:1746147185.040845:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463654144:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147185.040859:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.040872:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64a2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.040890:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.040892:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.040898:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.040911:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.040920:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e813c00, rc 0) 00000100:00100000:3.0:1746147185.040978:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463654144:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 133us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.040984:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11472 00000100:00100000:3.0:1746147185.040998:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11473 00000100:00100000:3.0:1746147185.041003:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463654272:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147185.041009:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.041015:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6128 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64a9 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.041046:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466371456:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.041089:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.041105:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11474 00000100:00100000:3.0:1746147185.041110:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463654400:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147185.041116:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.041124:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e813000/0xb4b2209fbdac612f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64b0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.041142:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466371584:192.168.203.36@tcp:106: 00000100:00080000:2.0:1746147185.041365:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147185.041608:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.043537:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466371456:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147185.043558:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6128 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a9 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.043569:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6128 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a9 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.043577:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e813200, rc 0) 00000100:00100000:3.0:1746147185.043625:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463654272:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2621us (3271us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147185.043632:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11473 00000100:00100000:2.0:1746147185.043748:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466371584:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147185.043763:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e813000/0xb4b2209fbdac612f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64b0 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.043772:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e813000/0xb4b2209fbdac612f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64b0 expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.043779:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e813000, rc 0) 00000100:00100000:2.0:1746147185.043811:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463654400:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2700us (3402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147185.043816:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11474 00000100:00100000:0.0:1746147185.045772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.046087:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654656 00000100:00100000:2.0:1746147185.046095:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654656 00000100:00100000:2.0:1746147185.046145:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10450 00000100:00100000:2.0:1746147185.046153:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:28809:x1830967463654656:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147185.046169:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.046184:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac6136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64b7 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.046261:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147185.046272:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.046278:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147185.046304:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.046316:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 24 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.046326:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371712:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.046399:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.047832:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466371712:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.047849:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147185.048497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.048719:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654784 00000100:00100000:1.0:1746147185.048725:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654784 00010000:00010000:1.0:1746147185.048756:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 25 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.048784:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5648 00000100:00100000:1.0:1746147185.048789:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:1957:x1830967463654784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.048799:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.048803:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 25 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.048811:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 25 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.048831:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569600/0xb4b2209fbdac611a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e649b expref: 25 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.048856:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.048860:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.048867:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.048873:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147185.048891:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.048918:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:1957:x1830967463654784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 129us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.048924:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5648 00010000:00010000:2.0:1746147185.049253:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147185.049259:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147185.049274:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.049374:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55400/0xb4b2209fbdac6136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64b7 expref: 25 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.049385:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64b7 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.049391:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.049393:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147185.049395:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54a00, rc 0) 00000100:00100000:2.0:1746147185.049429:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+24:28809:x1830967463654656:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3277us (3663us total) trans 8589944194 rc 0/0 00000100:00100000:2.0:1746147185.049438:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10450 00000100:00100000:0.0:1746147185.049669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.049734:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463654912 00000100:00100000:3.0:1746147185.049738:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463654912 00000100:00100000:3.0:1746147185.049759:0:14045:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:3.0:1746147185.049763:0:14045:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1956:x1830967463654912:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1746147185.049787:0:14045:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1956:x1830967463654912:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 24us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.049795:0:14045:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:2.0:1746147185.054194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.054275:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655168 00000100:00100000:0.0:1746147185.054284:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655168 00000100:00100000:0.0:1746147185.054558:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10451 00000100:00100000:0.0:1746147185.054567:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+24:28809:x1830967463655168:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147185.054584:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.054587:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147185.054606:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac613d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64b7 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.055047:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.055052:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147185.055064:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac614b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64be expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.055142:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6152 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.055155:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6152 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147185.055162:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6152 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147185.055171:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147185.055255:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac614b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64be expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.055266:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6152 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64be expref: 25 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.055272:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.055274:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147185.055276:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20a00, rc 0) 00000100:00100000:0.0:1746147185.055332:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+25:28809:x1830967463655168:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 766us (1144us total) trans 8589944195 rc 0/0 00000100:00100000:0.0:1746147185.055338:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10451 00000100:00100000:0.0:1746147185.057697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.058779:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655296 00000100:00100000:2.0:1746147185.058790:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655296 00000100:00100000:2.0:1746147185.058844:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10452 00000100:00100000:2.0:1746147185.058852:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+25:28809:x1830967463655296:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147185.058870:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.058884:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6160 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64c5 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.058929:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6160 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64c5 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.058970:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6160 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64c5 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.058986:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.058989:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147185.058991:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54e00, rc 0) 00000100:00100000:2.0:1746147185.059035:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+26:28809:x1830967463655296:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 184us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.059041:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10452 00000100:00100000:3.0:1746147185.065552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.065573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.065603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.065632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.065645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.065662:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655552 00000100:00100000:3.0:1746147185.065671:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655552 00000100:00100000:1.0:1746147185.065680:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655808 00000100:00100000:1.0:1746147185.065684:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655808 00000100:00100000:3.0:1746147185.065709:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656064 00000100:00100000:3.0:1746147185.065712:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656064 00000100:00100000:1.0:1746147185.065712:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655424 00000100:00100000:1.0:1746147185.065714:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655424 00000100:00100000:3.0:1746147185.065723:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655680 00000100:00100000:3.0:1746147185.065724:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655680 00000100:00100000:1.0:1746147185.065727:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11475 00000100:00100000:1.0:1746147185.065734:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463655552:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147185.065737:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11476 00000100:00100000:3.0:1746147185.065742:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463655808:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147185.065767:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.065767:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.065780:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.065781:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.065788:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.065791:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.065794:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.065797:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 34 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.065800:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.065801:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.065802:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.065803:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.065804:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.065804:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.065828:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 33 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.065828:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 34 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.065838:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 34 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.065848:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466371968:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.065866:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11477 00000100:00100000:0.0:1746147185.065873:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463656064:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147185.065888:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.065897:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.065907:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147185.065908:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.065908:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.065910:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.065925:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.065974:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 33 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.065985:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466371840:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.065989:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 12 pid: 6881 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.065998:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466372096:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.066012:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066019:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 13 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.066026:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466372352:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.066026:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066033:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 22 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.066039:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466372480:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.066052:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.066053:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934559c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147185.066059:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 20 pid: 17530 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.066066:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466372608:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.066069:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11478 00000100:00100000:1.0:1746147185.066074:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463655424:12345-192.168.203.36@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147185.066078:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147185.066088:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.066092:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11479 00010000:00010000:1.0:1746147185.066096:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147185.066097:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463655680:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147185.066102:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.066108:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066110:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066112:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.066113:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.066115:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.066120:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.066127:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.066131:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066134:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066138:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.066138:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.066139:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.066141:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.066145:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466372736:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.066154:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066161:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.066168:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147185.066169:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466372864:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.066175:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 13 pid: 6881 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.066182:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466372992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.066188:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.066196:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 12 pid: 4445 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.066203:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466373120:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.066203:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.066210:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 20 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.066216:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466373248:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.066218:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.066224:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.066226:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.066230:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466373376:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.066240:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.066267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.066564:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463655936 00000100:00100000:1.0:1746147185.066569:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463655936 00000100:00100000:1.0:1746147185.066588:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11480 00000100:00100000:1.0:1746147185.066593:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463655936:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147185.066608:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066631:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066638:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066643:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147185.066644:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147185.066646:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066660:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066666:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.066673:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466373504:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.066706:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.066713:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.066721:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466373632:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.066736:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455180 going to sleep for 11 seconds 00010000:00010000:0.0:1746147185.067495:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 22 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.067505:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466372224:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.067542:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.073913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.073930:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466372736:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.073961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.073963:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466371968:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.073971:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466372096:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.073975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.073977:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466372480:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.073988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147185.073999:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.074004:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656192 00000100:00100000:0.0:1746147185.074010:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656192 00000100:00100000:1.0:1746147185.074015:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656448 00000100:00100000:1.0:1746147185.074018:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656448 00010000:00010000:0.0:1746147185.074037:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 34 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.074048:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656320 00000100:00100000:2.0:1746147185.074052:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656320 00000100:00100000:0.0:1746147185.074058:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656704 00000100:00100000:0.0:1746147185.074060:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656704 00010000:00010000:2.0:1746147185.074068:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 13 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.074070:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 23 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.074089:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5649 00000100:00100000:2.0:1746147185.074095:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463656192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.074106:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074124:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 34 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074131:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 34 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.074136:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466371840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.074144:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466372352:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.074149:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f065000/0xb4b2209fbdac60d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e646a expref: 34 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.074151:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466372608:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.074164:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147185.074168:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.074197:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463656192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.074202:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5649 00010000:00010000:1.0:1746147185.074215:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 15 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.074217:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5650 00000100:00100000:2.0:1746147185.074221:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463656320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.074227:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074238:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 13 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074250:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 13 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074267:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51d5c00/0xb4b2209fbdac5c12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f8 expref: 13 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074276:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.074288:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463656320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.074292:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5650 00000100:00100000:2.0:1746147185.074301:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5651 00000100:00100000:2.0:1746147185.074305:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463656704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.074310:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074316:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 23 pid: 8480 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.074323:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 23 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.074329:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5652 00010000:00010000:2.0:1746147185.074332:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b86ec00/0xb4b2209fbdac5a75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e600a expref: 23 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.074341:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463656448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.074349:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074350:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147185.074359:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 15 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.074362:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463656704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (374us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147185.074367:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 15 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.074368:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5651 00010000:00010000:0.0:1746147185.074378:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e813c00/0xb4b2209fbdac6121 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64a2 expref: 15 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.074390:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.074393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.074404:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656576 00000100:00100000:2.0:1746147185.074406:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656576 00000100:00100000:0.0:1746147185.074408:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463656448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.074413:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5652 00010000:00010000:2.0:1746147185.074415:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 35 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.074425:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5653 00000100:00100000:2.0:1746147185.074429:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463656576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.074434:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074439:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 35 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074446:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 35 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074456:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f14cc00/0xb4b2209fbdac5aa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e602d expref: 35 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074468:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.074470:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.074473:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.074478:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466372992:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.074480:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.074494:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.074503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.074507:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463656576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.074511:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5653 00000100:00100000:0.0:1746147185.074512:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656832 00000100:00100000:0.0:1746147185.074514:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656832 00010000:00010000:2.0:1746147185.074524:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074525:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 14 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074529:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.074538:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5654 00000100:00100000:0.0:1746147185.074543:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463656832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.074544:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.074550:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074550:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.074556:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074559:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 14 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074561:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e20000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.074564:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074566:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 14 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074571:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074576:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51d5600/0xb4b2209fbdac5c0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e60f1 expref: 14 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.074580:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.074584:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147185.074585:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e20000/0xb4b2209fbdac616e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.074600:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463656832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.074605:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5654 00000100:00100000:2.0:1746147185.074633:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463655552:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 8899us (9088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.074639:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11475 00000100:00100000:0.0:1746147185.074640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.074648:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463656960 00000100:00100000:0.0:1746147185.074651:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463656960 00010000:00010000:0.0:1746147185.074660:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 11 pid: 4445 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.074677:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5655 00000100:00100000:0.0:1746147185.074681:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463656960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.074686:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.074694:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 11 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.074701:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 11 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.074711:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.074716:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466373248:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.074726:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463656960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.074731:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5655 00010000:00010000:2.0:1746147185.074733:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.074795:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466372864:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.074803:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092904a00/0xb4b2209fbdac5f4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6313 expref: 10 pid: 4445 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.074810:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466373120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.075522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.075563:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657216 00000100:00100000:1.0:1746147185.075567:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657216 00010000:00010000:1.0:1746147185.075581:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.075608:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5656 00000100:00100000:1.0:1746147185.075621:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463657216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147185.075628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147185.075628:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.075637:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.075640:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657344 00000100:00100000:0.0:1746147185.075644:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657344 00010000:00010000:1.0:1746147185.075645:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.075655:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4ba200/0xb4b2209fbdac5f0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62f0 expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.075655:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 21 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.075668:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.075681:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5657 00000100:00100000:0.0:1746147185.075686:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463657344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147185.075688:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466373504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.075690:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463657216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147185.075691:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147185.075695:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5656 00010000:00010000:0.0:1746147185.075699:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 21 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.075707:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 21 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.075716:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064c00/0xb4b2209fbdac60cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6463 expref: 21 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.075725:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.075726:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.075729:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.075734:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.075754:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.075993:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466373376:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.076010:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077464:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.077469:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466373632:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.077470:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463657344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1782us (1840us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147185.077475:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.077476:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5657 00010000:00010000:2.0:1746147185.077485:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077496:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077502:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077508:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077513:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e813200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147185.077516:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077522:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077533:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.077538:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e813200/0xb4b2209fbdac6167 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.077582:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463655808:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 11839us (12008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.077590:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11476 00000100:00100000:2.0:1746147185.077710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.077724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.079442:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466372224:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.079459:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.080234:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657728 00000100:00100000:3.0:1746147185.080242:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657728 00010000:00010000:3.0:1746147185.080266:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.080280:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657088 00000100:00100000:0.0:1746147185.080284:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657088 00000100:00100000:3.0:1746147185.080293:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5658 00000100:00100000:3.0:1746147185.080300:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463657728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.080310:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.080311:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.080327:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.080328:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5659 00000100:00100000:0.0:1746147185.080333:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463657088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.080336:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.080339:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.080349:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.080354:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac5eea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e62cd expref: 34 pid: 17530 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.080355:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.080364:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.080366:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.080369:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.080369:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b86e800/0xb4b2209fbdac5a1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5fcb expref: 33 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.080376:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.080377:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147185.080391:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.080406:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463657728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 107us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.080412:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5658 00010000:00010000:1.0:1746147185.080429:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080436:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080672:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080680:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080686:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080692:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1bc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.080695:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080700:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080709:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.080714:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac6183 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.080920:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463657088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 586us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.080925:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5659 00000100:00100000:1.0:1746147185.081140:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463655680:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15041us (15493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.081147:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11479 00000100:00100000:0.0:1746147185.081377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.081407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.081418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.081449:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657600 00000100:00100000:2.0:1746147185.081453:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657600 00000100:00100000:0.0:1746147185.081467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147185.081476:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x419:0x0] (3874816->4194303) req@ffff88009e5e2d80 x1830967463657600/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147185.081477:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657472 00000100:00100000:0.0:1746147185.081479:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657472 00002000:00100000:2.0:1746147185.081484:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2d80 with x1830967463657600 ext(3874816->4194303) 00010000:00010000:0.0:1746147185.081487:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 21 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.081489:0:8484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 21 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.081497:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657984 00000100:00100000:0.0:1746147185.081499:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657984 00010000:00010000:2.0:1746147185.081502:0:8484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 22 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.081505:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 22 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.081507:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e5e2d80 00000100:00100000:0.0:1746147185.081514:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5660 00000100:00100000:2.0:1746147185.081519:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463657856 00000100:00100000:0.0:1746147185.081519:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463657472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147185.081521:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463657856 00010000:00010000:0.0:1746147185.081525:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746147185.081531:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3674111) req@ffff88009e5e0700 x1830967463657856/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147185.081533:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 22 pid: 8478 timeout: 672 lvb_type: 1 00002000:00100000:2.0:1746147185.081538:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0700 with x1830967463657856 ext(3145728->3674111) 00010000:00010000:2.0:1746147185.081542:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 21 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.081545:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 22 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.081548:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 21 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.081553:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5e0700 00010000:00010000:0.0:1746147185.081555:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac59cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f8c expref: 22 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.081561:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1500 00010000:00010000:0.0:1746147185.081562:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.081563:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147185.081565:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463657600:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147185.081566:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.081572:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.081585:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.081599:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463657472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.081604:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5660 00000100:00100000:0.0:1746147185.081626:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5661 00000100:00100000:0.0:1746147185.081630:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463657984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.081636:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.081643:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.081650:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.081664:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac60e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6478 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.081671:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.081682:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463657984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.081686:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5661 00000100:00100000:3.0:1746147185.081761:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1501 00000100:00100000:3.0:1746147185.081766:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463657856:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147185.081857:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081864:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081875:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081882:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081887:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081892:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f569a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.081894:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081900:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081908:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.081913:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f569a00/0xb4b2209fbdac617c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.081958:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463655424:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15883us (16324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.081964:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11478 00000100:00100000:2.0:1746147185.092505:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463657600:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10930us (11138us total) trans 21474840586 rc 0/0 00000100:00100000:2.0:1746147185.092516:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1500 00002000:00100000:2.0:1746147185.092527:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3874816->4194303) req@ffff88009e5e2d80 x1830967463657600/t21474840586(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.092535:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2d80 with x1830967463657600 ext(3874816->4194303) 00010000:00010000:2.0:1746147185.092543:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.092549:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463657856:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10781us (11128us total) trans 17179873181 rc 0/0 00010000:00010000:2.0:1746147185.092554:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.092556:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1501 00002000:00010000:2.0:1746147185.092560:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e5e2d80 00002000:00100000:3.0:1746147185.092561:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3674111) req@ffff88009e5e0700 x1830967463657856/t17179873181(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.092568:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0700 with x1830967463657856 ext(3145728->3674111) 00010000:00010000:3.0:1746147185.092573:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.092582:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:3.0:1746147185.092587:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5e0700 00000100:00100000:0.0:1746147185.096067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.096191:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463658112 00000100:00100000:1.0:1746147185.096201:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463658112 00010000:00010000:1.0:1746147185.096232:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.096275:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5662 00000100:00100000:1.0:1746147185.096283:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463658112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.096296:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.096314:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.096325:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.096342:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac60e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e647f expref: 23 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.096369:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.096371:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.096374:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.096380:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.096400:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.097260:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463658112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 976us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.097266:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5662 00010000:00010000:1.0:1746147185.097306:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097312:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097325:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097329:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097333:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097337:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.097339:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097343:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097349:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.097352:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6175 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.097381:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:1958:x1830967463656064:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 31510us (31779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.097386:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11477 00000100:00100000:1.0:1746147185.098206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.098319:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463658240 00000100:00100000:0.0:1746147185.098325:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463658240 00010000:00010000:0.0:1746147185.098345:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.098376:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5663 00000100:00100000:0.0:1746147185.098383:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463658240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.098393:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.098914:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.098927:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.098964:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac60db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3874816->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6471 expref: 20 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.098987:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.098989:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.098992:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.098999:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.099021:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.099045:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463658240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 662us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.099051:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5663 00010000:00010000:3.0:1746147185.099186:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099195:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099211:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099216:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099227:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099233:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4a11200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147185.099235:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099241:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099249:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.099254:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a11200/0xb4b2209fbdac618a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.099438:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463655936:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 32843us (33168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.099445:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11480 00000100:00100000:0.0:1746147185.100671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.100741:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463658496 00000100:00100000:3.0:1746147185.100748:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463658496 00000100:00100000:3.0:1746147185.100789:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10453 00000100:00100000:3.0:1746147185.100796:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:28809:x1830967463658496:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147185.101002:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.101021:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6160 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64c5 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101033:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.101036:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147185.101061:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.101071:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 42 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101078:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101083:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101088:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 42 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101093:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101099:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 334 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101104:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.101127:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 334 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101140:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 334 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101151:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466373760:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.101228:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101235:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 42 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101242:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466373888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.101269:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 42 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101276:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 42 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101283:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.101610:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101629:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101636:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.101662:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101668:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 42 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101675:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374272:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.101704:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 42 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.101711:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 42 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.101718:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba59500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374400:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.101750:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.103347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.103458:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466373760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.103472:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466373888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.103478:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374016:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.104045:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463658624 00000100:00100000:1.0:1746147185.104053:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463658624 00010000:00010000:1.0:1746147185.104081:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 335 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.104116:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5664 00000100:00100000:1.0:1746147185.104124:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+335:1957:x1830967463658624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.104141:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.104146:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 335 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.104155:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 335 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.104173:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac5ac9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e603b expref: 335 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.104196:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.104201:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.104208:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.104248:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1957:x1830967463658624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.104254:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5664 00000100:00100000:0.0:1746147185.105834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.105880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.105881:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463658752 00000100:00100000:1.0:1746147185.105889:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463658752 00010000:00010000:1.0:1746147185.105910:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 43 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.105963:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659008 00000100:00100000:3.0:1746147185.105966:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5665 00000100:00100000:2.0:1746147185.105967:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659008 00000100:00100000:3.0:1746147185.105973:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1957:x1830967463658752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.105983:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.105987:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.105997:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.106012:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e811400/0xb4b2209fbdac58d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5f1c expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.106023:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.106026:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.106033:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.106060:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+43:1957:x1830967463658752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.106065:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5665 00000100:00100000:2.0:1746147185.106085:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4131 00000100:00100000:2.0:1746147185.106089:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+42:14478:x1830967463659008:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147185.106455:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+43:14478:x1830967463659008:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 364us (573us total) trans 8589944196 rc 0/0 00000100:00100000:2.0:1746147185.106461:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4131 00000100:00100000:0.0:1746147185.107709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.107735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.107774:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659264 00000100:00100000:1.0:1746147185.107779:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659264 00000100:00100000:0.0:1746147185.107792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147185.107796:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 43 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.107816:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659136 00000100:00100000:1.0:1746147185.107818:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659136 00000100:00100000:0.0:1746147185.107820:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659392 00000100:00100000:0.0:1746147185.107823:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659392 00010000:00010000:1.0:1746147185.107827:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.107835:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 44 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.107849:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5666 00000100:00100000:0.0:1746147185.107854:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1957:x1830967463659264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.107864:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.107869:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.107876:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 44 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.107889:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.107892:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.107897:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.107916:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1957:x1830967463659264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.107921:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5666 00000100:00100000:1.0:1746147185.107930:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5667 00000100:00100000:1.0:1746147185.107950:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+334:1957:x1830967463659136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147185.107952:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5668 00010000:00010000:1.0:1746147185.107957:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147185.107957:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+43:1957:x1830967463659392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.107961:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.107963:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.107967:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 43 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.107968:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.107975:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 43 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.108140:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.108149:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac5512 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cde expref: 43 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.108161:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0efa00/0xb4b2209fbdac5519 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5ce5 expref: 334 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.108169:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374272:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.108169:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.108173:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147185.108176:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba59500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466374400:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.108178:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.108192:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+333:1957:x1830967463659136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 257us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.108198:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5667 00010000:00010000:3.0:1746147185.108201:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.108897:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac550b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5cd7 expref: 42 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.109036:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.109040:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.109045:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.109065:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+41:1957:x1830967463659392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1108us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.109067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.109070:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5668 00000100:00100000:0.0:1746147185.109081:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659520 00000100:00100000:0.0:1746147185.109084:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659520 00010000:00010000:0.0:1746147185.109093:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 41 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.109117:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5669 00000100:00100000:0.0:1746147185.109122:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+41:1957:x1830967463659520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.109129:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.109133:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 41 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.109140:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 41 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.109149:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2a600/0xb4b2209fbdac5dee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e621e expref: 41 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.109158:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.109161:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.109166:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.109172:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.109193:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147185.109213:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.109219:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1957:x1830967463659520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147185.109220:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.109225:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5669 00000040:00080000:2.0:1746147185.109685:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2879, 88 off239064 00000004:00080000:2.0:1746147185.109691:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572096753550ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.109716:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2834, 88 off235096 00000004:00080000:2.0:1746147185.109720:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572096782446ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.109744:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2835, 88 off235184 00000004:00080000:2.0:1746147185.109747:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572096810206ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.109755:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2880, 88 off239152 00000004:00080000:2.0:1746147185.109757:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572096819994ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.109763:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2881, 88 off239240 00000004:00080000:2.0:1746147185.109765:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572096828089ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112622:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2836, 88 off235272 00000004:00080000:2.0:1746147185.112635:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099697318ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.112661:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2837, 88 off235360 00000004:00080000:2.0:1746147185.112664:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099726565ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.112672:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2838, 88 off235448 00000004:00080000:2.0:1746147185.112675:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099737676ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.112685:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2882, 88 off239328 00000004:00080000:2.0:1746147185.112689:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099751640ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112698:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2839, 88 off235536 00000004:00080000:2.0:1746147185.112700:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099762766ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.112706:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2883, 88 off239416 00000004:00080000:2.0:1746147185.112708:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099770829ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112714:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2840, 88 off235624 00000004:00080000:2.0:1746147185.112716:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099778880ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.112722:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2884, 88 off239504 00000004:00080000:2.0:1746147185.112725:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099787625ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112733:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2885, 88 off239592 00000004:00080000:2.0:1746147185.112735:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099798056ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112742:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2886, 88 off239680 00000004:00080000:2.0:1746147185.112744:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099807163ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112752:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2887, 88 off239768 00000004:00080000:2.0:1746147185.112755:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572099817380ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.112762:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2841, 88 off235712 00000004:00080000:2.0:1746147185.112764:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572099827260ns, next at 537465048041ns, rc = 0 00000001:00080000:2.0:1746147185.143240:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944195 is committed 00000001:00080000:2.0:1746147185.143253:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944189 is committed 00000001:00080000:2.0:1746147185.143257:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944166 is committed 00000001:00080000:2.0:1746147185.143274:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944188 is committed 00000001:00080000:2.0:1746147185.143308:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944197 is committed 00000004:00080000:2.0:1746147185.143312:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:2.0:1746147185.143318:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:2.0:1746147185.143323:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:2.0:1746147185.143324:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00080000:2.0:1746147185.143326:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000004:00080000:2.0:1746147185.143327:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:2.0:1746147185.143329:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:2.0:1746147185.143330:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:2.0:1746147185.143331:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:2.0:1746147185.143332:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:2.0:1746147185.143334:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:2.0:1746147185.143336:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:2.0:1746147185.143337:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:2.0:1746147185.143338:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000004:00080000:2.0:1746147185.143339:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:2.0:1746147185.143341:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:2.0:1746147185.143342:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000001:00080000:2.0:1746147185.143345:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944196 is committed 00000001:00080000:2.0:1746147185.143350:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944192 is committed 00000100:00100000:2.0:1746147185.143629:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466374784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.143677:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143718:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.143734:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143744:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.143757:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143767:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466376320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.143778:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143793:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746147185.143797:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466374912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.143809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143818:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.143829:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143838:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.143850:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143859:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466376448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.143870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.143890:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466374784 00000100:00100000:2.0:1746147185.143897:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466374784 00000100:00100000:2.0:1746147185.143925:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375296 00000100:00100000:2.0:1746147185.143927:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375296 00000100:00100000:2.0:1746147185.143953:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375808 00000100:00100000:2.0:1746147185.143955:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375808 00000100:00100000:2.0:1746147185.143963:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466376320 00000100:00100000:2.0:1746147185.143964:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466376320 00000100:00100000:2.0:1746147185.143969:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466374912 00000100:00100000:2.0:1746147185.143970:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466374912 00000100:00100000:2.0:1746147185.143975:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375424 00000100:00100000:2.0:1746147185.143977:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375424 00000100:00100000:2.0:1746147185.143982:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375936 00000100:00100000:2.0:1746147185.143983:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375936 00000100:00100000:2.0:1746147185.143989:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466376448 00000100:00100000:2.0:1746147185.143990:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466376448 00000100:00100000:2.0:1746147185.143999:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11481 00000100:00100000:2.0:1746147185.144005:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466374784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.144157:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466374784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (479us total) trans 17179873182 rc 0/0 00000100:00100000:2.0:1746147185.144163:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11481 00000100:00100000:2.0:1746147185.144176:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11482 00000100:00100000:2.0:1746147185.144181:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466375296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.144283:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:2.0:1746147185.144286:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.144288:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144290:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.144292:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:2.0:1746147185.144310:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466375296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (574us total) trans 17179873183 rc 0/0 00000100:00100000:2.0:1746147185.144314:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11482 00000100:00100000:2.0:1746147185.144324:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11483 00000100:00100000:2.0:1746147185.144328:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466375808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.144422:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466375808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (663us total) trans 21474840587 rc 0/0 00000100:00100000:2.0:1746147185.144427:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11483 00000100:00100000:2.0:1746147185.144436:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11484 00000100:00100000:2.0:1746147185.144440:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466376320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.144520:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147185.144522:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.144524:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144526:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.144528:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:2.0:1746147185.144544:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466376320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (765us total) trans 21474840588 rc 0/0 00000100:00100000:2.0:1746147185.144549:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11484 00000100:00100000:2.0:1746147185.144557:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11485 00000100:00100000:2.0:1746147185.144561:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466374912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.144647:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147185.144649:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.144651:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144653:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144654:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1746147185.144670:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466374912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (859us total) trans 17179873184 rc 0/0 00000100:00100000:2.0:1746147185.144674:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11485 00000100:00100000:2.0:1746147185.144682:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11486 00000100:00100000:2.0:1746147185.144686:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466375424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.144762:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147185.144764:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.144766:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144768:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.144770:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1746147185.144784:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466375424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (954us total) trans 17179873185 rc 0/0 00000100:00100000:2.0:1746147185.144789:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11486 00000100:00100000:2.0:1746147185.144797:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11487 00000100:00100000:2.0:1746147185.144800:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466375936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.144878:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466375936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1027us total) trans 21474840589 rc 0/0 00000100:00100000:2.0:1746147185.144883:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11487 00000100:00100000:2.0:1746147185.144890:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11488 00000100:00100000:2.0:1746147185.144894:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830967466376448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.144985:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:2.0:1746147185.144987:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.144989:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.144990:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.144992:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:2.0:1746147185.145008:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830967466376448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1137us total) trans 21474840590 rc 0/0 00000100:00100000:2.0:1746147185.145012:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11488 00000004:00080000:2.0:1746147185.145051:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df800/2, rc 0, transno 17179873184 00000100:00100000:2.0:1746147185.145055:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466374912:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.145061:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd500/2, rc 0, transno 17179873185 00000100:00100000:2.0:1746147185.145064:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.145069:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090508000/2, rc 0, transno 21474840589 00000100:00100000:2.0:1746147185.145074:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147185.145079:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80d500/2, rc 0, transno 21474840590 00000100:00100000:2.0:1746147185.145082:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466376448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147185.145087:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ded80/2, rc 0, transno 17179873182 00000100:00100000:2.0:1746147185.145089:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466374784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.145094:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dce00/2, rc 0, transno 17179873183 00000100:00100000:2.0:1746147185.145096:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.145101:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b480/2, rc 0, transno 21474840587 00000100:00100000:2.0:1746147185.145103:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466375808:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147185.145107:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 21474840588 00000100:00100000:2.0:1746147185.145109:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466376320:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147185.145297:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e5e1c00 reply state ffff88009f7d9000 transno 8589944197 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147185.145305:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147185.145356:0:14049:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147185.145365:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28809:x1830967463658496:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 44569us (44694us total) trans 8589944197 rc 0/0 00000100:00100000:3.0:1746147185.145374:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10453 00000100:00100000:3.0:1746147185.145391:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466374656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.145410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145431:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.145444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145454:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145473:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145483:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145494:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:3.0:1746147185.145499:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466374528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.145510:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145519:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.145529:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145538:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145549:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145555:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145566:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145571:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.145594:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466374656 00000100:00100000:3.0:1746147185.145599:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466374656 00000100:00100000:3.0:1746147185.145621:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375168 00000100:00100000:3.0:1746147185.145624:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375168 00000100:00100000:3.0:1746147185.145631:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375680 00000100:00100000:3.0:1746147185.145633:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375680 00000100:00100000:3.0:1746147185.145638:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466376192 00000100:00100000:3.0:1746147185.145639:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466376192 00000100:00100000:3.0:1746147185.145644:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466374528 00000100:00100000:3.0:1746147185.145645:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466374528 00000100:00100000:3.0:1746147185.145649:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375040 00000100:00100000:3.0:1746147185.145651:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375040 00000100:00100000:3.0:1746147185.145656:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466375552 00000100:00100000:3.0:1746147185.145657:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466375552 00000100:00100000:3.0:1746147185.145662:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466376064 00000100:00100000:3.0:1746147185.145663:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466376064 00000100:00100000:3.0:1746147185.145667:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466376576 00000100:00100000:3.0:1746147185.145669:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466376576 00000100:00100000:3.0:1746147185.145675:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11489 00000100:00100000:3.0:1746147185.145679:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466374656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.145768:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466374656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (357us total) trans 17179873186 rc 0/0 00000100:00100000:3.0:1746147185.145773:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11489 00000100:00100000:3.0:1746147185.145782:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11490 00000100:00100000:3.0:1746147185.145785:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466375168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.145862:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.145864:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.145866:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.145868:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.145870:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147185.145884:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466375168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (440us total) trans 17179873187 rc 0/0 00000100:00100000:3.0:1746147185.145889:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11490 00000100:00100000:3.0:1746147185.145898:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11491 00000100:00100000:3.0:1746147185.145901:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466375680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.145992:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466375680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (525us total) trans 21474840591 rc 0/0 00000100:00100000:3.0:1746147185.145997:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11491 00000100:00100000:3.0:1746147185.146005:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11492 00000100:00100000:3.0:1746147185.146009:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466376192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147185.146082:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.146084:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.146086:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.146087:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.146089:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1746147185.146106:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466376192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (621us total) trans 21474840592 rc 0/0 00000100:00100000:3.0:1746147185.146110:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11492 00000100:00100000:3.0:1746147185.146119:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11493 00000100:00100000:3.0:1746147185.146122:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466374528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.146191:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466374528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (680us total) trans 17179873188 rc 0/0 00000100:00100000:3.0:1746147185.146196:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11493 00000100:00100000:3.0:1746147185.146203:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11494 00000100:00100000:3.0:1746147185.146206:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466375040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.146290:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466375040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (758us total) trans 17179873189 rc 0/0 00000100:00100000:3.0:1746147185.146294:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11494 00000100:00100000:3.0:1746147185.146302:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11495 00000100:00100000:3.0:1746147185.146306:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466375552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.146391:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466375552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (840us total) trans 21474840593 rc 0/0 00000100:00100000:3.0:1746147185.146396:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11495 00000100:00100000:3.0:1746147185.146403:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11496 00000100:00100000:3.0:1746147185.146406:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466376064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147185.146473:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.146475:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.146477:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.146478:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.146480:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147185.146496:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466376064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (928us total) trans 21474840594 rc 0/0 00000100:00100000:3.0:1746147185.146500:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11496 00000100:00100000:3.0:1746147185.146509:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11497 00000100:00100000:3.0:1746147185.146513:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466376576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147185.146590:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:3.0:1746147185.146592:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.146594:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.146596:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.146597:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:3.0:1746147185.146624:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466376576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1041us total) trans 21474840595 rc 0/0 00000100:00100000:3.0:1746147185.146629:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11497 00010000:00010000:3.0:1746147185.146646:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146653:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146659:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146663:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dcc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.146666:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146671:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146681:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.146684:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147185.146687:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.146691:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac6191 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000004:00080000:3.0:1746147185.146716:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd180/2, rc 0, transno 17179873188 00000100:00100000:3.0:1746147185.146720:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466374528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.146725:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936de680/2, rc 0, transno 17179873189 00000100:00100000:3.0:1746147185.146727:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375040:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.146732:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df480/2, rc 0, transno 21474840593 00000100:00100000:3.0:1746147185.146734:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375552:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147185.146739:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009050b800/2, rc 0, transno 21474840594 00000100:00100000:3.0:1746147185.146741:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376064:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147185.146745:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a80f800/2, rc 0, transno 21474840595 00000100:00100000:3.0:1746147185.146747:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147185.146751:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc700/2, rc 0, transno 17179873186 00000100:00100000:3.0:1746147185.146753:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466374656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.146757:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc000/2, rc 0, transno 17179873187 00000100:00100000:3.0:1746147185.146759:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.146763:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090509880/2, rc 0, transno 21474840591 00000100:00100000:3.0:1746147185.146765:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466375680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147185.146769:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047480/2, rc 0, transno 21474840592 00000100:00100000:3.0:1746147185.146771:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466376192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.160665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.162441:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659648 00000100:00100000:3.0:1746147185.162452:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659648 00000100:00100000:3.0:1746147185.162514:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10454 00000100:00100000:3.0:1746147185.162523:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28809:x1830967463659648:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147185.162543:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.162560:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64cc expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.162607:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.162632:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.162651:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.162653:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147185.162656:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dde00, rc 0) 00000100:00100000:3.0:1746147185.162717:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28809:x1830967463659648:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 195us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.162724:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10454 00000100:00100000:0.0:1746147185.168809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.168885:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463659776 00000100:00100000:2.0:1746147185.168894:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463659776 00000100:00100000:2.0:1746147185.168961:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 585 00000100:00100000:2.0:1746147185.168969:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:28809:x1830967463659776:12345-192.168.203.36@tcp:103:mirror_io.0 00010000:00010000:2.0:1746147185.168982:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.169003:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6152 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64be expref: 8 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.169016:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.169020:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.169068:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+7:28809:x1830967463659776:12345-192.168.203.36@tcp:103:mirror_io.0 Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.169075:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 585 00000100:00100000:0.0:1746147185.172497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.172576:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463660032 00000100:00100000:2.0:1746147185.172585:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463660032 00000100:00100000:2.0:1746147185.172632:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4132 00000100:00100000:2.0:1746147185.172643:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28809:x1830967463660032:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147185.172840:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28809:x1830967463660032:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 197us (349us total) trans 8589944198 rc 0/0 00000100:00100000:2.0:1746147185.172846:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4132 00000100:00100000:0.0:1746147185.177331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.177390:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463660288 00000100:00100000:2.0:1746147185.177398:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463660288 00000100:00100000:2.0:1746147185.177439:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4133 00000100:00100000:2.0:1746147185.177444:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28809:x1830967463660288:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147185.177596:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:28809:x1830967463660288:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 150us (272us total) trans 8589944199 rc 0/0 00000100:00100000:2.0:1746147185.177603:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4133 00000100:00100000:0.0:1746147185.203480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.203560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.203647:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463660544 00000100:00100000:3.0:1746147185.203657:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463660544 00000100:00100000:3.0:1746147185.203692:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463660800 00000100:00100000:3.0:1746147185.203694:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463660800 00000100:00100000:3.0:1746147185.203711:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10455 00000100:00100000:3.0:1746147185.203718:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28819:x1830967463660544:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147185.203726:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10456 00000100:00100000:2.0:1746147185.203734:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28820:x1830967463660800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.203738:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.203742:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.203753:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac61a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64d3 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.203753:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013666d400/0xb4b2209fbdac619f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64da expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.203845:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.203850:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.203855:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203863:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203872:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203880:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203885:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203986:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203993:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.203998:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147185.204005:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147185.204008:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204111:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204111:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204117:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.204122:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204122:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204126:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.204128:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204130:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.204133:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204135:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204144:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147185.204147:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.204150:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204154:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac61ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204177:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204182:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.204185:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204187:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.204191:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204191:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.204193:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.204197:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204198:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147185.204203:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.204203:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48500) 00010000:00010000:2.0:1746147185.204205:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.204207:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204211:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac61bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.204236:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013666d400/0xb4b2209fbdac619f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.204240:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204246:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204249:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.204250:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204254:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dcc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.204254:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.204256:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.204256:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147185.204258:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20600, rc 0) 00010000:00010000:3.0:1746147185.204261:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204267:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147185.204269:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.204272:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204279:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac61b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204291:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204296:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147185.204296:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28820:x1830967463660800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 564us (736us total) trans 8589944200 rc 0/0 00010000:00010000:3.0:1746147185.204301:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147185.204302:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10456 00010000:00010000:3.0:1746147185.204305:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dac4a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.204307:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204310:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204316:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48500) 00010000:00010000:3.0:1746147185.204317:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.204319:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204323:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac61d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.204346:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac61a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 304 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.204354:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.204364:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.204365:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147185.204367:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efdd200, rc 0) 00000100:00100000:3.0:1746147185.204385:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28819:x1830967463660544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 668us (913us total) trans 8589944201 rc 0/0 00000100:00100000:3.0:1746147185.204391:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10455 00000100:00100000:0.0:1746147185.210826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.210902:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661056 00000100:00100000:2.0:1746147185.210910:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661056 00000100:00100000:2.0:1746147185.210966:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4134 00000100:00100000:2.0:1746147185.210974:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28819:x1830967463661056:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147185.211152:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28819:x1830967463661056:12345-192.168.203.36@tcp:35:cat.0 Request processed in 178us (331us total) trans 8589944202 rc 0/0 00000100:00100000:2.0:1746147185.211159:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4134 00000100:00100000:0.0:1746147185.212712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.212736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.212757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.212776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.212794:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661184 00000100:00100000:3.0:1746147185.212800:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661184 00000100:00100000:0.0:1746147185.212801:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661440 00000100:00100000:0.0:1746147185.212804:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661440 00000100:00100000:0.0:1746147185.212836:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661312 00000100:00100000:0.0:1746147185.212838:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661312 00000100:00100000:3.0:1746147185.213035:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661568 00000100:00100000:3.0:1746147185.213038:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661568 00000100:00100000:0.0:1746147185.213046:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11498 00000100:00100000:0.0:1746147185.213054:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463661440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.213066:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.213082:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64ef expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147185.213174:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x6814176f, atime: 0x6814176e, ctime: 0x6814176f, blocks: 0x81f 00000100:00100000:3.0:1746147185.213280:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11499 00000100:00100000:3.0:1746147185.213286:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463661184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.213295:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.213304:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64e1 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.213318:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x6814176b, atime: 0x6814176b, ctime: 0x6814176b, blocks: 0x7f7 00010000:00010000:3.0:1746147185.213332:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213333:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213340:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 34 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213351:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 34 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213358:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff6400, rc 0) 00000100:00100000:3.0:1746147185.213392:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463661184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.213398:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11499 00000100:00100000:3.0:1746147185.213412:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11500 00000100:00100000:3.0:1746147185.213416:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463661312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.213422:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.213429:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64e8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.213439:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814176e, atime: 0x6814176e, ctime: 0x6814176e, blocks: 0x821 00010000:00010000:3.0:1746147185.213446:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213447:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213450:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213458:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213465:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff6000, rc 0) 00000100:00100000:3.0:1746147185.213480:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463661312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.213485:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11500 00000100:00100000:3.0:1746147185.213496:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11501 00000100:00100000:3.0:1746147185.213500:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463661568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.213505:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.213514:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64f6 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.213524:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x81f 00010000:00010000:3.0:1746147185.213531:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213532:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.213536:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 34 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213544:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 34 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.213550:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff6600, rc 0) 00010000:00010000:0.0:1746147185.213559:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.213561:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147185.213563:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463661568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (787us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147185.213567:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 35 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147185.213568:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11501 00010000:00010000:0.0:1746147185.213578:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 35 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.213585:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487600, rc 0) 00000100:00100000:0.0:1746147185.213600:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463661440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 548us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.213606:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11498 00000100:00100000:1.0:1746147185.214329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.214391:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662208 00000100:00100000:3.0:1746147185.214396:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662208 00000100:00100000:3.0:1746147185.214429:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10457 00000100:00100000:3.0:1746147185.214435:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28815:x1830967463662208:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147185.214448:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.214457:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6a00/0xb4b2209fbdac6201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6512 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.214527:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.214538:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.214549:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.214554:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.214578:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.214587:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 305 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.214597:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376704:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.214607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.214649:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661696 00000100:00100000:1.0:1746147185.214652:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661696 00000100:00100000:1.0:1746147185.214680:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11502 00000100:00100000:1.0:1746147185.214685:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463661696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.214692:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.214700:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e64fd expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147185.214714:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4926336, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x1567 00010000:00010000:1.0:1746147185.214722:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.214723:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.214727:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.214737:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.214743:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbe00, rc 0) 00000100:00100000:0.0:1746147185.215800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.215827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.215839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.215840:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661824 00000100:00100000:2.0:1746147185.215845:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661824 00000100:00100000:0.0:1746147185.215850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.215862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.215873:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463661952 00000100:00100000:2.0:1746147185.215875:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463661952 00000100:00100000:0.0:1746147185.215882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.215894:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662336 00000100:00100000:2.0:1746147185.215896:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662336 00000100:00100000:2.0:1746147185.215906:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662464 00000100:00100000:2.0:1746147185.215907:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662464 00000100:00100000:2.0:1746147185.215912:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662592 00000100:00100000:2.0:1746147185.215913:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662592 00000100:00100000:2.0:1746147185.215918:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662720 00000100:00100000:2.0:1746147185.215920:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662720 00000100:00100000:2.0:1746147185.215928:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11503 00000100:00100000:2.0:1746147185.215933:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463661824:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147185.215949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147185.215953:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147185.215962:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662848 00010000:00010000:2.0:1746147185.215963:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6504 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.215965:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662848 00002000:00010000:2.0:1746147185.215976:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x1029 00000100:00100000:0.0:1746147185.215979:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11504 00000100:00100000:0.0:1746147185.215984:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463661952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.215985:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.215986:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.215991:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.215991:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.215998:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e650b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.216001:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216007:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dce00, rc 0) 00010000:00010000:0.0:1746147185.216012:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216014:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216017:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.216027:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147185.216033:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463661824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 100us (235us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147185.216033:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:2.0:1746147185.216039:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11503 00000100:00100000:0.0:1746147185.216049:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463661952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.216053:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11504 00000100:00100000:2.0:1746147185.216057:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11505 00000100:00100000:2.0:1746147185.216062:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463662336:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147185.216063:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11506 00010000:00010000:2.0:1746147185.216067:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147185.216068:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463662464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.216074:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6519 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216074:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.216079:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6520 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.216082:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216084:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216088:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.216088:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216090:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216093:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216095:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216102:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dd000, rc 0) 00010000:00010000:0.0:1746147185.216102:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.216113:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487800, rc 0) 00000100:00100000:2.0:1746147185.216118:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463662336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.216122:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11505 00000100:00100000:2.0:1746147185.216131:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11507 00000100:00100000:2.0:1746147185.216136:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463662592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.216141:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.216148:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6527 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.216155:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216156:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216160:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216168:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216174:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20200, rc 0) 00000100:00100000:2.0:1746147185.216188:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463662592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.216196:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11507 00000100:00100000:2.0:1746147185.216204:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11508 00000100:00100000:2.0:1746147185.216209:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463662720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.216214:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.216219:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e652e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.216228:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216229:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.216232:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216240:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.216246:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20a00, rc 0) 00000100:00100000:2.0:1746147185.216260:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463662720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.216262:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11509 00000100:00100000:2.0:1746147185.216266:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11508 00000100:00100000:3.0:1746147185.216269:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463662848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.216275:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.216281:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6535 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.216290:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.216292:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.216295:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.216303:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.216313:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff7200, rc 0) 00000100:00100000:3.0:1746147185.216330:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463662848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 62us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.216334:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11509 00010000:00010000:3.0:1746147185.216378:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.216387:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 7 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.216395:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e137100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.216426:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.216488:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463661696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1801us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.216497:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11502 00000100:00100000:0.0:1746147185.216531:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463662464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 57us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.216537:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11506 00000100:00100000:0.0:1746147185.219630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.219664:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.219673:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e137100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376832:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.219690:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147185.219760:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463663104 00000100:00100000:0.0:1746147185.219760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.219767:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463663104 00010000:00010000:1.0:1746147185.219795:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 8 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.219835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.219857:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463662976 00000100:00100000:1.0:1746147185.219860:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463662976 00000100:00100000:0.0:1746147185.219862:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463663232 00000100:00100000:0.0:1746147185.219864:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463663232 00000100:00100000:2.0:1746147185.219868:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5670 00010000:00010000:1.0:1746147185.219872:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.219878:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1959:x1830967463663104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147185.219881:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10458 00000100:00100000:1.0:1746147185.219883:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5671 00000100:00100000:0.0:1746147185.219885:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28820:x1830967463663232:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147185.219887:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1959:x1830967463662976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.219890:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.219892:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.219895:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 9 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.219896:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.219899:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.219902:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.219909:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac6247 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e653c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.220053:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.220069:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac61c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64da expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.220084:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.220087:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.220094:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.220099:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147185.220105:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac6247 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e653c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.220115:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac6247 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e653c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.220130:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.220133:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147185.220135:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487e00, rc 0) 00010000:00010000:1.0:1746147185.220149:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac61d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64d3 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.220159:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28820:x1830967463663232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 273us (323us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147185.220161:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.220164:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.220167:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10458 00010000:00010000:1.0:1746147185.220169:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.220174:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.220186:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.220202:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1959:x1830967463662976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 314us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.220208:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5671 00010000:00010000:1.0:1746147185.220223:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.220228:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147185.220239:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147185.220330:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6a00/0xb4b2209fbdac6201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.220339:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.220344:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.220346:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147185.220348:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff6c00, rc 0) 00000100:00100000:1.0:1746147185.220363:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28815:x1830967463662208:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5929us (6036us total) trans 8589944203 rc 0/0 00000100:00100000:1.0:1746147185.220373:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10457 00000100:00100000:2.0:1746147185.220601:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1959:x1830967463663104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 725us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.220607:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5670 00000100:00100000:0.0:1746147185.220882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.220933:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463663360 00000100:00100000:1.0:1746147185.220955:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463663360 00000100:00100000:1.0:1746147185.220974:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10459 00000100:00100000:1.0:1746147185.220978:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28819:x1830967463663360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.220986:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.220993:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6543 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.221014:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.221021:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.221030:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.221031:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147185.221033:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4ba200, rc 0) 00000100:00100000:1.0:1746147185.221061:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28819:x1830967463663360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.221066:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10459 00000100:00100000:0.0:1746147185.228269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.228513:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463663616 00000100:00100000:2.0:1746147185.228522:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463663616 00000100:00100000:2.0:1746147185.228568:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10460 00000100:00100000:2.0:1746147185.228576:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28822:x1830967463663616:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147185.228594:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.228609:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac625c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e654a expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.228698:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228708:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228716:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228727:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228733:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228737:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228813:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac6271 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228820:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac6271 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228825:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac6271 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147185.228830:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.228891:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228897:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228901:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228906:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9b3400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.228908:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228914:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228922:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147185.228924:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.228927:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228931:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac6263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228980:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228984:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228988:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228991:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9b3200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.228994:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.228998:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.229004:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008dc4ba00) 00010000:00010000:2.0:1746147185.229006:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.229007:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.229011:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac626a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.229040:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac625c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e654a expref: 11 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.229049:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac6271 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e654a expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.229054:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.229056:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147185.229058:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b2800, rc 0) 00000100:00100000:2.0:1746147185.229091:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28822:x1830967463663616:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 516us (829us total) trans 8589944204 rc 0/0 00000100:00100000:2.0:1746147185.229097:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10460 00000100:00100000:0.0:1746147185.229978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.230007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.230025:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463663872 00000100:00100000:3.0:1746147185.230030:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463663872 00000100:00100000:0.0:1746147185.230030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147185.230056:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008e977800 x1830967463663872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.230064:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967463663872 ext(0->1048575) 00002000:00010000:3.0:1746147185.230067:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:3.0:1746147185.230423:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463664384 00000100:00100000:3.0:1746147185.230426:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463664384 00002000:00100000:3.0:1746147185.230440:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a4faf480 x1830967463664384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.230446:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967463664384 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.230449:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faf480 00000100:00100000:3.0:1746147185.230457:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463664256 00000100:00100000:3.0:1746147185.230459:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463664256 00002000:00100000:3.0:1746147185.230467:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a4fac380 x1830967463664256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147185.230469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147185.230473:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967463664256 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.230475:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac380 00000100:00100000:3.0:1746147185.230482:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463664640 00000100:00100000:3.0:1746147185.230483:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463664640 00002000:00100000:3.0:1746147185.230490:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4faca80 x1830967463664640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.230496:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967463664640 ext(1048576->2097151) 00000100:00100000:0.0:1746147185.230497:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4363 00002000:00010000:3.0:1746147185.230499:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:0.0:1746147185.230503:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463663872:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.230795:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4364 00000100:00100000:3.0:1746147185.230801:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463664384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.230883:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4365 00000100:00100000:2.0:1746147185.230889:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463664256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.230921:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4366 00000100:00100000:3.0:1746147185.230926:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463664640:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.235185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.235212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.237542:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463664896 00000100:00100000:0.0:1746147185.237553:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463664896 00002000:00100000:0.0:1746147185.237596:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008e137100 x1830967463664896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.237605:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137100 with x1830967463664896 ext(0->1048575) 00002000:00010000:0.0:1746147185.237620:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137100 00000100:00100000:0.0:1746147185.237634:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463665152 00000100:00100000:0.0:1746147185.237637:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463665152 00002000:00100000:0.0:1746147185.237648:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008e136300 x1830967463665152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.237654:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136300 with x1830967463665152 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.237657:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e136300 00000100:00100000:0.0:1746147185.237665:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4367 00000100:00100000:0.0:1746147185.237671:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463664896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.237701:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4368 00000100:00100000:1.0:1746147185.237708:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463665152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.237805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.238051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.238098:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463665408 00000100:00100000:1.0:1746147185.238106:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463665408 00002000:00100000:1.0:1746147185.238119:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a044aa00 x1830967463665408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.238125:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967463665408 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.238127:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044aa00 00000100:00100000:1.0:1746147185.238137:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463665664 00000100:00100000:1.0:1746147185.238139:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463665664 00002000:00100000:1.0:1746147185.238147:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fadf80 x1830967463665664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.238153:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadf80 with x1830967463665664 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.238156:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadf80 00000100:00100000:1.0:1746147185.238164:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4369 00000100:00100000:1.0:1746147185.238169:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463665408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.238394:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4370 00000100:00100000:0.0:1746147185.238400:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463665664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.256390:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463664640:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25452us (25908us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.256401:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4366 00002000:00100000:3.0:1746147185.256416:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4faca80 x1830967463664640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.256425:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faca80 with x1830967463664640 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.256430:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4faca80 00000100:00100000:1.0:1746147185.265246:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463664384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34431us (35224us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.265258:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4364 00002000:00100000:1.0:1746147185.265272:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a4faf480 x1830967463664384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.265281:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967463664384 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.265295:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faf480 00000100:00100000:2.0:1746147185.276048:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463665664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 37531us (37880us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.276061:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4370 00002000:00100000:2.0:1746147185.276076:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fadf80 x1830967463665664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.276084:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fadf80 with x1830967463665664 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.276090:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fadf80 00000100:00100000:0.0:1746147185.277194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.278872:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463665408:12345-192.168.203.36@tcp:3:cat.0 Request processed in 40697us (41061us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.278882:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4369 00002000:00100000:1.0:1746147185.278892:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a044aa00 x1830967463665408/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.278900:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967463665408 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.278904:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044aa00 00000100:00100000:1.0:1746147185.278930:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463665920 00000100:00100000:1.0:1746147185.278948:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463665920 00000100:00100000:1.0:1746147185.279014:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10461 00000100:00100000:1.0:1746147185.279024:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28822:x1830967463665920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147185.279043:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.279048:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746147185.279072:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b2800/0xb4b2209fbdac6271 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e654a expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279102:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac6247 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e653c expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279112:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.279116:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147185.279128:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19000/0xb4b2209fbdac627f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6551 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279174:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.279196:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279203:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279209:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.279239:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279255:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 305 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.279266:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376960:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.279363:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.279372:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.280309:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377088:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.280354:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.282069:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463663872:12345-192.168.203.36@tcp:3:cat.0 Request processed in 51560us (52086us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.282078:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4363 00002000:00100000:3.0:1746147185.282086:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008e977800 x1830967463663872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.282094:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977800 with x1830967463663872 ext(0->1048575) 00002000:00010000:3.0:1746147185.282098:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977800 00000100:00100000:0.0:1746147185.283766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.283873:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666048 00000100:00100000:2.0:1746147185.283881:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666048 00010000:00010000:2.0:1746147185.283911:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.283955:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5672 00000100:00100000:1.0:1746147185.283958:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466376960:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.283965:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+306:1956:x1830967463666048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.283977:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.283982:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.283991:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.284009:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6255 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6543 expref: 306 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.284036:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.284040:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.284047:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.284051:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.284097:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1956:x1830967463666048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.284103:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5672 00000100:00100000:0.0:1746147185.285291:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463664256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 54399us (55257us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.285299:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4365 00002000:00100000:0.0:1746147185.285308:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a4fac380 x1830967463664256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.285316:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967463664256 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.285320:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4fac380 00000100:00100000:0.0:1746147185.290103:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463664896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 52421us (54913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.290114:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4367 00002000:00100000:0.0:1746147185.290127:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008e137100 x1830967463664896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.290136:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137100 with x1830967463664896 ext(0->1048575) 00002000:00010000:0.0:1746147185.290141:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137100 00000100:00100000:0.0:1746147185.301647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.301723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.301745:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666304 00000100:00100000:0.0:1746147185.301752:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666304 00010000:00010000:0.0:1746147185.301781:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.301825:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5673 00000100:00100000:0.0:1746147185.301833:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463666304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.301846:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.301852:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.301861:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.301878:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.301882:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.301890:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.301895:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.301908:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.301959:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463666304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.301965:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5673 00000100:00100000:2.0:1746147185.302085:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666176 00000100:00100000:2.0:1746147185.302089:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666176 00000100:00100000:2.0:1746147185.302111:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10462 00000100:00100000:2.0:1746147185.302116:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28819:x1830967463666176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.302131:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.302141:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6558 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.302174:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.302181:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.302191:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.302198:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.302206:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.302208:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147185.302210:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.302215:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3400, rc 0) 00000100:00100000:2.0:1746147185.302234:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28819:x1830967463666176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.302239:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10462 00010000:00010000:1.0:1746147185.302354:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6198 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64cc expref: 8 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.302371:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377088:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.302387:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.302393:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.302398:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000040:00080000:1.0:1746147185.302901:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2888, 88 off239856 00000004:00080000:1.0:1746147185.302907:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572289969680ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.302971:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2842, 88 off235800 00000004:00080000:1.0:1746147185.302975:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290037608ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.302987:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2843, 88 off235888 00000004:00080000:1.0:1746147185.302990:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290053215ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.302998:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2889, 88 off239944 00000004:00080000:1.0:1746147185.303001:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290063764ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303007:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2890, 88 off240032 00000004:00080000:1.0:1746147185.303010:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290072330ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303016:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2844, 88 off235976 00000004:00080000:1.0:1746147185.303018:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290080958ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.303024:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2845, 88 off236064 00000004:00080000:1.0:1746147185.303026:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290089139ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.303032:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2846, 88 off236152 00000004:00080000:1.0:1746147185.303033:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290096228ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.303039:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2891, 88 off240120 00000004:00080000:1.0:1746147185.303041:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290103885ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303047:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2847, 88 off236240 00000004:00080000:1.0:1746147185.303049:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290111842ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.303055:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2892, 88 off240208 00000004:00080000:1.0:1746147185.303057:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290119645ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303062:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2848, 88 off236328 00000004:00080000:1.0:1746147185.303064:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290126875ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147185.303070:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2893, 88 off240296 00000004:00080000:1.0:1746147185.303072:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290134718ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303077:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2894, 88 off240384 00000004:00080000:1.0:1746147185.303080:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290142525ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303086:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2895, 88 off240472 00000004:00080000:1.0:1746147185.303088:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290151008ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303094:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2896, 88 off240560 00000004:00080000:1.0:1746147185.303096:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572290158358ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147185.303102:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2849, 88 off236416 00000004:00080000:1.0:1746147185.303104:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572290166395ns, next at 537465048041ns, rc = 0 00000100:00100000:1.0:1746147185.305515:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463665152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 67800us (70294us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.305526:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4368 00002000:00100000:1.0:1746147185.305537:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008e136300 x1830967463665152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.305545:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136300 with x1830967463665152 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.305549:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e136300 00000100:00100000:2.0:1746147185.314553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.314584:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666432 00000100:00100000:2.0:1746147185.314594:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666432 00000100:00100000:2.0:1746147185.314646:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10463 00000100:00100000:2.0:1746147185.314657:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28820:x1830967463666432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.314675:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.314693:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e655f expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.314742:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.314752:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.314762:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.314765:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147185.314769:0:16361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.314775:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea2f000, rc 0) 00000100:00100000:2.0:1746147185.314821:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28820:x1830967463666432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 166us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.314827:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10463 00010000:00010000:1.0:1746147185.325874:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325886:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.325889:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147185.325893:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325903:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325909:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325920:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325925:0:14049:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325930:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.325992:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 12 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.326003:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377216:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147185.326085:0:14049:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.326093:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377344:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147185.326110:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455f00 going to sleep for 11 seconds 00000001:00080000:3.0:1746147185.326234:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944205 is committed 00000004:00080000:3.0:1746147185.326240:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1984 committed 00000004:00080000:3.0:1746147185.326246:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:3.0:1746147185.326250:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000004:00080000:3.0:1746147185.326251:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000004:00080000:3.0:1746147185.326252:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:3.0:1746147185.326254:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1983 committed 00000004:00080000:3.0:1746147185.326255:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000004:00080000:3.0:1746147185.326256:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1982 committed 00000004:00080000:3.0:1746147185.326257:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:3.0:1746147185.326259:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1981 committed 00000004:00080000:3.0:1746147185.326260:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1980 committed 00000004:00080000:3.0:1746147185.326261:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1979 committed 00000004:00080000:3.0:1746147185.326263:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:3.0:1746147185.326264:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000004:00080000:3.0:1746147185.326266:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1978 committed 00000004:00080000:3.0:1746147185.326268:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00000004:00080000:3.0:1746147185.326269:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000001:00080000:3.0:1746147185.326274:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944203 is committed 00000001:00080000:3.0:1746147185.326284:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944199 is committed 00000100:00100000:0.0:1746147185.326841:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147185.326851:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.326877:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.326897:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466377472 00000100:00100000:0.0:1746147185.326902:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466377472 00000100:00100000:0.0:1746147185.326926:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11510 00000100:00100000:0.0:1746147185.326933:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466377472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.326984:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466377728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.327003:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.327016:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.327027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.327036:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.327047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.327058:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466379264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.327069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.327079:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147185.327083:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466377600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.327096:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.327105:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378112:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.327110:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.327112:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147182 -> 1746147182 00002000:00010000:0.0:1746147185.327114:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147182 -> 1746147182 00002000:00010000:0.0:1746147185.327115:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147182 -> 1746147182 00000100:00100000:1.0:1746147185.327116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147185.327116:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147185.327136:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967466377472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (258us total) trans 17179873190 rc 0/0 00000100:00100000:0.0:1746147185.327140:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11510 00000100:00100000:1.0:1746147185.327830:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.327847:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.327892:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466377728 00000100:00100000:0.0:1746147185.327895:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466377728 00000100:00100000:3.0:1746147185.328008:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378240 00000100:00100000:3.0:1746147185.328012:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378240 00000100:00100000:3.0:1746147185.328030:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378752 00000100:00100000:3.0:1746147185.328032:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378752 00000100:00100000:3.0:1746147185.328043:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466379264 00000100:00100000:3.0:1746147185.328045:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466379264 00000100:00100000:3.0:1746147185.328052:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466377600 00000100:00100000:3.0:1746147185.328054:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466377600 00000100:00100000:3.0:1746147185.328060:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378112 00000100:00100000:3.0:1746147185.328061:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378112 00000100:00100000:3.0:1746147185.328069:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11511 00000100:00100000:3.0:1746147185.328074:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466377728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.328168:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.328171:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:3.0:1746147185.328173:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:3.0:1746147185.328174:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:3.0:1746147185.328176:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147185.328512:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378624 00000100:00100000:2.0:1746147185.328516:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378624 00000100:00100000:2.0:1746147185.328531:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11512 00000100:00100000:2.0:1746147185.328536:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466378240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.328630:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:2.0:1746147185.328632:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.328634:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.328635:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.328637:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:0.0:1746147185.328688:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11513 00000100:00100000:0.0:1746147185.328694:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3296:x1830967466378752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.328861:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466379136:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.328871:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4926336 -> 4926336 00002000:00010000:0.0:1746147185.328874:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.328876:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.328877:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.328879:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:1.0:1746147185.328881:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329001:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466378752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (1951us total) trans 21474840596 rc 0/0 00000100:00100000:2.0:1746147185.329007:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466378240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 470us (1977us total) trans 17179873192 rc 0/0 00000100:00100000:0.0:1746147185.329007:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11513 00000100:00100000:2.0:1746147185.329014:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11512 00000100:00100000:0.0:1746147185.329017:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466379136 00000100:00100000:0.0:1746147185.329019:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466379136 00000100:00100000:2.0:1746147185.329025:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11514 00000100:00100000:2.0:1746147185.329030:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466379264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.329031:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11515 00000100:00100000:0.0:1746147185.329034:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466377600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.329099:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.329102:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147183 -> 1746147183 00002000:00010000:0.0:1746147185.329103:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147182 -> 1746147182 00002000:00010000:2.0:1746147185.329104:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.329105:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147183 -> 1746147183 00002000:00010000:2.0:1746147185.329107:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.329107:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746147185.329108:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.329110:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.329111:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:2.0:1746147185.329130:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466379264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (2060us total) trans 21474840597 rc 0/0 00000100:00100000:2.0:1746147185.329135:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11514 00000100:00100000:2.0:1746147185.329144:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11516 00000100:00100000:2.0:1746147185.329148:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466378112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.329190:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466377600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (2092us total) trans 17179873193 rc 0/0 00000100:00100000:0.0:1746147185.329195:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11515 00000100:00100000:0.0:1746147185.329203:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11517 00000100:00100000:0.0:1746147185.329207:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466378624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.329212:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147185.329214:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.329215:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.329217:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.329218:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147185.329236:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466378112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (2118us total) trans 17179873194 rc 0/0 00000100:00100000:2.0:1746147185.329240:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11516 00000100:00100000:2.0:1746147185.329249:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11518 00000100:00100000:2.0:1746147185.329253:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466379136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.329274:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.329277:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.329278:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.329280:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.329282:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147185.329298:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466378624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (1450us total) trans 21474840598 rc 0/0 00000100:00100000:0.0:1746147185.329302:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11517 00000100:00100000:0.0:1746147185.329317:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.329333:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329344:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.329356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.329358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.329365:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.329376:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329385:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.329388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.329396:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.329403:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666560 00000100:00100000:2.0:1746147185.329406:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666560 00000004:00080000:0.0:1746147185.329414:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448700/2, rc 0, transno 17179873190 00000100:00100000:0.0:1746147185.329419:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.329422:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666688 00000100:00100000:2.0:1746147185.329424:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666688 00000100:00100000:0.0:1746147185.329425:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746147185.329429:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.329436:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4135 00000100:00100000:2.0:1746147185.329440:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28819:x1830967463666560:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147185.329440:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329447:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.329458:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329464:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.329475:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.329491:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4136 00000100:00100000:0.0:1746147185.329496:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28820:x1830967463666688:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:2.0:1746147185.329503:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28819:x1830967463666560:12345-192.168.203.36@tcp:49:cat.0 Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.329508:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4135 00000100:00100000:0.0:1746147185.329530:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28820:x1830967463666688:12345-192.168.203.36@tcp:49:cat.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.329535:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4136 00000100:00100000:0.0:1746147185.329554:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466377856 00000100:00100000:0.0:1746147185.329556:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466377856 00000100:00100000:2.0:1746147185.329559:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378368 00000100:00100000:2.0:1746147185.329562:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378368 00000100:00100000:0.0:1746147185.329565:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378880 00000100:00100000:0.0:1746147185.329567:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378880 00000100:00100000:2.0:1746147185.329571:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466379392 00000100:00100000:2.0:1746147185.329573:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466379392 00000100:00100000:0.0:1746147185.329574:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466377984 00000100:00100000:0.0:1746147185.329575:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466377984 00000100:00100000:2.0:1746147185.329580:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466378496 00000100:00100000:2.0:1746147185.329581:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466378496 00000100:00100000:0.0:1746147185.329582:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466379008 00000100:00100000:0.0:1746147185.329584:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466379008 00000100:00100000:2.0:1746147185.329589:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11519 00000100:00100000:2.0:1746147185.329593:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466377856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.329602:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11520 00000100:00100000:0.0:1746147185.329606:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466378368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.329685:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.329687:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.329688:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.329690:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.329692:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147185.329715:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466378368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (357us total) trans 17179873195 rc 0/0 00000100:00100000:0.0:1746147185.329719:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11520 00000100:00100000:0.0:1746147185.329728:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11521 00000100:00100000:0.0:1746147185.329731:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466378880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.329791:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466377728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1716us (2786us total) trans 17179873191 rc 0/0 00000100:00100000:3.0:1746147185.329797:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11511 00000100:00100000:0.0:1746147185.329810:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466378880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (431us total) trans 21474840599 rc 0/0 00000100:00100000:0.0:1746147185.329814:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11521 00000100:00100000:0.0:1746147185.329824:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11522 00000100:00100000:0.0:1746147185.329827:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466379392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.329893:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147185.329895:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.329897:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.329898:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.329900:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:3.0:1746147185.329901:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11523 00000100:00100000:3.0:1746147185.329906:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967466377984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.329918:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466379392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (521us total) trans 21474840600 rc 0/0 00000100:00100000:0.0:1746147185.329923:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11522 00000100:00100000:0.0:1746147185.329932:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11524 00000100:00100000:0.0:1746147185.329953:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466378496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.330006:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466377984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (564us total) trans 17179873196 rc 0/0 00000100:00100000:3.0:1746147185.330010:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11523 00002000:00010000:0.0:1746147185.330019:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746147185.330020:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11525 00002000:00010000:0.0:1746147185.330021:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147179 -> 1746147179 00002000:00010000:0.0:1746147185.330022:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147179 -> 1746147179 00002000:00010000:0.0:1746147185.330023:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147179 -> 1746147179 00000100:00100000:3.0:1746147185.330024:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466379008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.330024:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:0.0:1746147185.330043:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466378496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (584us total) trans 21474840601 rc 0/0 00000100:00100000:0.0:1746147185.330047:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11524 00000004:00080000:0.0:1746147185.330066:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0448a80/2, rc 0, transno 17179873196 00000100:00100000:0.0:1746147185.330070:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.330076:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b6ba680/2, rc 0, transno 21474840601 00000100:00100000:0.0:1746147185.330084:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378496:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147185.330086:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.330089:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00000004:00080000:0.0:1746147185.330089:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b6b8e00/2, rc 0, transno 17179873195 00002000:00010000:3.0:1746147185.330090:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147185.330091:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378368:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.330092:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.330093:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:0.0:1746147185.330096:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edc9880/2, rc 0, transno 21474840599 00000100:00100000:0.0:1746147185.330098:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466378880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.330103:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937ece00/2, rc 0, transno 21474840600 00000100:00100000:0.0:1746147185.330105:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.330109:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466379008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (632us total) trans 21474840602 rc 0/0 00000004:00080000:0.0:1746147185.330112:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcbb80/2, rc 0, transno 21474840602 00000100:00100000:3.0:1746147185.330113:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11525 00000100:00100000:0.0:1746147185.330114:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.330148:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147185.330154:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.330169:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.330260:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466379520 00000100:00100000:1.0:1746147185.330264:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466379520 00000100:00100000:1.0:1746147185.330282:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11526 00000100:00100000:1.0:1746147185.330286:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466379520:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.330291:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044b800/2, rc 0, transno 17179873193 00000100:00100000:0.0:1746147185.330295:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466377600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.330301:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b6b9f80/2, rc 0, transno 17179873194 00000100:00100000:0.0:1746147185.330304:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.330310:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e682300/2, rc 0, transno 21474840598 00000100:00100000:0.0:1746147185.330312:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.330318:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a044a680/2, rc 0, transno 17179873191 00000100:00100000:0.0:1746147185.330320:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466377728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.330327:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b6bad80/2, rc 0, transno 17179873192 00000100:00100000:0.0:1746147185.330329:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.330335:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132e13b80/2, rc 0, transno 21474840596 00000100:00100000:0.0:1746147185.330337:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466378752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.330343:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937ee680/2, rc 0, transno 21474840597 00000100:00100000:0.0:1746147185.330345:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466379264:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147185.330356:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147185.330358:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147185.330360:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147185.330361:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147185.330362:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147185.330390:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466379520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (219us total) trans 21474840603 rc 0/0 00000100:00100000:1.0:1746147185.330394:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11526 00000004:00080000:0.0:1746147185.330398:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03800/2, rc 0, transno 21474840603 00000100:00100000:0.0:1746147185.330400:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466379520:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.330679:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147185.330681:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.330683:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.330684:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.330685:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1746147185.330712:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466377856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1118us (1378us total) trans 17179873197 rc 0/0 00000100:00100000:2.0:1746147185.330717:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11519 00000004:00080000:0.0:1746147185.330735:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0449500/2, rc 0, transno 17179873197 00000100:00100000:0.0:1746147185.330739:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466377856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.330746:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377216:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147185.330754:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466377344:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147185.330778:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19000/0xb4b2209fbdac627f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147185.330792:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.330807:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19200, rc 0) 00000100:00100000:2.0:1746147185.331527:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28822:x1830967463665920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 52504us (54332us total) trans 8589944205 rc 0/0 00000100:00100000:2.0:1746147185.331533:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10461 00002000:00010000:2.0:1746147185.331628:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147185.331631:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.331632:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.331634:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.331636:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1746147185.331662:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967466379136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2409us (2781us total) trans 21474840604 rc 0/0 00000100:00100000:2.0:1746147185.331667:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11518 00000004:00080000:0.0:1746147185.331804:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937efb80/2, rc 0, transno 21474840604 00000100:00100000:0.0:1746147185.331809:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466379136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.339636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.339968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.340026:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666816 00000100:00100000:3.0:1746147185.340035:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666816 00000100:00100000:3.0:1746147185.340080:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11527 00000100:00100000:2.0:1746147185.340080:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463666944 00000100:00100000:2.0:1746147185.340084:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463666944 00000100:00100000:3.0:1746147185.340088:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28822:x1830967463666816:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147185.340101:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11528 00010000:00010000:3.0:1746147185.340103:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147185.340105:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28815:x1830967463666944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147185.340112:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.340116:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6566 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.340119:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e656d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.340138:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.340138:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.340145:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.340146:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.340150:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.340151:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.340152:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.340152:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.340154:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3747840->4157439] (req 3747840->4157439) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.340155:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.340178:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.340178:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.340187:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.340187:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 21 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.340197:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466379648:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.340197:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466379776:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.340281:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.340282:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 35 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.340288:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 36 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.340289:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 35 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.340296:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466380032:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.340296:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466379904:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.340310:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.340310:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.341920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.342039:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466379776:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.343415:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667072 00000100:00100000:3.0:1746147185.343423:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667072 00010000:00010000:3.0:1746147185.343452:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.343476:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5674 00000100:00100000:3.0:1746147185.343483:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463667072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.343495:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.343513:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.343522:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.343539:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac6239 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e652e expref: 22 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.343551:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.343590:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463667072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.343596:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5674 00000100:00100000:1.0:1746147185.343801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.343816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.343995:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466379648:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.344002:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466380032:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.344019:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3747840->4157439] (req 3747840->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.344028:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064800, rc 0) 00000100:00100000:3.0:1746147185.344044:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28822:x1830967463666816:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3957us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.344049:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11527 00000100:00100000:0.0:1746147185.344119:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667328 00000100:00100000:0.0:1746147185.344124:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667328 00010000:00010000:0.0:1746147185.344137:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.344149:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667200 00000100:00100000:0.0:1746147185.344151:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667200 00000100:00100000:1.0:1746147185.344152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147185.344159:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.344193:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667456 00000100:00100000:0.0:1746147185.344195:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667456 00000100:00100000:2.0:1746147185.344200:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5675 00010000:00010000:0.0:1746147185.344204:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 37 pid: 6881 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.344206:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463667328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.344213:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147185.344215:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5676 00000100:00100000:0.0:1746147185.344219:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463667200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.344225:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.344225:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.344230:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.344232:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.344239:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.344253:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dce00/0xb4b2209fbdac6216 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6504 expref: 36 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.344256:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff7200/0xb4b2209fbdac6240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6535 expref: 26 pid: 4445 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.344261:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.344263:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.344268:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.344278:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.344424:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5677 00000100:00100000:3.0:1746147185.344430:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463667456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.344437:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.344446:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 37 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.344455:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 37 pid: 6881 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.344465:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.344467:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.344470:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.344476:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.344496:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.344506:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466380160:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147185.344538:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.344553:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.344553:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463667200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 332us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.344558:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5676 00010000:00010000:3.0:1746147185.344571:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac620f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64fd expref: 37 pid: 6881 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.344579:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466379904:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.344591:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.344598:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea57e00, rc 0) 00000100:00100000:3.0:1746147185.344623:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:28815:x1830967463666944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4506us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.344629:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11528 00010000:00010000:2.0:1746147185.344727:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.344736:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466380288:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147185.344754:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.345117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.346021:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667712 00000100:00100000:1.0:1746147185.346033:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667712 00002000:00100000:1.0:1746147185.346061:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134d02d80 x1830967463667712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.346069:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02d80 with x1830967463667712 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.346073:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d02d80 00000100:00100000:1.0:1746147185.346098:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4371 00000100:00100000:1.0:1746147185.346107:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463667712:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147185.357843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.358045:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463667968 00000100:00100000:2.0:1746147185.358056:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463667968 00002000:00100000:2.0:1746147185.358096:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134d02680 x1830967463667968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.358105:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02680 with x1830967463667968 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.358110:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d02680 00000100:00100000:2.0:1746147185.358129:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4372 00000100:00100000:2.0:1746147185.358136:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463667968:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147185.362817:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463667712:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16700us (17690us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.362828:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4371 00002000:00100000:1.0:1746147185.362839:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134d02d80 x1830967463667712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.362848:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02d80 with x1830967463667712 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.362853:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d02d80 00000100:00100000:3.0:1746147185.365235:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466380160:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.365252:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.365294:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463667456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 20862us (21139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.365302:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5677 00000100:00100000:1.0:1746147185.365576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.365590:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466380288:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147185.365598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147185.365599:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.365643:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463667328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 21436us (21841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.365650:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5675 00000100:00100000:1.0:1746147185.365679:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463668224 00000100:00100000:1.0:1746147185.365685:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463668224 00002000:00100000:1.0:1746147185.365755:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3039232->3043327) req@ffff8800937edf80 x1830967463668224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.365763:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edf80 with x1830967463668224 ext(3039232->3043327) 00002000:00010000:1.0:1746147185.365767:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937edf80 00000100:00100000:1.0:1746147185.365781:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463668480 00000100:00100000:1.0:1746147185.365784:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463668480 00002000:00100000:1.0:1746147185.365797:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3747840->3751935) req@ffff8800937eca80 x1830967463668480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.365803:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eca80 with x1830967463668480 ext(3747840->3751935) 00002000:00010000:1.0:1746147185.365806:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eca80 00000100:00100000:1.0:1746147185.365816:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4373 00000100:00100000:1.0:1746147185.365822:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463668224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147185.365930:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463668224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 108us (354us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147185.365960:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4373 00002000:00100000:1.0:1746147185.365966:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3039232->3043327) req@ffff8800937edf80 x1830967463668224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.365973:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edf80 with x1830967463668224 ext(3039232->3043327) 00002000:00010000:1.0:1746147185.365975:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937edf80 00000100:00100000:1.0:1746147185.365991:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4374 00000100:00100000:1.0:1746147185.365996:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463668480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147185.367061:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463668480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1061us (1458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147185.367068:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4374 00002000:00100000:1.0:1746147185.367073:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3747840->3751935) req@ffff8800937eca80 x1830967463668480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.367080:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eca80 with x1830967463668480 ext(3747840->3751935) 00002000:00010000:1.0:1746147185.367083:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eca80 00000100:00100000:0.0:1746147185.372378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.373162:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463667968:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15024us (15324us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.373172:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4372 00002000:00100000:2.0:1746147185.373183:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134d02680 x1830967463667968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.373191:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02680 with x1830967463667968 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.373196:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d02680 00000100:00100000:3.0:1746147185.373459:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463668608 00000100:00100000:3.0:1746147185.373467:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463668608 00000100:00100000:3.0:1746147185.373498:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11529 00000100:00100000:3.0:1746147185.373504:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28815:x1830967463668608:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147185.373517:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.373529:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6574 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.373553:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.373559:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147185.373560:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147185.373563:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2699263] (req 2097152->2699263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.373587:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.373596:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 24 pid: 8478 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.373606:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466380416:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.374495:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.377669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.377702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.377726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.377767:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463669120 00000100:00100000:2.0:1746147185.377777:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463669120 00002000:00100000:2.0:1746147185.377815:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (4153344->4157439) req@ffff880134d02300 x1830967463669120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.377824:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02300 with x1830967463669120 ext(4153344->4157439) 00000100:00100000:0.0:1746147185.377825:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463668992 00000100:00100000:0.0:1746147185.377829:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463668992 00010000:00010000:2.0:1746147185.377833:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.377845:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 672 lvb_type: 0 00002000:00100000:0.0:1746147185.377846:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f453800 x1830967463668992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746147185.377851:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d02300 00002000:00100000:0.0:1746147185.377853:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f453800 with x1830967463668992 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.377856:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f453800 00000100:00100000:2.0:1746147185.377868:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463669376 00000100:00100000:2.0:1746147185.377870:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463669376 00000100:00100000:0.0:1746147185.377871:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1502 00000100:00100000:0.0:1746147185.377878:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463669120:12345-192.168.203.36@tcp:3:multiop.0 00002000:00100000:2.0:1746147185.377883:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f451f80 x1830967463669376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.377890:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451f80 with x1830967463669376 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.377893:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f451f80 00000100:00100000:2.0:1746147185.377902:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4375 00000100:00100000:2.0:1746147185.377907:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463668992:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147185.378021:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463669120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (359us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147185.378026:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1502 00002000:00100000:0.0:1746147185.378031:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (4153344->4157439) req@ffff880134d02300 x1830967463669120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.378038:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02300 with x1830967463669120 ext(4153344->4157439) 00010000:00010000:0.0:1746147185.378042:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.378055:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 25 pid: 8478 timeout: 672 lvb_type: 0 00002000:00010000:0.0:1746147185.378061:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d02300 00000100:00100000:0.0:1746147185.378073:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4376 00000100:00100000:0.0:1746147185.378077:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463669376:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147185.379906:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466380416:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.379930:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2699263] (req 2097152->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.379973:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064c00, rc 0) 00000100:00100000:3.0:1746147185.380008:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:28815:x1830967463668608:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6503us (7636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.380014:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11529 00000100:00100000:0.0:1746147185.387493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.387539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.387563:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463669632 00000100:00100000:0.0:1746147185.387571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.387573:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463669632 00000100:00100000:0.0:1746147185.387602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147185.387620:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f451500 x1830967463669632/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.387629:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463669632 ext(1048576->2097151) 00000100:00100000:0.0:1746147185.387632:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463670400 00002000:00010000:2.0:1746147185.387634:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451500 00000100:00100000:0.0:1746147185.387635:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463670400 00002000:00100000:0.0:1746147185.387653:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009e587100 x1830967463670400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.387661:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967463670400 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.387664:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00000100:00100000:2.0:1746147185.389178:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463670144 00000100:00100000:2.0:1746147185.389186:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463670144 00002000:00100000:2.0:1746147185.389210:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3747840->4157439) req@ffff88009e584000 x1830967463670144/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.389217:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584000 with x1830967463670144 ext(3747840->4157439) 00010000:00010000:2.0:1746147185.389226:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 26 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.389238:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 26 pid: 8478 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.389244:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e584000 00000100:00100000:2.0:1746147185.389492:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1503 00000100:00100000:2.0:1746147185.389501:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463670144:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147185.389581:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4377 00000100:00100000:0.0:1746147185.389587:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463669632:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147185.390117:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4378 00000100:00100000:3.0:1746147185.390126:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463670400:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147185.390898:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463670016 00000100:00100000:1.0:1746147185.390905:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463670016 00000100:00100000:1.0:1746147185.390934:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4137 00000100:00100000:1.0:1746147185.390953:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28822:x1830967463670016:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147185.391158:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28822:x1830967463670016:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 205us (3618us total) trans 8589944206 rc 0/0 00000100:00100000:1.0:1746147185.391164:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4137 00000100:00100000:1.0:1746147185.392320:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463669376:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14239us (14590us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.392328:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4376 00002000:00100000:1.0:1746147185.392337:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f451f80 x1830967463669376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.392344:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451f80 with x1830967463669376 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.392349:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f451f80 00000100:00100000:2.0:1746147185.394170:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463670144:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4666us (6562us total) trans 17179873198 rc 0/0 00000100:00100000:2.0:1746147185.394178:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1503 00002000:00100000:2.0:1746147185.394185:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3747840->4157439) req@ffff88009e584000 x1830967463670144/t17179873198(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.394192:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584000 with x1830967463670144 ext(3747840->4157439) 00010000:00010000:2.0:1746147185.394201:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 28 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.394214:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 28 pid: 8478 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.394220:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e584000 00000100:00100000:0.0:1746147185.395347:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463668992:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17436us (17641us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.395356:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4375 00002000:00100000:0.0:1746147185.395363:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f453800 x1830967463668992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.395375:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f453800 with x1830967463668992 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.395379:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f453800 00000100:00100000:0.0:1746147185.400423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.400504:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463670528 00000100:00100000:2.0:1746147185.400514:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463670528 00010000:00010000:2.0:1746147185.400547:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 29 pid: 8478 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.401846:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5678 00000100:00100000:2.0:1746147185.401857:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463670528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.401873:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147185.401889:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147184 -> 1746147185 00002000:00010000:2.0:1746147185.401892:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147184 -> 1746147185 00010000:00010000:2.0:1746147185.401897:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 29 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.401909:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 29 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.401929:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac629b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4157439) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6566 expref: 29 pid: 8478 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.401965:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.401967:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.401972:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.401979:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.402009:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.402023:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466380544:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147185.404001:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.405772:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463670400:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15641us (18192us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.405782:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4378 00002000:00100000:3.0:1746147185.405794:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009e587100 x1830967463670400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.405802:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967463670400 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.405807:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00000100:00100000:2.0:1746147185.410166:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466380544:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147185.410183:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.410222:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463670528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8367us (9808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.410232:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5678 00000100:00100000:0.0:1746147185.410364:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463669632:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 20776us (22877us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.410372:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4377 00002000:00100000:0.0:1746147185.410380:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f451500 x1830967463669632/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.410389:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463669632 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.410393:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451500 00000100:00100000:0.0:1746147185.414917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.415352:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463670784 00000100:00100000:2.0:1746147185.415361:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463670784 00002000:00100000:2.0:1746147185.415400:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2695168->2699263) req@ffff88009e585180 x1830967463670784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.415409:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585180 with x1830967463670784 ext(2695168->2699263) 00002000:00010000:2.0:1746147185.415413:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585180 00000100:00100000:2.0:1746147185.415444:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4379 00000100:00100000:2.0:1746147185.415451:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463670784:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147185.415590:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463670784:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 139us (679us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147185.415596:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4379 00002000:00100000:2.0:1746147185.415602:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2695168->2699263) req@ffff88009e585180 x1830967463670784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.415608:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585180 with x1830967463670784 ext(2695168->2699263) 00002000:00010000:2.0:1746147185.415621:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585180 00000100:00100000:0.0:1746147185.416998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.417252:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671040 00000100:00100000:3.0:1746147185.417259:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671040 00002000:00100000:3.0:1746147185.417281:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3039231) req@ffff88009e584700 x1830967463671040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.417294:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967463671040 ext(2097152->3039231) 00002000:00010000:3.0:1746147185.417298:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584700 00000100:00100000:3.0:1746147185.417312:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4380 00000100:00100000:3.0:1746147185.417317:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463671040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.427675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.427803:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671296 00000100:00100000:3.0:1746147185.427812:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671296 00000100:00100000:3.0:1746147185.427853:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11530 00000100:00100000:3.0:1746147185.427859:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463671296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.427872:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.427885:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064600/0xb4b2209fbdac62b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6582 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.427924:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466380672:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.427997:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.428042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.428186:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671168 00000100:00100000:1.0:1746147185.428190:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671168 00000100:00100000:0.0:1746147185.429485:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11531 00000100:00100000:0.0:1746147185.429493:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463671168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.429503:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.429511:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912e7a00/0xb4b2209fbdac62b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e657b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.429623:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466380800:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147185.429670:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.430260:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463671040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12941us (13264us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746147185.430268:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4380 00002000:00100000:3.0:1746147185.430276:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3039231) req@ffff88009e584700 x1830967463671040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.430284:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967463671040 ext(2097152->3039231) 00002000:00010000:3.0:1746147185.430288:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584700 00002000:00010000:2.0:1746147185.430487:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147184 -> 1746147185 00000100:00100000:2.0:1746147185.430503:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466380672:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147185.430522:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064600/0xb4b2209fbdac62b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6582 expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.430532:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064600/0xb4b2209fbdac62b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6582 expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.430554:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064600, rc 0) 00000100:00100000:2.0:1746147185.430584:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463671296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2725us (2916us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147185.430589:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11530 00002000:00010000:2.0:1746147185.430771:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147184 -> 1746147185 00002000:00010000:2.0:1746147185.430773:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147184 -> 1746147185 00002000:00010000:2.0:1746147185.430779:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147184 -> 1746147185 00000100:00100000:2.0:1746147185.430789:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466380800:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147185.430802:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912e7a00/0xb4b2209fbdac62b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e657b expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.430810:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912e7a00/0xb4b2209fbdac62b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e657b expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.430817:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912e7a00, rc 0) 00000100:00100000:2.0:1746147185.430837:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463671168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1345us (2794us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147185.430841:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11531 00000100:00100000:1.0:1746147185.433252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.434038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.434121:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671424 00000100:00100000:2.0:1746147185.434129:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671424 00000100:00100000:3.0:1746147185.434136:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671680 00000100:00100000:3.0:1746147185.434139:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671680 00002000:00100000:3.0:1746147185.434165:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2699264->3145727) req@ffff88009ef7d180 x1830967463671680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147185.434169:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11532 00002000:00100000:3.0:1746147185.434174:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7d180 with x1830967463671680 ext(2699264->3145727) 00000100:00100000:2.0:1746147185.434175:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28820:x1830967463671424:12345-192.168.203.36@tcp:101:cat.0 00002000:00010000:3.0:1746147185.434179:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7d180 00010000:00010000:2.0:1746147185.434186:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147185.434190:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4381 00000100:00100000:3.0:1746147185.434194:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463671680:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147185.434198:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6589 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.434216:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.434221:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147185.434223:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147185.434225:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.434247:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.434255:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 34 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.434263:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466380928:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.434537:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.436857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.436887:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466380928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.436908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147185.436916:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.436956:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec5000, rc 0) 00000100:00100000:0.0:1746147185.436957:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463672064 00000100:00100000:0.0:1746147185.436963:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463672064 00000100:00100000:2.0:1746147185.436992:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28820:x1830967463671424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2815us (3745us total) trans 0 rc 0/0 00002000:00100000:0.0:1746147185.436995:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ef7c380 x1830967463672064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147185.436999:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11532 00002000:00100000:0.0:1746147185.437004:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7c380 with x1830967463672064 ext(3145728->4194303) 00010000:00010000:0.0:1746147185.437022:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 35 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.437032:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 35 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:0.0:1746147185.437038:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7c380 00000100:00100000:0.0:1746147185.437048:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463671936 00000100:00100000:0.0:1746147185.437049:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463671936 00002000:00100000:0.0:1746147185.437057:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3039232->3145727) req@ffff88009ef7df80 x1830967463671936/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.437064:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7df80 with x1830967463671936 ext(3039232->3145727) 00010000:00010000:0.0:1746147185.437068:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 36 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.437075:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 36 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:0.0:1746147185.437079:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7df80 00000100:00100000:0.0:1746147185.437087:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1504 00000100:00100000:0.0:1746147185.437092:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463672064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.437173:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1505 00000100:00100000:2.0:1746147185.437180:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463671936:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147185.439180:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463671680:12345-192.168.203.36@tcp:3:cat.0 Request processed in 4980us (5138us total) trans 0 rc 446464/446464 00000100:00100000:3.0:1746147185.439188:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4381 00002000:00100000:3.0:1746147185.439197:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2699264->3145727) req@ffff88009ef7d180 x1830967463671680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 446464/446464 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.439206:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7d180 with x1830967463671680 ext(2699264->3145727) 00002000:00010000:3.0:1746147185.439210:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef7d180 00000100:00100000:2.0:1746147185.439427:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463671936:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2246us (2517us total) trans 21474840605 rc 0/0 00000100:00100000:2.0:1746147185.439434:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1505 00002000:00100000:2.0:1746147185.439440:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3039232->3145727) req@ffff88009ef7df80 x1830967463671936/t21474840605(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.439448:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7df80 with x1830967463671936 ext(3039232->3145727) 00010000:00010000:2.0:1746147185.439455:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 39 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.439466:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 39 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.439473:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7df80 00000100:00100000:0.0:1746147185.444630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.444852:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463672320 00000100:00100000:2.0:1746147185.444861:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463672320 00002000:00100000:2.0:1746147185.444897:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e584e00 x1830967463672320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.444911:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967463672320 ext(3145728->4194303) 00002000:00010000:2.0:1746147185.444916:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:2.0:1746147185.444970:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4382 00000100:00100000:2.0:1746147185.444978:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463672320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.446365:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463672064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9268us (9510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.446372:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1504 00002000:00100000:2.0:1746147185.446379:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ef7c380 x1830967463672064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.446386:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7c380 with x1830967463672064 ext(3145728->4194303) 00010000:00010000:2.0:1746147185.446393:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 37 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.446404:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 37 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.446410:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7c380 00000100:00100000:0.0:1746147185.450511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.450617:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463672448 00000100:00100000:2.0:1746147185.450626:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463672448 00000100:00100000:2.0:1746147185.450668:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11533 00000100:00100000:2.0:1746147185.450675:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:28819:x1830967463672448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.450691:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.450705:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6590 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.450733:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147185.450735:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147185.450739:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.450748:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 38 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.450756:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec5600, rc 0) 00000100:00100000:2.0:1746147185.450805:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28819:x1830967463672448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 130us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.450811:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11533 00000100:00100000:0.0:1746147185.452143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.452790:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463672320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7812us (8167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.452798:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4382 00002000:00100000:2.0:1746147185.452806:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e584e00 x1830967463672320/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.452814:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967463672320 ext(3145728->4194303) 00002000:00010000:2.0:1746147185.452818:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:3.0:1746147185.452964:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463672576 00000100:00100000:3.0:1746147185.452970:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463672576 00010000:00010000:3.0:1746147185.452992:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.453023:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5679 00000100:00100000:3.0:1746147185.453030:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463672576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.453039:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.453054:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.453064:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.453081:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac62a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e656d expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.453105:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.453107:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.453113:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.453120:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.453126:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.453127:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.453129:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.453135:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.453160:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.453170:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466381056:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.453251:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.453264:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466381184:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.453283:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.455876:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466381056:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.455886:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466381184:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.455901:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.455933:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463672576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2902us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.455962:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5679 00000100:00100000:0.0:1746147185.457734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.457777:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463672832 00000100:00100000:2.0:1746147185.457787:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463672832 00002000:00100000:2.0:1746147185.457822:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880093d35f80 x1830967463672832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.457830:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35f80 with x1830967463672832 ext(3145728->4194303) 00002000:00010000:2.0:1746147185.457834:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35f80 00000100:00100000:2.0:1746147185.457859:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4383 00000100:00100000:2.0:1746147185.457866:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463672832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.461876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.462122:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673088 00000100:00100000:2.0:1746147185.462131:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673088 00002000:00100000:2.0:1746147185.462166:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d36d80 x1830967463673088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.462175:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36d80 with x1830967463673088 ext(2097152->3145727) 00002000:00010000:2.0:1746147185.462179:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d36d80 00000100:00100000:2.0:1746147185.462207:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4384 00000100:00100000:2.0:1746147185.462214:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463673088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.468800:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463672832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10925us (11061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.468811:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4383 00002000:00100000:2.0:1746147185.468824:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880093d35f80 x1830967463672832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.468833:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35f80 with x1830967463672832 ext(3145728->4194303) 00002000:00010000:2.0:1746147185.468838:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35f80 00000100:00100000:0.0:1746147185.471853:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463673088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9630us (9974us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.471863:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4384 00002000:00100000:0.0:1746147185.471872:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d36d80 x1830967463673088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.471880:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36d80 with x1830967463673088 ext(2097152->3145727) 00002000:00010000:0.0:1746147185.471885:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d36d80 00000100:00100000:0.0:1746147185.480600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.482712:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673344 00000100:00100000:2.0:1746147185.482725:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673344 00002000:00100000:2.0:1746147185.482767:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880093d36300 x1830967463673344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.482775:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36300 with x1830967463673344 ext(4194304->4927487) 00002000:00010000:2.0:1746147185.482780:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d36300 00000100:00100000:2.0:1746147185.482808:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4385 00000100:00100000:2.0:1746147185.482816:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463673344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.483866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.483962:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673472 00000100:00100000:1.0:1746147185.483967:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673472 00000100:00100000:1.0:1746147185.484002:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11534 00000100:00100000:1.0:1746147185.484009:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28820:x1830967463673472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.484019:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.484032:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6597 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.484640:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.484648:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147185.484650:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147185.484653:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.484680:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.484691:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 35 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.484702:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381312:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.484769:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.490283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.490316:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673600 00000100:00100000:0.0:1746147185.490324:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673600 00002000:00100000:0.0:1746147185.490360:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2699263) req@ffff880093d34000 x1830967463673600/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.490368:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34000 with x1830967463673600 ext(2097152->2699263) 00010000:00010000:0.0:1746147185.490376:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 36 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.490387:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 36 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:0.0:1746147185.490393:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093d34000 00000100:00100000:0.0:1746147185.490422:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1506 00000100:00100000:0.0:1746147185.490430:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463673600:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147185.490690:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463673344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7873us (10101us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147185.490698:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4385 00002000:00100000:2.0:1746147185.490705:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880093d36300 x1830967463673344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.490712:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36300 with x1830967463673344 ext(4194304->4927487) 00002000:00010000:2.0:1746147185.490715:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d36300 00000100:00100000:1.0:1746147185.490819:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381312:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.490840:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.490852:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19e00, rc 0) 00000100:00100000:1.0:1746147185.490870:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28820:x1830967463673472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6863us (7008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.490876:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11534 00000100:00100000:2.0:1746147185.495712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.495891:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673728 00000100:00100000:1.0:1746147185.495900:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673728 00000100:00100000:1.0:1746147185.496018:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11535 00000100:00100000:1.0:1746147185.496028:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463673728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.496043:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.496057:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea18e00/0xb4b2209fbdac62d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e659e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.496103:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381440:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147185.496156:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.498799:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463673600:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8361us (8516us total) trans 17179873199 rc 0/0 00000100:00100000:3.0:1746147185.498810:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1506 00000100:00100000:1.0:1746147185.500916:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381440:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147185.500952:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18e00/0xb4b2209fbdac62d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e659e expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.500965:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18e00/0xb4b2209fbdac62d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e659e expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.500988:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18e00, rc 0) 00000100:00100000:1.0:1746147185.501019:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463673728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4993us (5315us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147185.501026:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11535 00002000:00100000:3.0:1746147185.502105:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2699263) req@ffff880093d34000 x1830967463673600/t17179873199(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.502116:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34000 with x1830967463673600 ext(2097152->2699263) 00010000:00010000:3.0:1746147185.502124:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.502135:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 38 pid: 8481 timeout: 672 lvb_type: 0 00002000:00010000:3.0:1746147185.502140:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093d34000 00000100:00100000:0.0:1746147185.503501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.504046:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673984 00000100:00100000:1.0:1746147185.504056:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673984 00000100:00100000:0.0:1746147185.504172:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.504752:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11536 00000100:00100000:1.0:1746147185.504760:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463673984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.504776:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.504792:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea19000/0xb4b2209fbdac62da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65a5 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.504839:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381568:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147185.504899:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.505154:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463673856 00000100:00100000:3.0:1746147185.505158:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463673856 00010000:00010000:3.0:1746147185.505174:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 40 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.505199:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5680 00000100:00100000:3.0:1746147185.505204:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463673856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.505212:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.505228:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 40 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.505238:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 40 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.505254:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.505256:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.505263:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.505270:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.505290:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.505297:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466381696:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.505453:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.505566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.505622:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463674112 00000100:00100000:2.0:1746147185.505626:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463674112 00000100:00100000:2.0:1746147185.505651:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10464 00000100:00100000:2.0:1746147185.505656:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+6:28826:x1830967463674112:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.505668:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.505677:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5c00/0xb4b2209fbdac62e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65ac expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.505715:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505724:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505731:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505741:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505750:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505755:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505837:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505846:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.505852:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.505870:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 302 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.505879:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 302 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.505886:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466381824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.505911:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439780 going to sleep for 11 seconds 00010000:00010000:1.0:1746147185.506372:0:8481:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88012c9f0a80 x1830967466381568) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 40 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.506391:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064c00/0xb4b2209fbdac62a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2699263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6574 expref: 40 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.506400:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466381568:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147185.506415:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea19000/0xb4b2209fbdac62da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65a5 expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.506423:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19000/0xb4b2209fbdac62da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65a5 expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.506428:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19000, rc 0) 00000100:00100000:1.0:1746147185.506626:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463673984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1865us (3127us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147185.506631:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11536 00000100:00100000:3.0:1746147185.507587:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466381696:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.507620:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.507642:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463673856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2437us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.507649:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5680 00000100:00100000:2.0:1746147185.508693:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466381824:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.508706:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.509047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.509115:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463674368 00000100:00100000:2.0:1746147185.509120:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463674368 00000100:00100000:2.0:1746147185.509158:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4138 00000100:00100000:2.0:1746147185.509165:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:7642:x1830967463674368:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147185.509515:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:7642:x1830967463674368:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 349us (467us total) trans 8589944207 rc 0/0 00000100:00100000:2.0:1746147185.509521:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4138 00000100:00100000:1.0:1746147185.514589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.514634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.514657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.514678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.514721:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463674496 00000100:00100000:3.0:1746147185.514729:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463674496 00010000:00010000:3.0:1746147185.514758:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 304 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.514792:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5681 00000100:00100000:3.0:1746147185.514799:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967463674496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.514812:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.514818:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 304 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.514827:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 304 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.514845:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff6c00/0xb4b2209fbdac6208 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6512 expref: 304 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.514858:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.514862:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.514869:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.514874:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.514889:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.514922:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967463674496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.514927:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5681 00000100:00100000:3.0:1746147185.514973:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463674752 00000100:00100000:3.0:1746147185.514976:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463674752 00002000:00100000:3.0:1746147185.514998:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012c9f3800 x1830967463674752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.515005:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967463674752 ext(2097152->3145727) 00002000:00010000:3.0:1746147185.515009:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:3.0:1746147185.515016:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675008 00000100:00100000:3.0:1746147185.515019:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675008 00002000:00100000:3.0:1746147185.515028:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012c9f2300 x1830967463675008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.515034:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967463675008 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.515036:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:3.0:1746147185.515044:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675136 00000100:00100000:3.0:1746147185.515045:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675136 00002000:00100000:3.0:1746147185.515052:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012c9f2a00 x1830967463675136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.515057:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967463675136 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.515059:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2a00 00000100:00100000:3.0:1746147185.515073:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4386 00000100:00100000:3.0:1746147185.515078:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463674752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.516052:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4387 00000100:00100000:3.0:1746147185.516059:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463675008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.516981:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4388 00000100:00100000:1.0:1746147185.516990:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463675136:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147185.517015:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517025:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147185.517057:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147185.517060:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147185.517072:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517082:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517089:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517094:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517098:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517102:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.517105:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517109:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517119:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147185.517122:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.517125:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.517129:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac62e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518045:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518052:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518057:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518061:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.518064:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518068:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518076:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48d00) 00010000:00010000:2.0:1746147185.518078:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.518080:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518085:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac62ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.518119:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5c00/0xb4b2209fbdac62e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.518130:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.518135:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.518137:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147185.518139:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec5200, rc 0) 00000100:00100000:2.0:1746147185.518166:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28826:x1830967463674112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 12509us (12599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.518172:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10464 00000100:00100000:3.0:1746147185.525119:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463674752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10031us (10498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.525130:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4386 00002000:00100000:3.0:1746147185.525142:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012c9f3800 x1830967463674752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.525151:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967463674752 ext(2097152->3145727) 00002000:00010000:3.0:1746147185.525157:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:3.0:1746147185.527547:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463675008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11482us (12881us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.527556:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4387 00002000:00100000:3.0:1746147185.527565:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012c9f2300 x1830967463675008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.527574:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2300 with x1830967463675008 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.527579:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2300 00000100:00100000:1.0:1746147185.532143:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463675136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15146us (17454us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.532153:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4388 00002000:00100000:1.0:1746147185.532164:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012c9f2a00 x1830967463675136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.532171:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967463675136 ext(3145728->4194303) 00002000:00010000:1.0:1746147185.532176:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f2a00 00000100:00100000:0.0:1746147185.533147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.533708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.533801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.533890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.533919:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675520 00000100:00100000:1.0:1746147185.533927:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675520 00000100:00100000:1.0:1746147185.533957:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675776 00000100:00100000:1.0:1746147185.533959:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675776 00000100:00100000:1.0:1746147185.533995:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676032 00000100:00100000:1.0:1746147185.533996:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676032 00000100:00100000:1.0:1746147185.534008:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11537 00000100:00100000:1.0:1746147185.534013:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463675776:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147185.534027:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.534040:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65c8 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.534057:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.534059:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.534065:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.534077:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.534090:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fa9400, rc 0) 00000100:00100000:3.0:1746147185.534101:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11538 00000100:00100000:3.0:1746147185.534108:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463676032:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147185.534114:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463675776:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 101us (407us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147185.534116:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147185.534119:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11537 00010000:00010000:3.0:1746147185.534125:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65d6 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.534137:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534139:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147185.534139:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11539 00000100:00100000:1.0:1746147185.534142:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463675520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.534144:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.534147:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.534152:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65ba expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.534153:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534160:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63c00, rc 0) 00010000:00010000:1.0:1746147185.534160:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.534161:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.534164:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.534171:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.534176:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ec5a00, rc 0) 00000100:00100000:3.0:1746147185.534177:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463676032:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.534183:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11538 00000100:00100000:1.0:1746147185.534188:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463675520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 45us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.534192:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11539 00000100:00100000:0.0:1746147185.534295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.534320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.534403:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675392 00000100:00100000:3.0:1746147185.534407:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675392 00000100:00100000:3.0:1746147185.534423:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675648 00000100:00100000:3.0:1746147185.534425:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675648 00000100:00100000:3.0:1746147185.534436:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463675904 00000100:00100000:3.0:1746147185.534438:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463675904 00000100:00100000:3.0:1746147185.534449:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11540 00000100:00100000:3.0:1746147185.534460:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463675392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.534467:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.534475:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65b3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.534485:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534486:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534491:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534499:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534510:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3200, rc 0) 00000100:00100000:3.0:1746147185.534529:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463675392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 75us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.534534:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11540 00000100:00100000:3.0:1746147185.534554:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11541 00000100:00100000:3.0:1746147185.534558:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463675648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.534564:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.534571:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65c1 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.534580:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534581:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534585:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534593:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534600:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3e00, rc 0) 00000100:00100000:3.0:1746147185.534627:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463675648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.534631:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11541 00000100:00100000:3.0:1746147185.534644:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11542 00000100:00100000:3.0:1746147185.534649:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463675904:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.534657:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.534664:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65cf expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.534673:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534675:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.534679:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534687:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.534693:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63e00, rc 0) 00000100:00100000:3.0:1746147185.534707:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463675904:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 59us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.534712:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11542 00000100:00100000:0.0:1746147185.538510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.539321:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676288 00000100:00100000:2.0:1746147185.539330:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676288 00000100:00100000:2.0:1746147185.539403:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10465 00000100:00100000:2.0:1746147185.539411:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:28826:x1830967463676288:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.539426:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.539440:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac6327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65dd expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.539508:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.539519:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.539524:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.539548:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.539562:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 8 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.539571:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466381952:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.540041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.540181:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.540278:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676544 00000100:00100000:1.0:1746147185.540283:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676544 00002000:00100000:1.0:1746147185.540307:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a47aaa00 x1830967463676544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.540315:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47aaa00 with x1830967463676544 ext(4194304->4927487) 00002000:00010000:1.0:1746147185.540318:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47aaa00 00000100:00100000:1.0:1746147185.540330:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4389 00000100:00100000:1.0:1746147185.540335:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463676544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.541882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.541902:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676672 00000100:00100000:0.0:1746147185.541908:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676672 00010000:00010000:0.0:1746147185.541927:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.541971:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5682 00000100:00100000:0.0:1746147185.541977:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463676672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.541986:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.541991:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.542000:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.542015:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.542019:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.542026:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.542032:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147185.542044:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.542070:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463676672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.542076:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5682 00010000:00010000:2.0:1746147185.542228:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5200/0xb4b2209fbdac62f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ac expref: 8 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.542244:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466381952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.542256:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.542263:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.542267:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147185.542282:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.542375:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac6327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.542385:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.542391:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.542393:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147185.542395:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4c00, rc 0) 00000100:00100000:2.0:1746147185.542423:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463676288:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3013us (3920us total) trans 8589944208 rc 0/0 00000100:00100000:2.0:1746147185.542429:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10465 00000100:00100000:0.0:1746147185.545887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.545922:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463676544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5585us (5881us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746147185.545932:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4389 00002000:00100000:1.0:1746147185.545961:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a47aaa00 x1830967463676544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.545969:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47aaa00 with x1830967463676544 ext(4194304->4927487) 00002000:00010000:1.0:1746147185.545974:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47aaa00 00000100:00100000:2.0:1746147185.546125:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676800 00000100:00100000:2.0:1746147185.546132:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676800 00000100:00100000:2.0:1746147185.546173:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10466 00000100:00100000:2.0:1746147185.546180:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463676800:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.546197:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.546210:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4a00/0xb4b2209fbdac633c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65e4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.546267:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.546277:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.546283:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.546307:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.546317:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.546326:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466382080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.546392:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.548060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.548144:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466382080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.548159:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147185.548219:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463676928 00000100:00100000:3.0:1746147185.548224:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463676928 00010000:00010000:3.0:1746147185.548244:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 10 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.548262:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5683 00000100:00100000:3.0:1746147185.548268:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463676928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.548278:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.548282:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 10 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.548294:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 10 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.548309:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac632e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65dd expref: 10 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.548335:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.548339:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.548346:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.548351:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.548364:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.548390:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463676928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.548396:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5683 00010000:00010000:2.0:1746147185.548683:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.548690:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147185.548720:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147185.548724:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147185.548736:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.548758:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4a00/0xb4b2209fbdac633c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65e4 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.548767:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65e4 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.548772:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.548774:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147185.548776:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4800, rc 0) 00000100:00100000:2.0:1746147185.548809:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463676800:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2629us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.548815:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10466 00000100:00100000:0.0:1746147185.551025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.551368:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677184 00000100:00100000:2.0:1746147185.551377:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677184 00000100:00100000:2.0:1746147185.551428:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10467 00000100:00100000:2.0:1746147185.551436:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463677184:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.551453:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.551466:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac634a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65eb expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.552098:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.552109:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.552117:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147185.552126:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.552213:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac634a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.552225:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.552231:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.552233:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147185.552235:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4400, rc 0) 00000100:00100000:2.0:1746147185.552276:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28826:x1830967463677184:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 841us (1257us total) trans 8589944209 rc 0/0 00000100:00100000:2.0:1746147185.552282:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10467 00000100:00100000:0.0:1746147185.552477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.552519:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677440 00000100:00100000:2.0:1746147185.552524:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677440 00000100:00100000:2.0:1746147185.552544:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4139 00000100:00100000:2.0:1746147185.552549:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28820:x1830967463677440:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147185.552642:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28820:x1830967463677440:12345-192.168.203.36@tcp:35:cat.0 Request processed in 92us (165us total) trans 8589944210 rc 0/0 00000100:00100000:2.0:1746147185.552648:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4139 00000100:00100000:0.0:1746147185.555184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.555279:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677568 00000100:00100000:2.0:1746147185.555288:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677568 00000100:00100000:2.0:1746147185.555324:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11543 00000100:00100000:2.0:1746147185.555332:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463677568:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147185.555367:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.555381:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.555388:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.555394:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.555400:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.555401:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.555404:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.555431:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.555446:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 21 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.555458:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.556551:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.556563:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 13 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.556571:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382336:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.557151:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.557199:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677696 00000100:00100000:0.0:1746147185.557205:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677696 00000100:00100000:0.0:1746147185.557231:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11544 00000100:00100000:0.0:1746147185.557237:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463677696:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147185.557261:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.557274:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.557281:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.557292:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.557298:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.557299:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.557301:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.557324:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.557332:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 26 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.557341:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382464:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.557458:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.557467:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 36 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.557475:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382592:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.557865:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.557888:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382208:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.559159:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.559169:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 11 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.559179:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382720:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.559241:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.559255:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 36 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.559266:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.559283:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.559313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.559446:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677952 00000100:00100000:2.0:1746147185.559453:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677952 00000100:00100000:2.0:1746147185.559479:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11545 00000100:00100000:2.0:1746147185.559484:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463677952:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147185.559510:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.559521:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147185.559661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.559676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.559688:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678208 00000100:00100000:1.0:1746147185.559692:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678208 00000100:00100000:1.0:1746147185.559717:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463677824 00000100:00100000:1.0:1746147185.559719:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463677824 00000100:00100000:1.0:1746147185.559733:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11546 00000100:00100000:1.0:1746147185.559737:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463678208:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147185.559753:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.559762:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.559768:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.559773:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.559775:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.559777:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.559793:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.559800:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 13 pid: 4444 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.559811:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466382976:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.559839:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.559846:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.559852:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466383104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.559877:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.559903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.559916:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678080 00000100:00100000:1.0:1746147185.559918:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678080 00000100:00100000:1.0:1746147185.559954:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11547 00000100:00100000:1.0:1746147185.559959:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463677824:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147185.559974:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.559983:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 36 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.559989:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.559994:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.559998:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.560000:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.560001:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.560014:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.560021:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 26 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.560028:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383232:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.560060:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.560067:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.560073:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383360:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.560089:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 36 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.560096:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 36 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.560102:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383488:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.560112:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.560140:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.560285:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11548 00000100:00100000:3.0:1746147185.560292:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463678080:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147185.560307:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560316:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560325:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.560330:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560334:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.560336:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.560337:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560352:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560358:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 36 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.560365:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383616:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.560396:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.560403:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.560410:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383744:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147185.560431:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.560438:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.560444:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383872:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147185.560452:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a5ce40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147185.560750:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147185.560754:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678336 00010000:00010000:2.0:1746147185.560756:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 21 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147185.560757:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678336 00010000:00010000:2.0:1746147185.560761:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.560762:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.560764:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.560771:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.560786:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5684 00000100:00100000:2.0:1746147185.560788:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.560790:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463678336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.560797:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.560804:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.560811:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 22 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.560812:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.560818:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384000:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.560820:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.560833:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0xb4b2209fbdac621d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e650b expref: 22 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.560841:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.560845:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147185.560848:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.560854:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384128:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.560861:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463678336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.560867:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5684 00010000:00010000:2.0:1746147185.560870:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.560876:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 36 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.560883:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384256:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.560895:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.560897:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c439e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.561139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.561265:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678464 00000100:00100000:3.0:1746147185.561269:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678464 00010000:00010000:3.0:1746147185.561281:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 16 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.561295:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5685 00000100:00100000:3.0:1746147185.561299:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463678464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.561306:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.561314:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 16 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.561321:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 16 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.561332:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9b3200/0xb4b2209fbdac6312 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65b3 expref: 16 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.561341:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.561358:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463678464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.561363:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5685 00000100:00100000:1.0:1746147185.561927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.562135:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678592 00000100:00100000:0.0:1746147185.562139:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678592 00010000:00010000:0.0:1746147185.562153:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 27 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.562167:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5686 00000100:00100000:0.0:1746147185.562172:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463678592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.562179:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.562190:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 27 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.562198:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 27 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.562210:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dd000/0xb4b2209fbdac6224 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6519 expref: 27 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.562219:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.562238:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463678592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.562243:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5686 00000100:00100000:1.0:1746147185.576305:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466382976:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.576335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576389:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466383104:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.576409:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.576436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576475:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383232:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.576501:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383360:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.576525:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466383488:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.576538:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.576558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.576622:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678720 00000100:00100000:1.0:1746147185.576629:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678720 00010000:00010000:1.0:1746147185.576657:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.576672:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678848 00000100:00100000:1.0:1746147185.576674:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678848 00010000:00010000:1.0:1746147185.576682:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 14 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.576689:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463678976 00000100:00100000:1.0:1746147185.576691:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463678976 00010000:00010000:1.0:1746147185.576697:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 15 pid: 4444 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.576703:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679104 00000100:00100000:1.0:1746147185.576705:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679104 00010000:00010000:1.0:1746147185.576710:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.576721:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679232 00000100:00100000:1.0:1746147185.576722:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679232 00010000:00010000:1.0:1746147185.576729:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.576736:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679360 00000100:00100000:1.0:1746147185.576737:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679360 00010000:00010000:1.0:1746147185.576744:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 16 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.576755:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5687 00000100:00100000:1.0:1746147185.576761:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463678720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.576773:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.576791:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.576800:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.576818:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.576820:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.576824:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.576832:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.576848:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.576879:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463678720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.576885:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5687 00000100:00100000:1.0:1746147185.576898:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5688 00000100:00100000:1.0:1746147185.576903:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463678848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.576909:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.576920:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 16 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.576928:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 16 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.576961:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.576976:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463678848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.576981:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5688 00000100:00100000:1.0:1746147185.576990:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5689 00000100:00100000:1.0:1746147185.576994:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463678976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.576999:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577007:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 15 pid: 4444 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577013:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 15 pid: 4444 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577023:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65d6 expref: 15 pid: 4444 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577046:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577060:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463678976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577065:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5689 00000100:00100000:1.0:1746147185.577086:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5690 00000100:00100000:1.0:1746147185.577090:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463679104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577097:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577103:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.577111:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.577120:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19e00/0xb4b2209fbdac62cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6597 expref: 26 pid: 8481 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.577127:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577128:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577130:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577136:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577148:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577161:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463679104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577166:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5690 00000100:00100000:1.0:1746147185.577175:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5691 00000100:00100000:1.0:1746147185.577179:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463679232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577184:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577191:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577198:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577207:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577208:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577211:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577217:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577225:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577236:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463679232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 57us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577241:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5691 00000100:00100000:1.0:1746147185.577250:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5692 00000100:00100000:1.0:1746147185.577255:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463679360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577260:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577268:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577274:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577283:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3e00/0xb4b2209fbdac6319 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c1 expref: 13 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577290:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577302:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463679360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 47us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577307:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5692 00010000:00010000:1.0:1746147185.577331:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577338:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577352:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577359:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577370:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577375:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0efa00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.577378:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577385:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577393:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577398:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6374 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.577431:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463678208:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 17694us (17771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577437:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11546 00000100:00100000:1.0:1746147185.577467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.577479:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679488 00000100:00100000:1.0:1746147185.577482:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679488 00010000:00010000:1.0:1746147185.577492:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 25 pid: 17530 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.577502:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5693 00000100:00100000:1.0:1746147185.577507:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463679488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577513:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577520:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 25 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577527:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 25 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577536:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487800/0xb4b2209fbdac622b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6520 expref: 25 pid: 17530 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577543:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577556:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463679488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577561:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5693 00000100:00100000:1.0:1746147185.577603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.577624:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679616 00000100:00100000:1.0:1746147185.577627:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679616 00010000:00010000:1.0:1746147185.577636:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 37 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.577647:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5694 00000100:00100000:1.0:1746147185.577651:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463679616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577656:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577663:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 37 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577674:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 37 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577684:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac61e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64ef expref: 37 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577691:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577692:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.577695:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577700:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577712:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577727:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463679616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577731:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5694 00010000:00010000:1.0:1746147185.577744:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577750:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577761:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577771:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577776:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577781:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f72ee00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.577784:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577789:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577796:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.577801:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72ee00/0xb4b2209fbdac637b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.577824:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463677824:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 17865us (18146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577830:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11547 00000100:00100000:1.0:1746147185.577864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.577874:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679744 00000100:00100000:1.0:1746147185.577877:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679744 00010000:00010000:1.0:1746147185.577886:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.577897:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5695 00000100:00100000:1.0:1746147185.577902:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463679744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.577907:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.577917:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577924:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 15 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.577932:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.577962:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463679744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.577967:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5695 00000100:00100000:1.0:1746147185.578003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.578014:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463679872 00000100:00100000:1.0:1746147185.578016:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463679872 00010000:00010000:1.0:1746147185.578027:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.578037:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5696 00000100:00100000:1.0:1746147185.578041:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463679872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.578047:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.578053:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.578064:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 21 pid: 8480 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.578074:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.578083:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463679872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.578087:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5696 00000100:00100000:1.0:1746147185.578142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.578151:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680000 00000100:00100000:1.0:1746147185.578154:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680000 00010000:00010000:1.0:1746147185.578162:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 21 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.578171:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5697 00000100:00100000:1.0:1746147185.578175:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463680000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.578179:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.578187:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 21 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578194:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 21 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578202:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.578215:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463680000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.578221:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5697 00000100:00100000:1.0:1746147185.578271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.578280:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680256 00000100:00100000:1.0:1746147185.578282:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680256 00010000:00010000:1.0:1746147185.578290:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.578299:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5698 00000100:00100000:1.0:1746147185.578303:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463680256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.578308:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.578314:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.578321:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 37 pid: 8480 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.578329:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.578330:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.578333:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.578338:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.578346:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.578358:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463680256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 54us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.578366:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5698 00000100:00100000:1.0:1746147185.578394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.578402:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680128 00000100:00100000:1.0:1746147185.578404:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680128 00010000:00010000:1.0:1746147185.578411:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.578420:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5699 00000100:00100000:1.0:1746147185.578424:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463680128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.578429:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.578434:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578441:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 15 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578450:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.578461:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463680128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 36us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.578465:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5699 00000100:00100000:1.0:1746147185.578508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.578517:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680384 00000100:00100000:1.0:1746147185.578519:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680384 00010000:00010000:1.0:1746147185.578528:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.578538:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5700 00000100:00100000:1.0:1746147185.578542:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463680384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.578546:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.578552:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578560:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 37 pid: 11147 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.578568:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.578569:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.578571:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.578576:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.578584:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.578595:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463680384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.578599:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5700 00010000:00010000:2.0:1746147185.578804:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff6400/0xb4b2209fbdac61ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e1 expref: 36 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.578817:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466382592:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.578833:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578839:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578844:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578863:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578869:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578874:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578879:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec4200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.578881:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578887:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578896:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.578901:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ec4200/0xb4b2209fbdac635f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.578951:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463677568:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 23605us (23758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.578957:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11543 00010000:00010000:2.0:1746147185.578986:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6232 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6527 expref: 20 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.578994:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579003:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa9400/0xb4b2209fbdac62fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65c8 expref: 13 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.579010:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579017:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff6600/0xb4b2209fbdac61fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64f6 expref: 35 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.579023:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466384256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579034:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579040:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579045:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579057:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579063:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579072:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579077:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.579079:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579083:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579091:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579096:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5e00/0xb4b2209fbdac636d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.579124:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463677952:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 19640us (19810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.579128:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11545 00010000:00010000:2.0:1746147185.579169:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5600/0xb4b2209fbdac62c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6590 expref: 34 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.579176:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579185:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65cf expref: 11 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.579204:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579213:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ec5000/0xb4b2209fbdac62be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6589 expref: 19 pid: 8480 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.579219:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466383872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.579234:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579240:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579245:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579256:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579261:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579266:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579271:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb63a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.579273:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579279:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579286:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.579290:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.579315:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463678080:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 19024us (19412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.579320:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11548 00010000:00010000:0.0:1746147185.579480:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ec5a00/0xb4b2209fbdac630b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65ba expref: 9 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.579493:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382720:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.579502:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff6000/0xb4b2209fbdac61f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e64e8 expref: 35 pid: 11147 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.579508:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466382848:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147185.579522:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579528:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579533:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579547:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579552:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579558:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579562:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4bb600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147185.579565:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579570:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579578:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.579582:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bb600/0xb4b2209fbdac6366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.579620:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463677696:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 22371us (22460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.579625:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11544 00000100:00100000:0.0:1746147185.582236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.582304:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680640 00000100:00100000:2.0:1746147185.582313:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680640 00000100:00100000:2.0:1746147185.582345:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10468 00000100:00100000:2.0:1746147185.582353:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28826:x1830967463680640:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147185.582392:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.582409:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4800/0xb4b2209fbdac6343 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65e4 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582421:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.582424:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147185.582451:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.582461:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582468:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582473:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582479:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.582503:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582513:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 9 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.582524:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.582617:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 302 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582624:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 302 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.582632:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384512:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.582655:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.582662:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.582669:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384640:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.582684:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.584304:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.584312:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384512:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.584318:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466384640:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.584340:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.584463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.584490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.584553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.586511:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680768 00000100:00100000:1.0:1746147185.586521:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680768 00010000:00010000:1.0:1746147185.586557:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 10 pid: 16361 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.586584:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681024 00000100:00100000:1.0:1746147185.586586:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681024 00010000:00010000:1.0:1746147185.586594:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 11 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.586629:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463680896 00000100:00100000:1.0:1746147185.586632:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463680896 00010000:00010000:1.0:1746147185.586643:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 303 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.586657:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5701 00000100:00100000:1.0:1746147185.586664:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463680768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.586676:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.586680:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 11 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586690:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 11 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586706:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea2f000/0xb4b2209fbdac6294 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e655f expref: 11 pid: 16361 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586720:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.586725:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.586731:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.586767:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463680768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.586773:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5701 00000100:00100000:1.0:1746147185.586788:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5702 00000100:00100000:1.0:1746147185.586793:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463681024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.586799:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.586803:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586808:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586817:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19200/0xb4b2209fbdac6286 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6551 expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586824:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.586827:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.586831:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.586843:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463681024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.586847:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5702 00000100:00100000:1.0:1746147185.586855:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5703 00000100:00100000:1.0:1746147185.586859:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967463680896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.586864:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.586867:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 303 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586875:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 303 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586885:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b3400/0xb4b2209fbdac628d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6558 expref: 303 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.586891:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.586894:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.586900:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.586905:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147185.586920:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.586932:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1957:x1830967463680896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.586955:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5703 00010000:00010000:2.0:1746147185.587213:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.587220:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000040:00080000:2.0:1746147185.587742:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2897, 88 off240648 00000004:00080000:2.0:1746147185.587747:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574809719ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587785:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2850, 88 off236504 00000004:00080000:2.0:1746147185.587789:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574851493ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587799:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2851, 88 off236592 00000004:00080000:2.0:1746147185.587802:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574864203ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587809:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2898, 88 off240736 00000004:00080000:2.0:1746147185.587811:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574873899ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587817:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2899, 88 off240824 00000004:00080000:2.0:1746147185.587819:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574881996ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587826:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2852, 88 off236680 00000004:00080000:2.0:1746147185.587828:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574890913ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587835:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2853, 88 off236768 00000004:00080000:2.0:1746147185.587837:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574899759ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587843:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2854, 88 off236856 00000004:00080000:2.0:1746147185.587845:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574908026ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587851:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2900, 88 off240912 00000004:00080000:2.0:1746147185.587853:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574916259ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587859:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2855, 88 off236944 00000004:00080000:2.0:1746147185.587861:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574924169ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587867:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2901, 88 off241000 00000004:00080000:2.0:1746147185.587869:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574931983ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587875:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2856, 88 off237032 00000004:00080000:2.0:1746147185.587877:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574940128ns, next at 537465048041ns, rc = 0 00000040:00080000:2.0:1746147185.587883:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2902, 88 off241088 00000004:00080000:2.0:1746147185.587885:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574947548ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587891:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2903, 88 off241176 00000004:00080000:2.0:1746147185.587893:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574955624ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587898:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2904, 88 off241264 00000004:00080000:2.0:1746147185.587901:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574963784ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587906:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2905, 88 off241352 00000004:00080000:2.0:1746147185.587908:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572574971053ns, next at 537464818071ns, rc = 0 00000040:00080000:2.0:1746147185.587914:0:14049:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2857, 88 off237120 00000004:00080000:2.0:1746147185.587916:0:14049:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572574979126ns, next at 537465048041ns, rc = 0 00000001:00080000:3.0:1746147185.612252:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944206 is committed 00000001:00080000:3.0:1746147185.612271:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944211 is committed 00000004:00080000:3.0:1746147185.612275:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:3.0:1746147185.612544:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2042 committed 00000004:00080000:3.0:1746147185.612582:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2041 committed 00000004:00080000:3.0:1746147185.612584:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2040 committed 00000004:00080000:3.0:1746147185.612586:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2039 committed 00000004:00080000:3.0:1746147185.612587:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:3.0:1746147185.612588:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2038 committed 00000004:00080000:3.0:1746147185.612590:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:3.0:1746147185.612591:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2037 committed 00000004:00080000:3.0:1746147185.612592:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00000004:00080000:3.0:1746147185.612593:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00000004:00080000:3.0:1746147185.612595:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000004:00080000:3.0:1746147185.612596:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2036 committed 00000004:00080000:3.0:1746147185.612597:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2035 committed 00000004:00080000:3.0:1746147185.612598:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00000004:00080000:3.0:1746147185.612600:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1985 committed 00000004:00080000:3.0:1746147185.612601:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000001:00080000:3.0:1746147185.612606:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944210 is committed 00000001:00080000:3.0:1746147185.612627:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944207 is committed 00000100:00100000:0.0:1746147185.613172:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466384896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.613216:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613245:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613260:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613274:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746147185.613278:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466384768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613302:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613323:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613334:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613351:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613373:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613394:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147185.613398:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613418:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a47a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613429:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.613447:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466384896 00000100:00100000:0.0:1746147185.613453:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466384896 00000100:00100000:0.0:1746147185.613479:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385408 00000100:00100000:0.0:1746147185.613481:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385408 00000100:00100000:0.0:1746147185.613488:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466384768 00000100:00100000:0.0:1746147185.613490:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466384768 00000100:00100000:0.0:1746147185.613495:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385280 00000100:00100000:0.0:1746147185.613496:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385280 00000100:00100000:0.0:1746147185.613501:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385792 00000100:00100000:0.0:1746147185.613502:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385792 00000100:00100000:0.0:1746147185.613507:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385024 00000100:00100000:0.0:1746147185.613508:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385024 00000100:00100000:0.0:1746147185.613513:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385536 00000100:00100000:0.0:1746147185.613515:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385536 00000100:00100000:0.0:1746147185.613520:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385152 00000100:00100000:0.0:1746147185.613521:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385152 00000100:00100000:0.0:1746147185.613527:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385664 00000100:00100000:0.0:1746147185.613528:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385664 00000100:00100000:0.0:1746147185.613536:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11549 00000100:00100000:0.0:1746147185.613544:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830967466384896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.613720:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466384896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (502us total) trans 17179873200 rc 0/0 00000100:00100000:0.0:1746147185.613726:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11549 00000100:00100000:0.0:1746147185.613740:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11550 00000100:00100000:0.0:1746147185.613744:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466385408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.613831:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.613834:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.613836:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.613837:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.613839:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147185.613858:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466385408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (596us total) trans 21474840606 rc 0/0 00000100:00100000:0.0:1746147185.613863:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11550 00000100:00100000:0.0:1746147185.613876:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11551 00000100:00100000:0.0:1746147185.613880:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466384768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.613967:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466384768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (672us total) trans 21474840607 rc 0/0 00000100:00100000:0.0:1746147185.613971:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11551 00000100:00100000:0.0:1746147185.613979:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11552 00000100:00100000:0.0:1746147185.613983:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466385280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.614048:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466385280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (733us total) trans 21474840608 rc 0/0 00000100:00100000:0.0:1746147185.614052:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11552 00000100:00100000:0.0:1746147185.614059:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11553 00000100:00100000:0.0:1746147185.614063:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830967466385792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.614118:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147185.614120:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.614122:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.614123:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.614125:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147185.614139:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830967466385792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (804us total) trans 21474840609 rc 0/0 00000100:00100000:0.0:1746147185.614143:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11553 00000100:00100000:0.0:1746147185.614151:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11554 00000100:00100000:0.0:1746147185.614155:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466385024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.614224:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466385024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (858us total) trans 21474840610 rc 0/0 00000100:00100000:0.0:1746147185.614229:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11554 00000100:00100000:0.0:1746147185.614316:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11555 00000100:00100000:0.0:1746147185.614322:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466385536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.614385:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.614388:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.614390:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.614391:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.614393:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147185.614410:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466385536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1024us total) trans 21474840611 rc 0/0 00000100:00100000:0.0:1746147185.614415:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11555 00000100:00100000:0.0:1746147185.614425:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11556 00000100:00100000:0.0:1746147185.614429:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466385152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.614500:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466385152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1089us total) trans 21474840612 rc 0/0 00000100:00100000:0.0:1746147185.614505:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11556 00000100:00100000:0.0:1746147185.614514:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11557 00000100:00100000:0.0:1746147185.614517:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466385664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.614579:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.614582:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.614583:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.614585:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.614586:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147185.614604:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830967466385664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1174us total) trans 21474840613 rc 0/0 00000100:00100000:0.0:1746147185.614635:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11557 00000004:00080000:0.0:1746147185.614670:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47a9880/2, rc 0, transno 21474840612 00000100:00100000:0.0:1746147185.614677:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614683:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47a8a80/2, rc 0, transno 21474840613 00000100:00100000:0.0:1746147185.614686:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614691:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47a8e00/2, rc 0, transno 21474840610 00000100:00100000:0.0:1746147185.614693:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614698:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47ab480/2, rc 0, transno 21474840611 00000100:00100000:0.0:1746147185.614701:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466385536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614713:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47a9500/2, rc 0, transno 21474840607 00000100:00100000:0.0:1746147185.614716:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466384768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614722:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47abb80/2, rc 0, transno 21474840608 00000100:00100000:0.0:1746147185.614724:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614728:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937ef800/2, rc 0, transno 21474840609 00000100:00100000:0.0:1746147185.614730:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.614738:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d49bb80/2, rc 0, transno 17179873200 00000100:00100000:0.0:1746147185.614741:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466384896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.614747:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a47aad80/2, rc 0, transno 21474840606 00000100:00100000:0.0:1746147185.614749:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a47aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466385408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.614879:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147185.615569:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.615597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.615628:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.615642:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.615653:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147185.615658:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.615671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.615681:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.615693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.615709:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386176 00000100:00100000:3.0:1746147185.615713:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386176 00000100:00100000:3.0:1746147185.615732:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386688 00000100:00100000:3.0:1746147185.615733:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386688 00000100:00100000:3.0:1746147185.615741:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386048 00000100:00100000:3.0:1746147185.615743:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386048 00000100:00100000:3.0:1746147185.615750:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386560 00000100:00100000:3.0:1746147185.615751:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386560 00000100:00100000:3.0:1746147185.615758:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11558 00000100:00100000:3.0:1746147185.615762:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466386176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.615862:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466386176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (264us total) trans 17179873201 rc 0/0 00000100:00100000:3.0:1746147185.615867:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11558 00000100:00100000:3.0:1746147185.615877:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11559 00000100:00100000:3.0:1746147185.615881:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466386688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.615956:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:3.0:1746147185.615958:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.615960:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.615961:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.615963:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:3.0:1746147185.615979:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466386688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (337us total) trans 17179873202 rc 0/0 00000100:00100000:3.0:1746147185.615983:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11559 00000100:00100000:3.0:1746147185.615992:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11560 00000100:00100000:3.0:1746147185.615996:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466386048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.616068:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466386048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (395us total) trans 17179873203 rc 0/0 00000100:00100000:3.0:1746147185.616072:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11560 00000100:00100000:3.0:1746147185.616080:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11561 00000100:00100000:3.0:1746147185.616084:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3294:x1830967466386560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.616144:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.616146:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.616147:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.616149:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147185.616150:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147185.616166:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1830967466386560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (472us total) trans 17179873204 rc 0/0 00000100:00100000:3.0:1746147185.616170:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11561 00000004:00080000:3.0:1746147185.616193:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d499f80/2, rc 0, transno 17179873203 00000100:00100000:3.0:1746147185.616197:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.616202:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d498e00/2, rc 0, transno 17179873204 00000100:00100000:3.0:1746147185.616204:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386560:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.616209:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d498700/2, rc 0, transno 17179873201 00000100:00100000:3.0:1746147185.616211:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147185.616216:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d49b800/2, rc 0, transno 17179873202 00000100:00100000:3.0:1746147185.616218:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466386688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.616333:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.616355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.617644:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.617665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.617687:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386304 00000100:00100000:1.0:1746147185.617692:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386304 00000100:00100000:1.0:1746147185.617714:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11562 00000100:00100000:1.0:1746147185.617719:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3295:x1830967466386304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147185.617817:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147185.617820:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147185.617821:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147185.617823:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746147185.617824:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1746147185.617848:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1830967466386304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (1491us total) trans 17179873205 rc 0/0 00000100:00100000:1.0:1746147185.617853:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11562 00000004:00010000:3.0:1746147185.617909:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a47ab800 reply state ffff88009b69b000 transno 8589944211 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147185.617917:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147185.617988:0:14049:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147185.617998:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463680640:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 35644us (35765us total) trans 8589944211 rc 0/0 00000100:00100000:3.0:1746147185.618004:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10468 00010000:00010000:3.0:1746147185.618023:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618030:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618036:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618040:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f064400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.618044:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618050:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618062:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.618065:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147185.618068:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.618072:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064400/0xb4b2209fbdac6389 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147185.618148:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466385920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.618166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147185.618188:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d498a80/2, rc 0, transno 17179873205 00000100:00100000:2.0:1746147185.618192:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.618197:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147185.618202:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.618215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.618233:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386816 00000100:00100000:2.0:1746147185.618235:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386816 00000100:00100000:2.0:1746147185.618249:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466385920 00000100:00100000:2.0:1746147185.618250:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466385920 00000100:00100000:2.0:1746147185.618258:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466386432 00000100:00100000:2.0:1746147185.618260:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466386432 00000100:00100000:2.0:1746147185.618268:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11563 00000100:00100000:2.0:1746147185.618273:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967466386816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.618352:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147185.618354:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.618356:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.618358:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.618359:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1746147185.618381:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830967466386816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (714us total) trans 17179873206 rc 0/0 00000100:00100000:2.0:1746147185.618386:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11563 00000100:00100000:2.0:1746147185.618394:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11564 00000100:00100000:2.0:1746147185.618399:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830967466385920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.618485:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:2.0:1746147185.618487:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.618489:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.618490:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147185.618492:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:2.0:1746147185.618510:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3295:x1830967466385920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (343us total) trans 21474840614 rc 0/0 00000100:00100000:2.0:1746147185.618515:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11564 00000100:00100000:2.0:1746147185.618524:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11565 00000100:00100000:2.0:1746147185.618528:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830967466386432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.618601:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830967466386432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (384us total) trans 17179873207 rc 0/0 00000100:00100000:2.0:1746147185.618606:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11565 00000004:00080000:2.0:1746147185.618642:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d498380/2, rc 0, transno 17179873207 00000100:00100000:2.0:1746147185.618646:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.618652:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d49a300/2, rc 0, transno 17179873206 00000100:00100000:2.0:1746147185.618654:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466386816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.618660:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc94700/2, rc 0, transno 21474840614 00000100:00100000:2.0:1746147185.618663:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466385920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.618982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.620273:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681280 00000100:00100000:2.0:1746147185.620281:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681280 00000100:00100000:2.0:1746147185.620306:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10469 00000100:00100000:2.0:1746147185.620311:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+6:28830:x1830967463681280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147185.620326:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.620337:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65f2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.620403:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620412:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620420:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620428:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620432:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620436:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620500:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620507:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.620512:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.620532:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.620541:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 7 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.620550:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466386944:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147185.621063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.621596:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090f6dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.621618:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681408 00000100:00100000:2.0:1746147185.621622:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681408 00000100:00100000:2.0:1746147185.621654:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10470 00000100:00100000:2.0:1746147185.621659:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:28826:x1830967463681408:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.621669:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.621676:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e65f9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.621703:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.621711:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.621725:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.621728:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147185.621730:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4600, rc 0) 00000100:00100000:2.0:1746147185.621754:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463681408:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 95us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.621759:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10470 00000100:00100000:2.0:1746147185.623390:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466386944:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.623407:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147185.624314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.624388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.624446:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681664 00000100:00100000:3.0:1746147185.624452:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681664 00000100:00100000:2.0:1746147185.624474:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681536 00010000:00010000:3.0:1746147185.624477:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 8 pid: 14049 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.624478:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681536 00000100:00100000:2.0:1746147185.624639:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10471 00000100:00100000:2.0:1746147185.624647:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:28826:x1830967463681536:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.624660:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.624671:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4000/0xb4b2209fbdac63b3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6600 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.624725:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.624735:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.624742:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147185.624761:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147185.624764:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147185.624774:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.624793:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4000/0xb4b2209fbdac63b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6600 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.624821:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6600 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.624827:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.624829:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147185.624832:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4c00, rc 0) 00000100:00100000:2.0:1746147185.624864:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:28826:x1830967463681536:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 219us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.624875:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10471 00000100:00100000:3.0:1746147185.624876:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5704 00000100:00100000:3.0:1746147185.624883:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463681664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.624892:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.624897:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.624907:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.624918:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac6351 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65eb expref: 9 pid: 14049 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.624930:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.624933:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.624970:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.624975:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.624989:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.625015:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+8:1959:x1830967463681664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.625021:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5704 00010000:00010000:2.0:1746147185.625325:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625331:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147185.625340:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147185.625800:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625807:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625812:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625816:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.625819:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625825:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625833:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.625835:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147185.625838:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625841:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac63a5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625855:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625860:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625864:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625867:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec4e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.625868:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625872:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625877:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147185.625879:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.625881:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625885:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4e00/0xb4b2209fbdac6397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625891:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625895:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625899:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625903:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.625905:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625909:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625914:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48e00) 00010000:00010000:2.0:1746147185.625916:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.625917:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.625921:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac639e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147185.626275:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6390 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f2 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.626283:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f2 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.626290:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec5a00, rc 0) 00000100:00100000:2.0:1746147185.626388:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28830:x1830967463681280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6076us (7406us total) trans 8589944212 rc 301/301 00000100:00100000:2.0:1746147185.626394:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10469 00000100:00100000:0.0:1746147185.627203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.627234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.627659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.627848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.627868:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681920 00000100:00100000:2.0:1746147185.627877:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681920 00000100:00100000:3.0:1746147185.627912:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463682176 00000100:00100000:3.0:1746147185.627915:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463682176 00000100:00100000:3.0:1746147185.627932:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463682432 00000100:00100000:3.0:1746147185.627933:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463682432 00000100:00100000:3.0:1746147185.627966:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11566 00000100:00100000:3.0:1746147185.627973:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463681920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.627986:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.627999:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e660e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.628017:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814176e, atime: 0x6814176e, ctime: 0x6814176e, blocks: 0x821 00010000:00010000:3.0:1746147185.628030:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628032:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628038:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628049:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628056:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49edc00, rc 0) 00000100:00100000:3.0:1746147185.628096:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463681920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 124us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.628101:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11566 00000100:00100000:3.0:1746147185.628113:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11567 00000100:00100000:3.0:1746147185.628118:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463682176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.628124:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.628132:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e661c expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.628147:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x81f 00010000:00010000:3.0:1746147185.628154:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628155:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628158:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628166:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628171:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49eca00, rc 0) 00000100:00100000:3.0:1746147185.628184:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463682176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 67us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.628189:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11567 00000100:00100000:3.0:1746147185.628199:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11568 00000100:00100000:3.0:1746147185.628203:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463682432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147185.628207:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.628214:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e662a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147185.628223:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141771, atime: 0x68141771, ctime: 0x68141771, blocks: 0x1029 00010000:00010000:3.0:1746147185.628229:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628230:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.628233:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628243:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.628249:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ec800, rc 0) 00000100:00100000:3.0:1746147185.628263:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463682432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 60us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.628267:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11568 00000100:00100000:0.0:1746147185.628360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.628388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.628691:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463681792 00000100:00100000:2.0:1746147185.628695:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463681792 00000100:00100000:2.0:1746147185.628708:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463682048 00000100:00100000:2.0:1746147185.628710:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463682048 00000100:00100000:2.0:1746147185.628718:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463682304 00000100:00100000:2.0:1746147185.628719:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463682304 00000100:00100000:2.0:1746147185.628730:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11569 00000100:00100000:2.0:1746147185.628734:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463681792:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.628740:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.628748:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6607 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147185.628759:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x6814176b, atime: 0x6814176b, ctime: 0x6814176b, blocks: 0x7f7 00010000:00010000:2.0:1746147185.628766:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628767:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628771:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628780:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628786:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20a00, rc 0) 00000100:00100000:2.0:1746147185.628805:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463681792:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 71us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.628810:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11569 00000100:00100000:2.0:1746147185.628820:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11570 00000100:00100000:2.0:1746147185.628824:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463682048:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.628829:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.628836:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6615 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147185.628845:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x6814176f, atime: 0x6814176e, ctime: 0x6814176f, blocks: 0x81f 00010000:00010000:2.0:1746147185.628852:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628854:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628857:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628865:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628871:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20800, rc 0) 00000100:00100000:2.0:1746147185.628884:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463682048:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 60us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.628889:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11570 00000100:00100000:2.0:1746147185.628897:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11571 00000100:00100000:2.0:1746147185.628901:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463682304:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147185.628906:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.628912:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6623 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147185.628921:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4926336, mtime: 0x68141771, atime: 0x68141770, ctime: 0x68141771, blocks: 0x1567 00010000:00010000:2.0:1746147185.628926:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628927:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.628931:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628955:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.628961:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20600, rc 0) 00000100:00100000:2.0:1746147185.628973:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463682304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.628977:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11571 00000100:00100000:0.0:1746147185.645083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.645239:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683072 00000100:00100000:0.0:1746147185.645247:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683072 00000100:00100000:0.0:1746147185.645284:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683328 00000100:00100000:0.0:1746147185.645286:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683328 00000100:00100000:0.0:1746147185.645294:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683200 00000100:00100000:0.0:1746147185.645296:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683200 00000100:00100000:0.0:1746147185.645302:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683584 00000100:00100000:0.0:1746147185.645303:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683584 00000100:00100000:0.0:1746147185.645312:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683840 00000100:00100000:0.0:1746147185.645314:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683840 00000100:00100000:0.0:1746147185.645321:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463683712 00000100:00100000:0.0:1746147185.645322:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463683712 00000100:00100000:0.0:1746147185.645328:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463684224 00000100:00100000:0.0:1746147185.645329:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463684224 00000100:00100000:0.0:1746147185.645334:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463684480 00000100:00100000:0.0:1746147185.645335:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463684480 00000100:00100000:0.0:1746147185.645343:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4390 00000100:00100000:0.0:1746147185.645348:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463683072:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147185.645378:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.645388:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.645390:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.645393:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.645402:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.646533:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4391 00000100:00100000:2.0:1746147185.646543:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463683328:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147185.646572:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.646580:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.646582:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.646584:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.646592:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.646784:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4392 00000100:00100000:1.0:1746147185.646793:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463683200:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147185.646812:0:21471:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.646820:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.646821:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.646824:0:21471:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.646832:0:21471:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.647620:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4393 00000100:00100000:2.0:1746147185.647627:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463683584:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147185.647644:0:21473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.647651:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.647652:0:21473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.647655:0:21473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.647662:0:21473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.647771:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4394 00000100:00100000:1.0:1746147185.647779:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463683840:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147185.647793:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.647799:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.647801:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.647803:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.647810:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.648749:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4395 00000100:00100000:2.0:1746147185.648756:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463683712:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147185.648774:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.648780:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.648781:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.648784:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.648792:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.649801:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4396 00000100:00100000:0.0:1746147185.649808:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463684224:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147185.649825:0:26114:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.649832:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.649833:0:26114:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.649836:0:26114:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.649843:0:26114:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.650729:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4397 00000100:00100000:0.0:1746147185.650737:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463684480:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147185.650757:0:8484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.650763:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.650765:0:8484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.650768:0:8484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.650775:0:8484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.651705:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463682688 00000100:00100000:3.0:1746147185.651714:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463682688 00000100:00100000:3.0:1746147185.651769:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10472 00000100:00100000:3.0:1746147185.651774:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+301:28834:x1830967463682688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.651788:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.651804:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdac642a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6631 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.651884:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.651892:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.651899:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.651907:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.651912:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.651917:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652009:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652016:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652022:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147185.652029:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147185.652094:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652100:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652105:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652109:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea18a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.652112:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652117:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652125:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.652128:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147185.652131:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652139:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18a00/0xb4b2209fbdac643f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652155:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652159:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652163:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652167:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea18400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.652169:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652173:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652179:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147185.652180:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.652182:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652185:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18400/0xb4b2209fbdac6431 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652191:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652194:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652197:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652201:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea19e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.652203:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652208:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652212:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f5da600) 00010000:00010000:3.0:1746147185.652214:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.652216:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652220:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea19e00/0xb4b2209fbdac6438 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.652248:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdac642a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6631 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.652254:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49ec600/0xb4b2209fbdac642a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6631 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.652260:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ec600, rc 0) 00000100:00100000:3.0:1746147185.657231:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28834:x1830967463682688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5445us (12145us total) trans 8589944213 rc 301/301 00000100:00100000:3.0:1746147185.657241:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10472 00010000:00010000:2.0:1746147185.665395:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665411:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665418:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665424:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.665428:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665434:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665450:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.665455:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20c00/0xb4b2209fbdac63f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.666383:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463683328:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 19837us (21240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.666394:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4391 00010000:00010000:1.0:1746147185.667321:0:21471:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667334:0:21471:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667345:0:21471:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667350:0:21471:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea57400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.667353:0:21471:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667359:0:21471:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667373:0:21471:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.667377:0:21471:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6400 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.667437:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463683200:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 20644us (22277us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.667443:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4392 00010000:00010000:2.0:1746147185.673779:0:21473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673795:0:21473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673804:0:21473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673809:0:21473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f20200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.673813:0:21473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673819:0:21473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673835:0:21473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.673845:0:21473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20200/0xb4b2209fbdac6407 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.673978:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:60817ea3-97af-43a7-ab2a-b628d12800db+17:1958:x1830967463683584:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 26308us (28765us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.673987:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4393 00010000:00010000:0.0:1746147185.686581:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686597:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686606:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686622:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea57c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147185.686625:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686632:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686648:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.686654:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea57c00/0xb4b2209fbdac640e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.686739:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463683840:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 38955us (41554us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.686748:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4394 00010000:00010000:2.0:1746147185.688244:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688258:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688264:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688269:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dac4a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.688272:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688278:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688290:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.688296:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac63f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.689312:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463683072:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 43956us (44182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.689322:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4390 00010000:00010000:1.0:1746147185.693784:0:26114:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693802:0:26114:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693809:0:26114:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693817:0:26114:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bb600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147185.693821:0:26114:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693829:0:26114:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693844:0:26114:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.693850:0:26114:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac641c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26114 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.693924:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463684224:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 44112us (48721us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.693951:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4396 00010000:00010000:2.0:1746147185.701149:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701163:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701170:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701176:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.701180:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701188:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701203:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.701208:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ec5a00/0xb4b2209fbdac6415 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.701289:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463683712:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 52530us (56095us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.701301:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4395 00000100:00100000:0.0:1746147185.703139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.703401:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463684736 00000100:00100000:1.0:1746147185.703409:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463684736 00000100:00100000:1.0:1746147185.703462:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4140 00000100:00100000:1.0:1746147185.703470:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28834:x1830967463684736:12345-192.168.203.36@tcp:35:cat.0 00010000:00010000:2.0:1746147185.703496:0:8484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703509:0:8484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703516:0:8484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703521:0:8484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9ba000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147185.703524:0:8484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703529:0:8484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703542:0:8484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.703547:0:8484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac6423 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.703638:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463684480:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 52899us (58420us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.703646:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4397 00000100:00100000:1.0:1746147185.703696:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28834:x1830967463684736:12345-192.168.203.36@tcp:35:cat.0 Request processed in 225us (564us total) trans 8589944214 rc 0/0 00000100:00100000:1.0:1746147185.703703:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4140 00000100:00100000:0.0:1746147185.705894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.705972:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463684992 00000100:00100000:3.0:1746147185.705983:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463684992 00000100:00100000:3.0:1746147185.706039:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10473 00000100:00100000:3.0:1746147185.706047:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:28838:x1830967463684992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.706069:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.706085:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c000/0xb4b2209fbdac644d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6638 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.706169:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706178:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706186:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706196:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706201:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706205:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706287:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706294:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706300:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147185.706307:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147185.706367:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706376:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706382:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706386:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50cc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.706389:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706394:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706402:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.706405:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147185.706408:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706412:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50cc00/0xb4b2209fbdac6462 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706439:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706444:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706448:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706451:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50c400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.706453:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706461:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706467:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147185.706469:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.706471:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706475:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c400/0xb4b2209fbdac6454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706482:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706486:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706491:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706494:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50c600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.706496:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706500:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706505:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f5da600) 00010000:00010000:3.0:1746147185.706507:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.706508:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706512:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac645b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147185.706537:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c000/0xb4b2209fbdac644d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6638 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.706544:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c000/0xb4b2209fbdac644d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6638 expref: 9 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.706550:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c000, rc 0) 00000100:00100000:3.0:1746147185.706606:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28838:x1830967463684992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 560us (717us total) trans 8589944215 rc 301/301 00000100:00100000:3.0:1746147185.706621:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10473 00000100:00100000:0.0:1746147185.708738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.709529:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463685376 00000100:00100000:3.0:1746147185.709539:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463685376 00000100:00100000:3.0:1746147185.709577:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10474 00000100:00100000:3.0:1746147185.709584:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28835:x1830967463685376:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147185.709604:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.709627:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdac6470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6646 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.709712:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709721:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709728:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709739:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709744:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709749:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709828:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709835:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.709841:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147185.709847:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00100000:2.0:1746147185.710325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.710355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.710366:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463685120 00000100:00100000:2.0:1746147185.710369:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463685120 00000100:00100000:2.0:1746147185.710383:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463685632 00000100:00100000:2.0:1746147185.710384:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463685632 00000100:00100000:2.0:1746147185.710395:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10475 00000100:00100000:2.0:1746147185.710399:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28834:x1830967463685120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.710405:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.710411:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac6493 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e663f expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710445:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710451:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710457:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147185.710469:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147185.710472:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147185.710482:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710500:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5400/0xb4b2209fbdac6493 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 308 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710512:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 307 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710519:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.710521:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147185.710524:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ec4400, rc 0) 00000100:00100000:2.0:1746147185.710565:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+307:28834:x1830967463685120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 165us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.710570:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10475 00000100:00100000:2.0:1746147185.710584:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10476 00000100:00100000:2.0:1746147185.710588:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463685632:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147185.710604:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.710624:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4c00/0xb4b2209fbdac63ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6600 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710632:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.710634:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147185.710649:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710655:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710660:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710683:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710692:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 306 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147185.710701:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466387072:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.710755:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090f6df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.710835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.710850:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463685760 00000100:00100000:2.0:1746147185.710853:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463685760 00000100:00100000:2.0:1746147185.710869:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10477 00000100:00100000:2.0:1746147185.710874:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28838:x1830967463685760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.710882:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.710888:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac64a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e664d expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.710915:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.710921:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710925:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.710932:0:14125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.710957:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.711155:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711163:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711168:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711172:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50d400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.711174:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711180:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711186:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.711189:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147185.711191:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711195:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d400/0xb4b2209fbdac6485 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711205:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711210:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711214:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711218:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50d000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.711219:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711224:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711229:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147185.711231:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.711233:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711237:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d000/0xb4b2209fbdac6477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711244:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711248:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711252:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711255:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d50d200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147185.711257:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711260:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711264:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f5da100) 00010000:00010000:3.0:1746147185.711266:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147185.711267:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711271:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d200/0xb4b2209fbdac647e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147185.711297:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdac6470 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6646 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.711303:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50ce00/0xb4b2209fbdac6470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6646 expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.711310:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50ce00, rc 0) 00000100:00100000:3.0:1746147185.711333:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28835:x1830967463685376:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1750us (2602us total) trans 8589944216 rc 301/301 00000100:00100000:3.0:1746147185.711338:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10474 00000100:00100000:2.0:1746147185.712815:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466387072:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147185.712831:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147185.721482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.721501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.721518:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463685888 00000100:00100000:1.0:1746147185.721526:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463685888 00000100:00100000:1.0:1746147185.721803:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686016 00000100:00100000:1.0:1746147185.721807:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686016 00000100:00100000:0.0:1746147185.721841:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11572 00000100:00100000:0.0:1746147185.721849:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463685888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.721866:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.721880:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6654 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.721898:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.721899:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.721906:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.721923:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 35 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.721931:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17c600, rc 0) 00000100:00100000:0.0:1746147185.721994:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463685888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.722000:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11572 00000100:00100000:0.0:1746147185.722015:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11573 00000100:00100000:0.0:1746147185.722021:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463686016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.722027:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.722035:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e665b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.722045:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.722046:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.722049:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.722057:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.722068:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17c800, rc 0) 00000100:00100000:0.0:1746147185.722083:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463686016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.722087:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11573 00000100:00100000:2.0:1746147185.722154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.722190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.723302:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686144 00000100:00100000:1.0:1746147185.723310:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686144 00000100:00100000:1.0:1746147185.723328:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686272 00000100:00100000:1.0:1746147185.723330:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686272 00000100:00100000:1.0:1746147185.723349:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11574 00000100:00100000:1.0:1746147185.723355:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463686144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.723366:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.723374:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6662 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.723386:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.723388:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.723393:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 37 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.723403:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 37 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.723410:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e957c00, rc 0) 00000100:00100000:1.0:1746147185.723433:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463686144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.723438:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11574 00000100:00100000:1.0:1746147185.723448:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11575 00000100:00100000:1.0:1746147185.723453:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463686272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.723461:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.723469:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6669 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.723478:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.723480:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.723483:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 36 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.723491:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 36 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.723497:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e956200, rc 0) 00000100:00100000:1.0:1746147185.723511:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463686272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 58us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.723516:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11575 00000100:00100000:1.0:1746147185.724068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.724555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.724588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.724728:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686656 00000100:00100000:3.0:1746147185.724735:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686656 00010000:00010000:3.0:1746147185.724757:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.724786:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5705 00000100:00100000:3.0:1746147185.724792:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1959:x1830967463686656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.724801:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.724806:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.724815:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.724829:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4400/0xb4b2209fbdac649a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e663f expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.724844:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.724848:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.724854:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147185.724860:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147185.724865:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147185.724870:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.724878:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.724892:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.724927:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686400 00000100:00100000:2.0:1746147185.724932:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686400 00000100:00100000:2.0:1746147185.724963:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686528 00000100:00100000:2.0:1746147185.724965:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686528 00000100:00100000:2.0:1746147185.724977:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11576 00000100:00100000:2.0:1746147185.724982:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463686400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.724990:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.724999:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6670 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.725010:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.725012:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.725016:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.725026:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 37 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.725032:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064600, rc 0) 00000100:00100000:2.0:1746147185.725547:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463686400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 563us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.725553:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11576 00000100:00100000:2.0:1746147185.725565:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11577 00000100:00100000:2.0:1746147185.725570:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463686528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.725576:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.725584:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6677 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.725598:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.725599:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.725603:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 38 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.725624:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 38 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.725630:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064800, rc 0) 00000100:00100000:2.0:1746147185.725645:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463686528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.725650:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11577 00010000:00010000:2.0:1746147185.725666:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.725672:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000004:00010000:2.0:1746147185.725791:0:14048:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ee5e300 reply state ffff88009d62c000 transno 8589944217 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147185.725798:0:14048:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147185.725842:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:28826:x1830967463685632:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 15253us (15486us total) trans 8589944217 rc 0/0 00000100:00100000:2.0:1746147185.725848:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10476 00000100:00100000:3.0:1746147185.726234:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1959:x1830967463686656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1440us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.726242:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5705 00000100:00100000:3.0:1746147185.729125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729185:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686784 00000100:00100000:3.0:1746147185.729193:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686784 00000100:00100000:3.0:1746147185.729219:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687040 00000100:00100000:3.0:1746147185.729221:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687040 00000100:00100000:3.0:1746147185.729230:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687296 00000100:00100000:3.0:1746147185.729231:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687296 00000100:00100000:3.0:1746147185.729238:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463686912 00000100:00100000:3.0:1746147185.729239:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463686912 00000100:00100000:3.0:1746147185.729250:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11578 00000100:00100000:3.0:1746147185.729256:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463686784:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.729406:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147185.729409:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147179 -> 1746147185 00002000:00010000:3.0:1746147185.729411:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147179 -> 1746147185 00002000:00010000:3.0:1746147185.729413:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147179 -> 1746147185 00002000:00010000:3.0:1746147185.729415:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:3.0:1746147185.729448:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463686784:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 191us (329us total) trans 21474840615 rc 0/0 00000100:00100000:3.0:1746147185.729455:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11578 00000100:00100000:3.0:1746147185.729467:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11579 00000100:00100000:3.0:1746147185.729472:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463687040:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.729552:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147185.729554:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147183 -> 1746147185 00002000:00010000:3.0:1746147185.729556:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147182 -> 1746147185 00002000:00010000:3.0:1746147185.729558:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147183 -> 1746147185 00002000:00010000:3.0:1746147185.729560:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147185.729575:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463687040:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 102us (427us total) trans 17179873208 rc 0/0 00000100:00100000:3.0:1746147185.729580:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11579 00000100:00100000:3.0:1746147185.729589:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11580 00000100:00100000:3.0:1746147185.729593:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463687296:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.729660:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4926336 -> 4926336 00002000:00010000:3.0:1746147185.729662:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.729664:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147184 -> 1746147185 00002000:00010000:3.0:1746147185.729665:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.729667:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:3.0:1746147185.729681:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463687296:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 88us (522us total) trans 21474840616 rc 0/0 00000100:00100000:3.0:1746147185.729687:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11580 00000100:00100000:3.0:1746147185.729695:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11581 00000100:00100000:3.0:1746147185.729699:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463686912:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.729753:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147185.729755:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147182 -> 1746147185 00002000:00010000:3.0:1746147185.729757:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147182 -> 1746147185 00002000:00010000:3.0:1746147185.729758:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147182 -> 1746147185 00002000:00010000:3.0:1746147185.729760:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147185.729778:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463686912:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 78us (606us total) trans 17179873209 rc 0/0 00000100:00100000:3.0:1746147185.729782:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11581 00000100:00100000:3.0:1746147185.729812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729826:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687168 00000100:00100000:3.0:1746147185.729829:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687168 00000100:00100000:3.0:1746147185.729842:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11582 00000100:00100000:3.0:1746147185.729846:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463687168:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.729903:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147185.729905:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147184 -> 1746147185 00002000:00010000:3.0:1746147185.729907:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147184 -> 1746147185 00002000:00010000:3.0:1746147185.729909:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147184 -> 1746147185 00002000:00010000:3.0:1746147185.729910:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147185.729925:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+16:1959:x1830967463687168:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 78us (112us total) trans 21474840617 rc 0/0 00000100:00100000:3.0:1746147185.729930:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11582 00000100:00100000:3.0:1746147185.729988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.729996:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687424 00000100:00100000:3.0:1746147185.729999:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687424 00000100:00100000:3.0:1746147185.730010:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11583 00000100:00100000:3.0:1746147185.730013:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463687424:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147185.730063:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.730065:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.730067:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.730068:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.730070:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147185.730083:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463687424:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 69us (95us total) trans 17179873210 rc 0/0 00000100:00100000:3.0:1746147185.730087:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11583 00000100:00100000:3.0:1746147185.732781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.732811:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687552 00000100:00100000:3.0:1746147185.732819:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687552 00000100:00100000:3.0:1746147185.732853:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10478 00000100:00100000:3.0:1746147185.732859:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28834:x1830967463687552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.732876:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.732890:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e667e expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.732955:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.732967:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.732984:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.732987:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147185.732990:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50d600, rc 0) 00000100:00100000:3.0:1746147185.733022:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28834:x1830967463687552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 163us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.733028:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10478 00010000:00010000:2.0:1746147185.733097:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733104:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733110:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733114:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ec5800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147185.733117:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733125:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733133:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.733135:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147185.733138:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.733147:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.733152:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147185.733172:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147185.733176:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec5800/0xb4b2209fbdac64a1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147185.733286:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.733291:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147185.733314:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147185.733317:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147185.733327:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.733348:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac64a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e664d expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.733367:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e664d expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.733372:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.733374:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147185.733376:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bb600, rc 0) 00000100:00100000:3.0:1746147185.733403:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28838:x1830967463685760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 22528us (22567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.733407:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10477 00000100:00100000:3.0:1746147185.739428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.739449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.739801:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687680 00000100:00100000:0.0:1746147185.739811:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687680 00000100:00100000:0.0:1746147185.739852:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687808 00000100:00100000:0.0:1746147185.739854:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687808 00000100:00100000:0.0:1746147185.739873:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11584 00000100:00100000:0.0:1746147185.739879:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463687680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.739900:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.739919:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6685 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.739964:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.739966:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.739975:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.739990:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147185.739993:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11585 00010000:00010000:0.0:1746147185.740002:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17d000, rc 0) 00000100:00100000:2.0:1746147185.740008:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463687808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.740025:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.740041:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e668c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.740047:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463687680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 167us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.740053:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11584 00010000:00010000:2.0:1746147185.740063:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.740064:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147185.740071:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.740083:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.740092:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064400, rc 0) 00000100:00100000:2.0:1746147185.740410:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463687808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 407us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.740416:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11585 00000100:00100000:3.0:1746147185.740830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.740873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.740887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.741261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.741639:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463687936 00000100:00100000:2.0:1746147185.741645:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463687936 00000100:00100000:0.0:1746147185.741676:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463688064 00000100:00100000:0.0:1746147185.741679:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463688064 00000100:00100000:0.0:1746147185.741696:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463688192 00000100:00100000:0.0:1746147185.741698:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463688192 00000100:00100000:0.0:1746147185.741713:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463688320 00000100:00100000:0.0:1746147185.741714:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463688320 00000100:00100000:0.0:1746147185.741724:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11586 00000100:00100000:0.0:1746147185.741730:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463687936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.741740:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.741750:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6693 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.741765:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741766:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741771:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741782:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741789:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17d600, rc 0) 00000100:00100000:0.0:1746147185.741810:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463687936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 80us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.741815:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11586 00000100:00100000:0.0:1746147185.741824:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11587 00000100:00100000:0.0:1746147185.741828:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463688064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.741833:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.741840:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e669a expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.741850:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741851:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741855:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741864:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741871:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17d800, rc 0) 00000100:00100000:0.0:1746147185.741883:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463688064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.741888:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11587 00000100:00100000:0.0:1746147185.741899:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11588 00000100:00100000:0.0:1746147185.741903:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463688192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.741908:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.741913:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66a1 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.741922:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741923:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.741926:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741933:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 22 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.741957:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17cc00, rc 0) 00000100:00100000:0.0:1746147185.741968:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463688192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.741972:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11588 00000100:00100000:0.0:1746147185.741980:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11589 00000100:00100000:0.0:1746147185.741983:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463688320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.741988:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.741992:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66a8 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.742000:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.742001:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.742004:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.742011:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.742016:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17d200, rc 0) 00000100:00100000:0.0:1746147185.742025:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463688320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 41us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.742029:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11589 00000100:00100000:3.0:1746147185.742408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.743485:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463688576 00000100:00100000:0.0:1746147185.743491:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463688576 00000100:00100000:0.0:1746147185.743522:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4141 00000100:00100000:0.0:1746147185.743528:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+8:28826:x1830967463688576:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147185.743850:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:28826:x1830967463688576:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 321us (1441us total) trans 8589944218 rc 0/0 00000100:00100000:0.0:1746147185.743855:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4141 00000100:00100000:2.0:1746147185.743954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.743973:0:8484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463688960 00000100:00100000:2.0:1746147185.743976:0:8484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463688960 00002000:00100000:2.0:1746147185.744002:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009ee5ed80 x1830967463688960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.744011:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967463688960 ext(0->1048575) 00002000:00010000:2.0:1746147185.744016:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5ed80 00000100:00100000:2.0:1746147185.744030:0:8484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4398 00000100:00100000:2.0:1746147185.744035:0:8484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463688960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.748149:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.748173:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463689088 00000100:00100000:0.0:1746147185.748179:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463689088 00002000:00100000:0.0:1746147185.748213:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d36680 x1830967463689088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.748222:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36680 with x1830967463689088 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.748226:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d36680 00000100:00100000:0.0:1746147185.748248:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4399 00000100:00100000:0.0:1746147185.748254:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463689088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.749073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.749087:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463689344 00000100:00100000:1.0:1746147185.749090:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463689344 00002000:00100000:1.0:1746147185.749108:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d499c00 x1830967463689344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.749115:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967463689344 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.749118:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:1.0:1746147185.749131:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4400 00000100:00100000:1.0:1746147185.749137:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463689344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.750326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.750373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.750445:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463689600 00000100:00100000:2.0:1746147185.750450:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463689600 00002000:00100000:2.0:1746147185.750472:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012d499500 x1830967463689600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.750480:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967463689600 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.750483:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499500 00000100:00100000:2.0:1746147185.750496:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4401 00000100:00100000:2.0:1746147185.750501:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463689600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.751918:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463689856 00000100:00100000:0.0:1746147185.751925:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463689856 00000100:00100000:0.0:1746147185.751972:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4142 00000100:00100000:0.0:1746147185.751979:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:28826:x1830967463689856:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147185.752137:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:28826:x1830967463689856:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 158us (1762us total) trans 8589944219 rc 0/0 00000100:00100000:0.0:1746147185.752144:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4142 00000100:00100000:3.0:1746147185.753280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.753342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.753454:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463690368 00000100:00100000:2.0:1746147185.753458:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463690368 00002000:00100000:2.0:1746147185.753485:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012ba5a680 x1830967463690368/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.753493:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5a680 with x1830967463690368 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.753498:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5a680 00000100:00100000:2.0:1746147185.754115:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463690624 00000100:00100000:2.0:1746147185.754119:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463690624 00002000:00100000:2.0:1746147185.754134:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012ba58000 x1830967463690624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.754142:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58000 with x1830967463690624 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.754145:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58000 00000100:00100000:3.0:1746147185.754171:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4402 00000100:00100000:3.0:1746147185.754178:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463690368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.755506:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4403 00000100:00100000:2.0:1746147185.755515:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463690624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.760034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.761409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.761727:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463690240 00000100:00100000:2.0:1746147185.761735:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463690240 00002000:00100000:2.0:1746147185.761774:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d34700 x1830967463690240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.761784:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34700 with x1830967463690240 ext(0->1048575) 00002000:00010000:2.0:1746147185.761790:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34700 00000100:00100000:2.0:1746147185.761825:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463690880 00000100:00100000:2.0:1746147185.761827:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463690880 00002000:00100000:2.0:1746147185.761838:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880093d37480 x1830967463690880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.761845:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37480 with x1830967463690880 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.761848:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d37480 00000100:00100000:2.0:1746147185.761862:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4404 00000100:00100000:2.0:1746147185.761868:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463690240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.763715:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4405 00000100:00100000:0.0:1746147185.763725:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463690880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.767589:0:8484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463688960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23541us (23622us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.767601:0:8484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4398 00002000:00100000:2.0:1746147185.767624:0:8484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009ee5ed80 x1830967463688960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.767634:0:8484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967463688960 ext(0->1048575) 00002000:00010000:2.0:1746147185.767641:0:8484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5ed80 00000100:00100000:1.0:1746147185.769545:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463689344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20397us (20462us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.769661:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4400 00002000:00100000:1.0:1746147185.769672:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d499c00 x1830967463689344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.769688:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967463689344 ext(1048576->2097151) 00002000:00010000:1.0:1746147185.769693:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:3.0:1746147185.771918:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463689600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21407us (21585us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.771930:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4401 00002000:00100000:3.0:1746147185.771963:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012d499500 x1830967463689600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.771971:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499500 with x1830967463689600 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.771976:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d499500 00000100:00100000:2.0:1746147185.777165:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463689088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28900us (29015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.777177:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4399 00002000:00100000:2.0:1746147185.777189:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d36680 x1830967463689088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.777199:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36680 with x1830967463689088 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.777205:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d36680 00000100:00100000:3.0:1746147185.782806:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463690368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28615us (29514us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.782820:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4402 00002000:00100000:3.0:1746147185.782831:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012ba5a680 x1830967463690368/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.782841:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5a680 with x1830967463690368 ext(1048576->2097151) 00002000:00010000:3.0:1746147185.782848:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5a680 00000100:00100000:2.0:1746147185.790414:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463690624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34890us (37060us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.790428:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4403 00002000:00100000:2.0:1746147185.790440:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012ba58000 x1830967463690624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.790449:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58000 with x1830967463690624 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.790455:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58000 00000100:00100000:2.0:1746147185.795506:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463690240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 33627us (35471us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.795518:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4404 00002000:00100000:2.0:1746147185.795529:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d34700 x1830967463690240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.795538:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34700 with x1830967463690240 ext(0->1048575) 00002000:00010000:2.0:1746147185.795544:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34700 00000100:00100000:2.0:1746147185.796972:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463690880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 33243us (35561us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.796980:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4405 00002000:00100000:2.0:1746147185.796988:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880093d37480 x1830967463690880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.797417:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37480 with x1830967463690880 ext(1048576->2097151) 00002000:00010000:2.0:1746147185.797424:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d37480 00000100:00100000:0.0:1746147185.805364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.805399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.805427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.805442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.805469:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463691264 00000100:00100000:2.0:1746147185.805470:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463691392 00000100:00100000:3.0:1746147185.805476:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463691264 00000100:00100000:2.0:1746147185.805476:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463691392 00000100:00100000:0.0:1746147185.805485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.805516:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463691776 00002000:00100000:3.0:1746147185.805519:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d35500 x1830967463691264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.805519:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880093d34e00 x1830967463691392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147185.805519:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463691776 00002000:00100000:3.0:1746147185.805535:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35500 with x1830967463691264 ext(2097152->3145727) 00002000:00100000:2.0:1746147185.805535:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34e00 with x1830967463691392 ext(3145728->4194303) 00002000:00100000:0.0:1746147185.805537:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d37b80 x1830967463691776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746147185.805540:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35500 00002000:00010000:2.0:1746147185.805540:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34e00 00002000:00100000:0.0:1746147185.805544:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463691776 ext(3145728->4194303) 00002000:00010000:0.0:1746147185.805548:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:2.0:1746147185.805555:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463691648 00000100:00100000:2.0:1746147185.805557:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463691648 00000100:00100000:3.0:1746147185.805564:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4406 00002000:00100000:2.0:1746147185.805567:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daace00 x1830967463691648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.805572:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daace00 with x1830967463691648 ext(2097152->3145727) 00002000:00010000:2.0:1746147185.805575:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daace00 00000100:00100000:0.0:1746147185.805580:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4407 00000100:00100000:2.0:1746147185.805584:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4408 00000100:00100000:0.0:1746147185.805586:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463691264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.805589:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463691776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.805622:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4409 00000100:00100000:1.0:1746147185.805629:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463691648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.806842:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692032 00000100:00100000:0.0:1746147185.806848:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692032 00000100:00100000:0.0:1746147185.806881:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10479 00000100:00100000:0.0:1746147185.806888:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28838:x1830967463692032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.806901:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147185.806907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147185.806920:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66af expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.806995:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.807009:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.807032:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.807035:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147185.807038:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63c00, rc 0) 00000100:00100000:0.0:1746147185.807061:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28838:x1830967463692032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 174us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.807067:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10479 00000100:00100000:0.0:1746147185.807083:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692288 00000100:00100000:0.0:1746147185.807086:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692288 00000100:00100000:3.0:1746147185.807232:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463691392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.809231:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10480 00000100:00100000:1.0:1746147185.809242:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28830:x1830967463692288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147185.809258:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.809261:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147185.809282:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bb600/0xb4b2209fbdac64af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e664d expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809302:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.809306:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147185.809315:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216400/0xb4b2209fbdac6518 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66b6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809357:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147185.809368:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809374:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809379:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809384:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147185.809410:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 10 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809419:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.809428:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387200:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.809504:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 304 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809510:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 304 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.809517:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387328:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.809535:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.809542:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 9 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.809548:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.809559:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.819970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.820003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.820228:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387200:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.820237:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387328:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147185.820244:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.820264:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463691776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14674us (14835us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746147185.820268:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147185.820273:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4408 00002000:00100000:1.0:1746147185.820284:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d37b80 x1830967463691776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.820293:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463691776 ext(3145728->4194303) 00002000:00010000:1.0:1746147185.820298:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:3.0:1746147185.820343:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692416 00000100:00100000:3.0:1746147185.820349:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692416 00010000:00010000:3.0:1746147185.820375:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.820394:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692544 00000100:00100000:3.0:1746147185.820396:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692544 00010000:00010000:3.0:1746147185.820405:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.820418:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5706 00000100:00100000:3.0:1746147185.820424:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+305:1957:x1830967463692416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.820436:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.820441:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820450:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820470:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac64e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e667e expref: 305 pid: 14048 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820493:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.820497:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.820504:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.820510:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.820529:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1957:x1830967463692416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.820534:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5706 00000100:00100000:3.0:1746147185.820547:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5707 00000100:00100000:3.0:1746147185.820552:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463692544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.820558:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147185.820561:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820568:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820578:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ec4600/0xb4b2209fbdac63ac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e65f9 expref: 10 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.820586:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.820589:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.820904:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.820909:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147185.820950:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463692544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 382us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.820955:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5707 00010000:00010000:2.0:1746147185.821143:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147185.824622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.824681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.824683:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692672 00000100:00100000:1.0:1746147185.824691:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692672 00000100:00100000:0.0:1746147185.824700:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692800 00000100:00100000:0.0:1746147185.824704:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692800 00010000:00010000:1.0:1746147185.824721:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 12 pid: 14125 timeout: 672 lvb_type: 0 00000100:00100000:0.0:1746147185.824731:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10481 00000100:00100000:0.0:1746147185.824737:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28838:x1830967463692800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.824755:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.824770:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66bd expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.825126:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463691264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19539us (19770us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.825134:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4407 00002000:00100000:2.0:1746147185.825142:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880093d35500 x1830967463691264/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.825157:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35500 with x1830967463691264 ext(2097152->3145727) 00002000:00010000:2.0:1746147185.825161:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35500 00000100:00100000:1.0:1746147185.825271:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5708 00000100:00100000:1.0:1746147185.825278:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463692672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.825286:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.825291:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 13 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:0.0:1746147185.825293:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147185.825302:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.825377:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 13 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.825393:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63c00/0xb4b2209fbdac6511 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66af expref: 13 pid: 14125 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.825416:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.825419:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147185.825425:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147185.825431:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 5/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000020 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147185.825436:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.825671:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 5/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147185.825685:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.825695:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147185.825698:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147185.825700:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.825706:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63a00, rc 0) 00010000:00010000:1.0:1746147185.825911:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.825951:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463692672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 673us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.825956:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5708 00010000:00010000:3.0:1746147185.827361:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147185.827373:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000040:00080000:3.0:1746147185.827985:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2906, 88 off241440 00000004:00080000:3.0:1746147185.827992:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815054069ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828031:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2858, 88 off237208 00000004:00080000:3.0:1746147185.828035:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815097428ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828050:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2859, 88 off237296 00000004:00080000:3.0:1746147185.828053:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815115239ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828059:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2907, 88 off241528 00000004:00080000:3.0:1746147185.828061:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815123574ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828067:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2908, 88 off241616 00000004:00080000:3.0:1746147185.828069:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815132174ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828075:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2860, 88 off237384 00000004:00080000:3.0:1746147185.828077:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815140317ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828084:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2861, 88 off237472 00000004:00080000:3.0:1746147185.828086:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815148774ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828114:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2863, 88 off237656 00000004:00080000:3.0:1746147185.828117:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815180199ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828125:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2909, 88 off241704 00000004:00080000:3.0:1746147185.828127:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815190158ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828133:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2864, 88 off237744 00000004:00080000:3.0:1746147185.828135:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815198064ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147185.828140:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2910, 88 off241792 00000004:00080000:3.0:1746147185.828142:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815205147ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828147:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2865, 88 off237832 00000004:00080000:3.0:1746147185.828149:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572815211523ns, next at 537465048041ns, rc = 0 00000100:00100000:1.0:1746147185.828524:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463691648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22895us (23079us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.828535:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4409 00002000:00100000:1.0:1746147185.828546:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daace00 x1830967463691648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.828561:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daace00 with x1830967463691648 ext(2097152->3145727) 00002000:00010000:1.0:1746147185.828566:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daace00 00000100:00100000:3.0:1746147185.828868:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28838:x1830967463692800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3458us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.828877:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10481 00000040:00080000:3.0:1746147185.828917:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2911, 88 off241880 00000004:00080000:3.0:1746147185.828922:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572815985089ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828967:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2912, 88 off241968 00000004:00080000:3.0:1746147185.828970:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572816032766ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828980:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2913, 88 off242056 00000004:00080000:3.0:1746147185.828983:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572816045609ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.828990:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2914, 88 off242144 00000004:00080000:3.0:1746147185.828993:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572816055404ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147185.829011:0:14125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2866, 88 off237920 00000004:00080000:3.0:1746147185.829014:0:14125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572816076764ns, next at 537465048041ns, rc = 0 00000100:00100000:3.0:1746147185.830987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.831052:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463692928 00000100:00100000:2.0:1746147185.831060:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463692928 00000100:00100000:2.0:1746147185.831107:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10482 00000100:00100000:2.0:1746147185.831115:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:28835:x1830967463692928:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147185.831134:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.831152:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66c4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.831207:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.831218:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.831230:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147185.831233:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147185.831237:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147185.831243:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88e00, rc 0) 00000100:00100000:2.0:1746147185.831285:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28835:x1830967463692928:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 170us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.831291:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10482 00000100:00100000:3.0:1746147185.835874:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463691392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30296us (30465us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.835886:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4406 00002000:00100000:3.0:1746147185.835898:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880093d34e00 x1830967463691392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.835913:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34e00 with x1830967463691392 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.835919:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d34e00 00000001:00080000:2.0:1746147185.867303:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944219 is committed 00000001:00080000:2.0:1746147185.867322:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944214 is committed 00000001:00080000:2.0:1746147185.867330:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944212 is committed 00000001:00080000:2.0:1746147185.867335:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944220 is committed 00000004:00080000:2.0:1746147185.867339:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:2.0:1746147185.867346:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2051 committed 00000004:00080000:2.0:1746147185.867351:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2050 committed 00000004:00080000:2.0:1746147185.867353:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2049 committed 00000004:00080000:2.0:1746147185.867354:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2048 committed 00000004:00080000:2.0:1746147185.867356:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:2.0:1746147185.867357:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2047 committed 00000004:00080000:2.0:1746147185.867359:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:2.0:1746147185.867360:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2046 committed 00000004:00080000:2.0:1746147185.867362:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:2.0:1746147185.867363:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000004:00080000:2.0:1746147185.867365:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000004:00080000:2.0:1746147185.867366:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2045 committed 00000004:00080000:2.0:1746147185.867368:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2044 committed 00000004:00080000:2.0:1746147185.867369:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:2.0:1746147185.867371:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:2.0:1746147185.867372:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2043 committed 00000001:00080000:2.0:1746147185.867378:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944216 is committed 00010000:00010000:3.0:1746147185.867488:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867500:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.867503:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147185.867507:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867516:0:14125:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867523:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867529:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 301 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867536:0:14125:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 301 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867542:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 301 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.867579:0:14125:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 301 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.867596:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387584:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.867700:0:14125:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.867708:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387712:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.867734:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130f02300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.868754:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466387968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.868797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868816:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.868828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868837:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.868848:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868856:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.868867:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868879:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147185.868882:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.868895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868902:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.868913:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868922:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.868932:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868964:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.868975:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.868994:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466387968 00000100:00100000:0.0:1746147185.868999:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466387968 00000100:00100000:0.0:1746147185.869026:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11590 00000100:00100000:0.0:1746147185.869032:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3293:x1830967466387968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.869197:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.869200:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869202:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869204:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869206:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147185.869227:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3293:x1830967466387968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (430us total) trans 17179873211 rc 0/0 00000100:00100000:0.0:1746147185.869232:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11590 00000100:00100000:0.0:1746147185.869252:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388480 00000100:00100000:0.0:1746147185.869255:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388480 00000100:00100000:0.0:1746147185.869267:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388992 00000100:00100000:0.0:1746147185.869269:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388992 00000100:00100000:0.0:1746147185.869277:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389504 00000100:00100000:0.0:1746147185.869278:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389504 00000100:00100000:0.0:1746147185.869284:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388096 00000100:00100000:0.0:1746147185.869286:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388096 00000100:00100000:0.0:1746147185.869292:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388608 00000100:00100000:0.0:1746147185.869293:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388608 00000100:00100000:0.0:1746147185.869298:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389120 00000100:00100000:0.0:1746147185.869299:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389120 00000100:00100000:0.0:1746147185.869305:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389632 00000100:00100000:0.0:1746147185.869306:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389632 00000100:00100000:0.0:1746147185.869313:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11591 00000100:00100000:0.0:1746147185.869317:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466388480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.869384:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.869386:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.869388:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.869390:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147185.869392:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147185.869409:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466388480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (580us total) trans 17179873212 rc 0/0 00000100:00100000:0.0:1746147185.869414:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11591 00000100:00100000:0.0:1746147185.869424:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11592 00000100:00100000:0.0:1746147185.869429:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3293:x1830967466388992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.869520:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.869522:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869524:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869525:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869527:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147185.869544:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466388992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (694us total) trans 21474840618 rc 0/0 00000100:00100000:0.0:1746147185.869549:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11592 00000100:00100000:0.0:1746147185.869558:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11593 00000100:00100000:0.0:1746147185.869562:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3293:x1830967466389504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.869644:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.869647:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.869649:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.869651:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.869652:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1746147185.869669:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466389504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (800us total) trans 21474840619 rc 0/0 00000100:00100000:0.0:1746147185.869674:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11593 00000100:00100000:0.0:1746147185.869684:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11594 00000100:00100000:0.0:1746147185.869688:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466388096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.869748:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147185.869750:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869752:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869754:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.869755:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147185.869771:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466388096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (874us total) trans 17179873213 rc 0/0 00000100:00100000:0.0:1746147185.869774:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11594 00000100:00100000:0.0:1746147185.869901:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11595 00000100:00100000:0.0:1746147185.869907:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3293:x1830967466388608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.870005:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147185.870007:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.870009:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.870011:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.870013:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:0.0:1746147185.870031:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3293:x1830967466388608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (1117us total) trans 17179873214 rc 0/0 00000100:00100000:0.0:1746147185.870036:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11595 00000100:00100000:0.0:1746147185.870049:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11596 00000100:00100000:0.0:1746147185.870054:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3293:x1830967466389120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.870102:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11597 00000100:00100000:2.0:1746147185.870109:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466389632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.870114:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4926336 -> 4926336 00002000:00010000:0.0:1746147185.870116:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.870117:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.870119:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.870121:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5479 00000100:00100000:0.0:1746147185.870139:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466389120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1206us total) trans 21474840620 rc 0/0 00000100:00100000:0.0:1746147185.870143:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11596 00000004:00080000:0.0:1746147185.870186:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b5f80/2, rc 0, transno 17179873213 00000100:00100000:0.0:1746147185.870191:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388096:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.870197:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:0.0:1746147185.870197:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecefb80/2, rc 0, transno 17179873214 00002000:00010000:2.0:1746147185.870199:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00000100:00100000:0.0:1746147185.870200:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388608:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147185.870201:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.870203:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.870205:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000004:00080000:0.0:1746147185.870207:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012eceea00/2, rc 0, transno 21474840620 00000100:00100000:0.0:1746147185.870213:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.870219:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b7480/2, rc 0, transno 17179873211 00000100:00100000:0.0:1746147185.870221:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466387968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.870228:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b6a00/2, rc 0, transno 17179873212 00000100:00100000:2.0:1746147185.870229:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830967466389632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (1253us total) trans 21474840621 rc 0/0 00000100:00100000:0.0:1746147185.870231:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.870235:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11597 00000004:00080000:0.0:1746147185.870236:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012eced500/2, rc 0, transno 21474840618 00000100:00100000:0.0:1746147185.870238:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466388992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.870243:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecedc00/2, rc 0, transno 21474840619 00000100:00100000:0.0:1746147185.870246:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.870253:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecece00/2, rc 0, transno 21474840621 00000100:00100000:0.0:1746147185.870256:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466389632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.870306:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466388224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.870338:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.870368:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466388736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.870382:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.870392:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466389248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.870402:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388224 00000100:00100000:3.0:1746147185.870405:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.870407:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388224 00000100:00100000:3.0:1746147185.870416:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466389760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.870426:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388736 00000100:00100000:3.0:1746147185.870427:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147185.870428:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388736 00000100:00100000:2.0:1746147185.870435:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389248 00000100:00100000:2.0:1746147185.870437:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389248 00000100:00100000:1.0:1746147185.870438:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466387840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147185.870443:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389760 00000100:00100000:2.0:1746147185.870444:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389760 00000100:00100000:2.0:1746147185.870451:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11598 00000100:00100000:2.0:1746147185.870455:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967466388224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.870460:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11599 00000100:00100000:1.0:1746147185.870464:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147185.870466:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830967466388736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.870476:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466388352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147185.870488:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.870495:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466388864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.870507:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147185.870512:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466389376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.870523:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147185.870529:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147185.870531:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.870533:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.870535:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.870536:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1746147185.870543:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466387840 00000100:00100000:1.0:1746147185.870546:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466387840 00002000:00010000:3.0:1746147185.870552:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147185.870555:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147185.870557:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147185.870558:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00000100:00100000:2.0:1746147185.870558:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967466388224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (219us total) trans 17179873215 rc 0/0 00000100:00100000:1.0:1746147185.870558:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388352 00002000:00010000:3.0:1746147185.870560:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147185.870560:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388352 00000100:00100000:2.0:1746147185.870563:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11598 00000100:00100000:1.0:1746147185.870566:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466388864 00000100:00100000:1.0:1746147185.870567:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466388864 00000100:00100000:2.0:1746147185.870572:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389376 00000100:00100000:2.0:1746147185.870574:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389376 00000100:00100000:1.0:1746147185.870576:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11600 00000100:00100000:3.0:1746147185.870579:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830967466388736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (196us total) trans 17179873216 rc 0/0 00000100:00100000:1.0:1746147185.870580:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830967466389248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.870585:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11601 00000100:00100000:2.0:1746147185.870588:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3295:x1830967466389760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.870589:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11599 00000100:00100000:3.0:1746147185.870600:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11602 00000100:00100000:3.0:1746147185.870605:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3296:x1830967466387840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147185.870687:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147185.870689:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.870690:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00000100:00100000:1.0:1746147185.870691:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466389248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (285us total) trans 21474840622 rc 0/0 00002000:00010000:3.0:1746147185.870692:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.870694:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147185.870696:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11600 00000100:00100000:1.0:1746147185.870704:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11603 00000100:00100000:1.0:1746147185.870708:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466388352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147185.870717:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466387840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (252us total) trans 17179873217 rc 0/0 00000100:00100000:3.0:1746147185.870722:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11602 00000100:00100000:3.0:1746147185.870735:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11604 00000100:00100000:3.0:1746147185.870740:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3296:x1830967466388864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.870803:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830967466388352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (313us total) trans 17179873218 rc 0/0 00002000:00010000:3.0:1746147185.870807:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746147185.870808:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11603 00002000:00010000:3.0:1746147185.870810:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.870811:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.870813:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:3.0:1746147185.870815:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:1.0:1746147185.870823:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11605 00000100:00100000:1.0:1746147185.870828:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466389376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147185.870833:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466388864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (325us total) trans 21474840623 rc 0/0 00000100:00100000:3.0:1746147185.870838:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11604 00002000:00010000:1.0:1746147185.870893:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147185.870895:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147185.870897:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147185.870898:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147185.871081:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147185.871103:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466389376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (578us total) trans 21474840624 rc 0/0 00000100:00100000:1.0:1746147185.871108:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11605 00000004:00080000:1.0:1746147185.871129:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b6680/2, rc 0, transno 17179873217 00000100:00100000:1.0:1746147185.871395:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466387840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147185.871406:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b6300/2, rc 0, transno 17179873218 00000100:00100000:1.0:1746147185.871409:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466388352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147185.871416:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecedf80/2, rc 0, transno 21474840623 00000100:00100000:1.0:1746147185.871419:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466388864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147185.871424:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ececa80/2, rc 0, transno 21474840624 00000100:00100000:1.0:1746147185.871426:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466389376:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147185.871658:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:2.0:1746147185.871661:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.871663:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147185.871665:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147185.871667:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:2.0:1746147185.871689:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3295:x1830967466389760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1100us (1261us total) trans 21474840625 rc 0/0 00000100:00100000:2.0:1746147185.871695:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11601 00000004:00080000:2.0:1746147185.871721:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a56b5c00/2, rc 0, transno 17179873215 00000100:00100000:2.0:1746147185.871724:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466388224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.871730:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecef800/2, rc 0, transno 17179873216 00000100:00100000:2.0:1746147185.871733:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466388736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147185.871739:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecef100/2, rc 0, transno 21474840622 00000100:00100000:2.0:1746147185.871742:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466389248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147185.871748:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929f6300/2, rc 0, transno 21474840625 00000100:00100000:2.0:1746147185.871750:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466389760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147185.873850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.873876:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693312 00000100:00100000:2.0:1746147185.873881:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693312 00000100:00100000:3.0:1746147185.873955:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387584:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.873965:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466387712:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.873999:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216400/0xb4b2209fbdac6518 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 9 pid: 14125 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147185.874016:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.874043:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e216600, rc 0) 00000100:00100000:3.0:1746147185.874079:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28830:x1830967463692288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 64840us (67172us total) trans 8589944220 rc 0/0 00000100:00100000:3.0:1746147185.874085:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10480 00000100:00100000:3.0:1746147185.874115:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10483 00000100:00100000:3.0:1746147185.874120:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28834:x1830967463693312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.874133:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.874143:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdac6534 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66cb expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.874172:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdac6534 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66cb expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.874182:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdac6534 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66cb expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.874191:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147185.874194:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147185.874198:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c800, rc 0) 00000100:00100000:3.0:1746147185.874212:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28834:x1830967463693312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 92us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.874217:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10483 00000100:00100000:1.0:1746147185.875071:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466389888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147185.875111:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.875187:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466389888 00000100:00100000:0.0:1746147185.875192:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466389888 00000100:00100000:0.0:1746147185.875214:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11606 00000100:00100000:0.0:1746147185.875219:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3296:x1830967466389888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.875383:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:0.0:1746147185.875386:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.875388:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.875390:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147185.875392:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:0.0:1746147185.875414:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3296:x1830967466389888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (302us total) trans 21474840626 rc 0/0 00000100:00100000:0.0:1746147185.875418:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11606 00000100:00100000:0.0:1746147185.877297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.877331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.877350:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693184 00000100:00100000:0.0:1746147185.877355:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693184 00000100:00100000:0.0:1746147185.877379:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693056 00000100:00100000:0.0:1746147185.877380:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693056 00000100:00100000:0.0:1746147185.877394:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4143 00000100:00100000:0.0:1746147185.877399:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28835:x1830967463693184:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:0.0:1746147185.877487:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28835:x1830967463693184:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.877492:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4143 00000100:00100000:0.0:1746147185.877503:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4144 00000100:00100000:0.0:1746147185.877506:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28838:x1830967463693056:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:0.0:1746147185.877530:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28838:x1830967463693056:12345-192.168.203.36@tcp:49:cat.0 Request processed in 23us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.877535:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4144 00000004:00080000:1.0:1746147185.877872:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d5ded80/2, rc 0, transno 21474840626 00000100:00100000:1.0:1746147185.877879:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466389888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.887290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.887450:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693440 00000100:00100000:1.0:1746147185.887458:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693440 00000100:00100000:1.0:1746147185.887495:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4145 00000100:00100000:1.0:1746147185.887502:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28830:x1830967463693440:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:1.0:1746147185.887627:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28830:x1830967463693440:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.887633:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4145 00000100:00100000:0.0:1746147185.887673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.887878:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693568 00000100:00100000:1.0:1746147185.887881:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693568 00000100:00100000:1.0:1746147185.887912:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 586 00000100:00100000:1.0:1746147185.887917:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1959:x1830967463693568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147185.887925:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147185.887961:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d50c800/0xb4b2209fbdac6534 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66cb expref: 303 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.887984:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147185.887988:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147185.888004:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1959:x1830967463693568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.888009:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 586 00000100:00100000:0.0:1746147185.895160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.895235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.895322:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693696 00000100:00100000:1.0:1746147185.895330:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693696 00000100:00100000:1.0:1746147185.895435:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693824 00000100:00100000:1.0:1746147185.895438:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693824 00000100:00100000:1.0:1746147185.895458:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11607 00000100:00100000:1.0:1746147185.895464:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28835:x1830967463693696:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147185.895486:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.895505:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66d2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.895535:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895542:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895549:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 39 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895554:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.895556:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.895559:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.895585:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 39 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895596:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 39 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.895616:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.895702:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895714:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 27 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.895722:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390144:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.895745:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.895753:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 13 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.895760:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390272:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.895777:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.895976:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11608 00000100:00100000:0.0:1746147185.895983:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28830:x1830967463693824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147185.895989:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.895995:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66d9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.896007:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.896011:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.896016:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.896019:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1572864->2097151] (req 1572864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.896038:0:8478:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.896048:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [1572864->2097151] (req 1572864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 28 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.896057:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbe00, rc 0) 00000100:00100000:0.0:1746147185.896080:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28830:x1830967463693824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 98us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.896088:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11608 00000100:00100000:0.0:1746147185.898476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.898504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.898530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.898539:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463693952 00000100:00100000:3.0:1746147185.898551:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463693952 00010000:00010000:3.0:1746147185.898590:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 40 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.898636:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463694208 00000100:00100000:3.0:1746147185.898638:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463694208 00010000:00010000:3.0:1746147185.898648:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 14 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.898650:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463694080 00000100:00100000:1.0:1746147185.898657:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463694080 00000100:00100000:3.0:1746147185.898666:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5709 00000100:00100000:3.0:1746147185.898675:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463693952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147185.898677:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5710 00010000:00010000:1.0:1746147185.898683:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 28 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.898687:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463694208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147185.898688:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.898699:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147185.898703:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5711 00010000:00010000:3.0:1746147185.898707:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 40 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.898709:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463694080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.898717:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 14 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.898718:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 40 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.898719:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.898728:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 14 pid: 8478 timeout: 672 lvb_type: 1 00010000:00010000:1.0:1746147185.898900:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 28 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:3.0:1746147185.898911:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147185.898914:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 28 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.898922:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147185.898928:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.898930:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147185.898980:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463693952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 305us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.898984:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463694208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 298us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147185.898987:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5709 00000100:00100000:2.0:1746147185.898992:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5710 00010000:00010000:1.0:1746147185.899219:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60080000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.899229:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60080000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.899258:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.899269:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 39 pid: 6881 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.899280:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466390528:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147185.899345:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147185.899380:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e957c00/0xb4b2209fbdac64c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6662 expref: 39 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.899396:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.899405:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e17d600/0xb4b2209fbdac64f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6693 expref: 28 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.899412:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390144:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.899419:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20800/0xb4b2209fbdac63e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6615 expref: 13 pid: 8478 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.899427:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466390272:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.899449:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 38 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.899456:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 38 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:1.0:1746147185.899465:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18400, rc 0) 00000100:00100000:1.0:1746147185.899484:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28835:x1830967463693696:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4020us (4334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.899489:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11607 00000100:00100000:2.0:1746147185.899812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.899833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.899861:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463694592 00000100:00100000:2.0:1746147185.899865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.899867:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463694592 00000100:00100000:2.0:1746147185.899878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147185.899892:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e587b80 x1830967463694592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.899901:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967463694592 ext(2097152->3145727) 00000100:00100000:2.0:1746147185.899902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:3.0:1746147185.899905:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e587b80 00000100:00100000:2.0:1746147185.899915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.899929:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463695488 00000100:00100000:3.0:1746147185.899931:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463695488 00000100:00100000:2.0:1746147185.899956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147185.899963:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e585f80 x1830967463695488/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.899970:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585f80 with x1830967463695488 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.899973:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585f80 00000100:00100000:2.0:1746147185.899973:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463694720 00000100:00100000:2.0:1746147185.899977:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463694720 00000100:00100000:3.0:1746147185.899984:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463694976 00000100:00100000:3.0:1746147185.899987:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463694976 00002000:00100000:3.0:1746147185.899997:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e584a80 x1830967463694976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.899999:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e586a00 x1830967463694720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.900003:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584a80 with x1830967463694976 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.900006:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584a80 00002000:00100000:2.0:1746147185.900008:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586a00 with x1830967463694720 ext(2097152->3145727) 00002000:00010000:2.0:1746147185.900011:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e586a00 00000100:00100000:3.0:1746147185.900012:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463695360 00000100:00100000:3.0:1746147185.900014:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463695360 00000100:00100000:2.0:1746147185.900023:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463695744 00002000:00100000:3.0:1746147185.900024:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012d49aa00 x1830967463695360/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147185.900025:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463695744 00002000:00100000:3.0:1746147185.900030:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967463695360 ext(2097152->3145727) 00002000:00010000:3.0:1746147185.900032:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00002000:00100000:2.0:1746147185.900033:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012d498000 x1830967463695744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.900039:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967463695744 ext(3145728->4194303) 00000100:00100000:3.0:1746147185.900041:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696000 00002000:00010000:2.0:1746147185.900042:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d498000 00000100:00100000:3.0:1746147185.900043:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696000 00000100:00100000:2.0:1746147185.900051:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4410 00002000:00100000:3.0:1746147185.900053:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012d49ad80 x1830967463696000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147185.900056:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463694592:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147185.900059:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967463696000 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.900062:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49ad80 00000100:00100000:3.0:1746147185.900067:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4411 00000100:00100000:3.0:1746147185.900073:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463695488:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.900856:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4412 00000100:00100000:0.0:1746147185.900865:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463694976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.901063:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4413 00000100:00100000:3.0:1746147185.901070:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463694720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.901083:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4414 00000100:00100000:1.0:1746147185.901091:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463695360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.901392:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4415 00000100:00100000:1.0:1746147185.901397:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463695744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.902102:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4416 00000100:00100000:3.0:1746147185.902109:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463696000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.904855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.905050:0:1351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696256 00000100:00100000:2.0:1746147185.905059:0:1351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696256 00002000:00100000:2.0:1746147185.905100:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff88008d5ddc00 x1830967463696256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.905110:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddc00 with x1830967463696256 ext(1863680->1867775) 00010000:00010000:2.0:1746147185.905121:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 42 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.905136:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 42 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.905142:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5ddc00 00000100:00100000:2.0:1746147185.905163:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1507 00000100:00100000:2.0:1746147185.905171:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463696256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147185.905291:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463696256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 120us (442us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147185.905297:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1507 00002000:00100000:2.0:1746147185.905303:0:1351:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->1867775) req@ffff88008d5ddc00 x1830967463696256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.905310:0:1351:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ddc00 with x1830967463696256 ext(1863680->1867775) 00010000:00010000:2.0:1746147185.905315:0:1351:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 42 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.905323:0:1351:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 42 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.905329:0:1351:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d5ddc00 00000100:00100000:0.0:1746147185.906031:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466390528:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147185.906047:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.906078:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967463694080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7370us (7547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.906085:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5711 00000100:00100000:3.0:1746147185.915443:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463695488:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15358us (15598us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.915453:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4411 00002000:00100000:3.0:1746147185.915472:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e585f80 x1830967463695488/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.915481:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585f80 with x1830967463695488 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.915486:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585f80 00000100:00100000:3.0:1746147185.919443:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463694720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18362us (19566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.919455:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4413 00002000:00100000:3.0:1746147185.919465:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e586a00 x1830967463694720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.919474:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586a00 with x1830967463694720 ext(2097152->3145727) 00002000:00010000:3.0:1746147185.919480:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e586a00 00000100:00100000:1.0:1746147185.923542:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463695744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22133us (23614us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.923554:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4415 00002000:00100000:1.0:1746147185.923564:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012d498000 x1830967463695744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.923574:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498000 with x1830967463695744 ext(3145728->4194303) 00002000:00010000:1.0:1746147185.923580:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d498000 00000100:00100000:1.0:1746147185.929445:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463695360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28344us (29531us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.929458:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4414 00002000:00100000:1.0:1746147185.929469:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012d49aa00 x1830967463695360/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.929479:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49aa00 with x1830967463695360 ext(2097152->3145727) 00002000:00010000:1.0:1746147185.929485:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49aa00 00000100:00100000:1.0:1746147185.935471:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463694976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34596us (35579us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147185.935484:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4412 00002000:00100000:1.0:1746147185.935496:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e584a80 x1830967463694976/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.935505:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584a80 with x1830967463694976 ext(3145728->4194303) 00002000:00010000:1.0:1746147185.935511:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584a80 00000100:00100000:2.0:1746147185.935578:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463694592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 35520us (35766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147185.935585:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4410 00002000:00100000:2.0:1746147185.935590:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e587b80 x1830967463694592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.935596:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967463694592 ext(2097152->3145727) 00002000:00010000:2.0:1746147185.935600:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e587b80 00000100:00100000:0.0:1746147185.939337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.941879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.942248:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696512 00000100:00100000:2.0:1746147185.942257:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696512 00000100:00100000:1.0:1746147185.942283:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696640 00000100:00100000:1.0:1746147185.942289:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696640 00002000:00100000:2.0:1746147185.942298:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff8800937ee300 x1830967463696512/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.942308:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ee300 with x1830967463696512 ext(1863680->2097151) 00010000:00010000:2.0:1746147185.942398:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 38 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147185.942413:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 38 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147185.942420:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937ee300 00000100:00100000:2.0:1746147185.942436:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1508 00000100:00100000:2.0:1746147185.942443:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463696512:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147185.942652:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11609 00000100:00100000:1.0:1746147185.942659:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28835:x1830967463696640:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147185.942669:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.942685:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66e0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.942706:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942719:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942724:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942730:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.942732:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147185.942734:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1581055] (req 1048576->1581055) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.942762:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942771:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 40 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.942782:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390656:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.942865:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 21 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942871:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 21 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.942876:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390784:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.942893:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.942897:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 15 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.942901:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390912:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.942910:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.943789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.943899:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696768 00000100:00100000:0.0:1746147185.943904:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696768 00000100:00100000:0.0:1746147185.943956:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11610 00000100:00100000:0.0:1746147185.943963:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463696768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.943974:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147185.944239:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463696000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 42127us (44279us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147185.944248:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4416 00002000:00100000:3.0:1746147185.944259:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012d49ad80 x1830967463696000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.944268:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49ad80 with x1830967463696000 ext(3145728->4194303) 00002000:00010000:3.0:1746147185.944272:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49ad80 00010000:00010000:0.0:1746147185.944537:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6550 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66e7 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.944580:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391040:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147185.944637:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.948549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.948575:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697024 00000100:00100000:0.0:1746147185.948582:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697024 00010000:00010000:0.0:1746147185.948625:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 39 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:0.0:1746147185.948651:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5712 00000100:00100000:0.0:1746147185.948658:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463697024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.948674:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147185.948771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.948809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147185.948828:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463696896 00000100:00100000:2.0:1746147185.948831:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463696896 00010000:00010000:2.0:1746147185.948847:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 22 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.948863:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697152 00000100:00100000:2.0:1746147185.948865:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697152 00010000:00010000:2.0:1746147185.948873:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 16 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:2.0:1746147185.948886:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5713 00000100:00100000:2.0:1746147185.948890:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463696896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.948897:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.948908:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 22 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.948918:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 22 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:3.0:1746147185.948933:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391040:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147185.948966:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147185.948982:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6550 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e7 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.948992:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6550 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e7 expref: 28 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147185.948998:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463696896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.949004:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5713 00010000:00010000:3.0:1746147185.949005:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55800, rc 0) 00000100:00100000:2.0:1746147185.949018:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5714 00000100:00100000:2.0:1746147185.949022:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463697152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147185.949025:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463696768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5064us (5239us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147185.949028:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147185.949031:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11610 00010000:00010000:2.0:1746147185.949034:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 16 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.949046:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 16 pid: 8480 timeout: 672 lvb_type: 1 00010000:00010000:2.0:1746147185.949055:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.949067:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463697152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147185.949088:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5714 00000100:00100000:1.0:1746147185.949326:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390656:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.949336:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e17d800/0xb4b2209fbdac64fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e669a expref: 21 pid: 21080 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.949350:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390784:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.949358:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49eca00/0xb4b2209fbdac63cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e661c expref: 15 pid: 8480 timeout: 672 lvb_type: 1 00000100:00100000:1.0:1746147185.949364:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466390912:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.949386:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1581055] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.949393:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0a2000, rc 0) 00000100:00100000:1.0:1746147185.949413:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28835:x1830967463696640:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6755us (10087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.949418:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11609 00010000:00010000:0.0:1746147185.949554:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 38 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.949563:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 38 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.949576:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e956200/0xb4b2209fbdac64cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6669 expref: 38 pid: 21080 timeout: 672 lvb_type: 1 00010000:00010000:0.0:1746147185.949598:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.949600:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.949613:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.949621:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.949647:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 37 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.949664:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466391168:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147185.949709:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.949873:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463696512:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7429us (8000us total) trans 17179873219 rc 0/0 00000100:00100000:3.0:1746147185.949881:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1508 00002000:00100000:3.0:1746147185.949888:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1863680->2097151) req@ffff8800937ee300 x1830967463696512/t17179873219(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.949898:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ee300 with x1830967463696512 ext(1863680->2097151) 00010000:00010000:3.0:1746147185.949903:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 40 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.949915:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 40 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:3.0:1746147185.949921:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937ee300 00000100:00100000:0.0:1746147185.954559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.954600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.954666:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466391168:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147185.954684:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.954722:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463697024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6064us (6183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.954734:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5712 00000100:00100000:0.0:1746147185.954798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.955093:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697408 00000100:00100000:1.0:1746147185.955100:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697408 00000100:00100000:1.0:1746147185.955128:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697280 00000100:00100000:1.0:1746147185.955130:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697280 00000100:00100000:1.0:1746147185.955145:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11611 00000100:00100000:1.0:1746147185.955151:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463697408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147185.955168:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.955185:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdac6557 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66f5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.955233:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466391296:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147185.955285:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.955465:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11612 00000100:00100000:3.0:1746147185.955483:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463697280:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.955492:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.955503:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d50de00/0xb4b2209fbdac655e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66ee expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.955529:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391424:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.955557:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130f023c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.955731:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697664 00000100:00100000:2.0:1746147185.955736:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697664 00002000:00100000:2.0:1746147185.955765:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e134e00 x1830967463697664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147185.955774:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134e00 with x1830967463697664 ext(4194304->4927487) 00002000:00010000:2.0:1746147185.955779:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134e00 00000100:00100000:2.0:1746147185.955792:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4417 00000100:00100000:2.0:1746147185.955797:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463697664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147185.962018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.962104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147185.962219:0:8481:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a4671c00 x1830967466391424) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 41 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.962259:0:8481:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 41 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.962283:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac653b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d2 expref: 41 pid: 6881 timeout: 672 lvb_type: 0 00000100:00100000:3.0:1746147185.962302:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391424:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147185.962324:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.962326:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147185.962333:0:8481:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.962346:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147185.962377:0:8481:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.962389:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391552:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147185.962455:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130f023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.962482:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463698176 00000100:00100000:3.0:1746147185.962491:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463698176 00002000:00100000:3.0:1746147185.962521:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1576960->1581055) req@ffff88008daac000 x1830967463698176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.962530:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac000 with x1830967463698176 ext(1576960->1581055) 00002000:00010000:3.0:1746147185.962535:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac000 00000100:00100000:3.0:1746147185.962550:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4418 00000100:00100000:3.0:1746147185.962556:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463698176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.962696:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463698176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 140us (591us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147185.962702:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4418 00002000:00100000:3.0:1746147185.962707:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1576960->1581055) req@ffff88008daac000 x1830967463698176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.962714:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac000 with x1830967463698176 ext(1576960->1581055) 00002000:00010000:3.0:1746147185.962717:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac000 00000100:00100000:3.0:1746147185.963188:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463697664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7391us (8389us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147185.963194:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4417 00002000:00100000:3.0:1746147185.963199:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e134e00 x1830967463697664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.963205:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134e00 with x1830967463697664 ext(4194304->4927487) 00002000:00010000:3.0:1746147185.963209:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134e00 00000100:00100000:1.0:1746147185.963314:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466391296:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147185.963334:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdac6557 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66f5 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.963345:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064200/0xb4b2209fbdac6557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66f5 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.963357:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:1.0:1746147185.963374:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463697408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8224us (8826us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147185.963380:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11611 00000100:00100000:2.0:1746147185.963781:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463697792 00000100:00100000:2.0:1746147185.963786:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463697792 00000100:00100000:2.0:1746147185.963822:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 587 00000100:00100000:2.0:1746147185.963829:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463697792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147185.963837:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147185.963839:0:16058:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b4b2209fbdac653b) 00010000:00010000:2.0:1746147185.963841:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147185.963858:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463697792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 31us (1853us total) trans 0 rc 116/116 00000100:00100000:2.0:1746147185.963867:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 587 00000100:00100000:3.0:1746147185.968775:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466391552:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147185.968816:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d50de00/0xb4b2209fbdac655e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66ee expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.968831:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d50de00/0xb4b2209fbdac655e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66ee expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.968844:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50de00, rc 0) 00000100:00100000:3.0:1746147185.968913:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463697280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 13431us (14311us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147185.968921:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11612 00000100:00100000:0.0:1746147185.969527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.969588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.969628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.969862:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463698816 00000100:00100000:3.0:1746147185.969869:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463698816 00000100:00100000:3.0:1746147185.969908:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4146 00000100:00100000:3.0:1746147185.969915:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+302:28835:x1830967463698816:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147185.970167:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28835:x1830967463698816:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 251us (538us total) trans 8589944221 rc 0/0 00000100:00100000:3.0:1746147185.970173:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4146 00000100:00100000:3.0:1746147185.970190:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463698560 00000100:00100000:3.0:1746147185.970193:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463698560 00000100:00100000:3.0:1746147185.970211:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11613 00000100:00100000:3.0:1746147185.970215:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463698560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147185.970224:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147185.970240:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6565 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e66fc expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147185.970281:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466391680:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147185.970334:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130f023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.970981:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463698432 00000100:00100000:1.0:1746147185.970987:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463698432 00002000:00100000:1.0:1746147185.971016:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1572864->1576959) req@ffff88008fc95c00 x1830967463698432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.971031:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95c00 with x1830967463698432 ext(1572864->1576959) 00002000:00010000:1.0:1746147185.971036:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95c00 00000100:00100000:1.0:1746147185.971050:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4419 00000100:00100000:1.0:1746147185.971062:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463698432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147185.971200:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463698432:12345-192.168.203.36@tcp:3:cat.0 Request processed in 143us (1674us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147185.971206:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4419 00002000:00100000:1.0:1746147185.971211:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1572864->1576959) req@ffff88008fc95c00 x1830967463698432/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147185.971217:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95c00 with x1830967463698432 ext(1572864->1576959) 00002000:00010000:1.0:1746147185.971220:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95c00 00000100:00100000:0.0:1746147185.973176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.973255:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699072 00000100:00100000:3.0:1746147185.973262:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699072 00002000:00100000:3.0:1746147185.973296:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880134d00e00 x1830967463699072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.973305:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00e00 with x1830967463699072 ext(4194304->4927487) 00002000:00010000:3.0:1746147185.973310:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00e00 00000100:00100000:3.0:1746147185.973338:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4420 00000100:00100000:3.0:1746147185.973345:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463699072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147185.980411:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463699072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7055us (7230us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147185.980423:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4420 00002000:00100000:3.0:1746147185.980433:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880134d00e00 x1830967463699072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.980444:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00e00 with x1830967463699072 ext(4194304->4927487) 00002000:00010000:3.0:1746147185.980450:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00e00 00000100:00100000:0.0:1746147185.981773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.981856:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699200 00000100:00100000:1.0:1746147185.981863:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699200 00000100:00100000:1.0:1746147185.981905:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11614 00000100:00100000:1.0:1746147185.981910:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28830:x1830967463699200:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147185.981925:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.981969:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6703 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.982002:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.982011:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147185.982013:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147185.982017:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.982048:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 36 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.982058:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 36 pid: 6881 timeout: 672 lvb_type: 0 00000100:00100000:1.0:1746147185.982073:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466391808:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147185.982159:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147185.982255:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466391680:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147185.982287:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6565 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66fc expref: 24 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.982297:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6565 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66fc expref: 24 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147185.982313:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50d600, rc 0) 00000100:00100000:3.0:1746147185.982336:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463698560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12120us (12747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147185.982342:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11613 00000100:00100000:1.0:1746147185.984931:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466391808:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147185.984987:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147185.985003:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63e00, rc 0) 00000100:00100000:1.0:1746147185.985046:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28830:x1830967463699200:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3133us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147185.985053:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11614 00000100:00100000:0.0:1746147185.988777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.989412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147185.989435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147185.989568:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699328 00000100:00100000:3.0:1746147185.989577:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699328 00002000:00100000:3.0:1746147185.989625:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1581055) req@ffff880134d00a80 x1830967463699328/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147185.989636:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00a80 with x1830967463699328 ext(1048576->1581055) 00010000:00010000:3.0:1746147185.989645:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 37 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:3.0:1746147185.989658:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 37 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:3.0:1746147185.989665:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d00a80 00000100:00100000:3.0:1746147185.989682:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1509 00000100:00100000:3.0:1746147185.989689:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463699328:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147185.990517:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699456 00000100:00100000:1.0:1746147185.990528:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699456 00000100:00100000:1.0:1746147185.990574:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699584 00000100:00100000:1.0:1746147185.990577:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699584 00000100:00100000:1.0:1746147185.990614:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11615 00000100:00100000:1.0:1746147185.990623:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463699456:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147185.990627:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11616 00010000:00010000:1.0:1746147185.990637:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147185.990637:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463699584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147185.990647:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147185.990653:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e670a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.990659:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea18e00/0xb4b2209fbdac657a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6711 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147185.990699:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466391936:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147185.990700:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466392064:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147185.991016:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.991063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147185.991086:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147185.991253:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699712 00000100:00100000:2.0:1746147185.991258:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699712 00000100:00100000:2.0:1746147185.991281:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11617 00000100:00100000:2.0:1746147185.991286:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463699712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147185.991298:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147185.991305:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb88c00/0xb4b2209fbdac6581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6718 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147185.991333:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466392192:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147185.991391:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147185.993008:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466392064:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147185.993033:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea18e00/0xb4b2209fbdac657a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6711 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.993045:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea18e00/0xb4b2209fbdac657a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6711 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.993057:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18e00, rc 0) 00000100:00100000:1.0:1746147185.993083:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463699584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2447us (3645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147185.993090:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11616 00000100:00100000:1.0:1746147185.993138:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466391936:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147185.993164:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6573 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e670a expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.993172:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6573 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e670a expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147185.993179:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065800, rc 0) 00000100:00100000:1.0:1746147185.993194:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463699456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2573us (3783us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147185.993202:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11615 00000100:00100000:2.0:1746147185.994222:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466392192:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147185.994249:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88c00/0xb4b2209fbdac6581 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6718 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.994261:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88c00/0xb4b2209fbdac6581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6718 expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147185.994287:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88c00, rc 0) 00000100:00100000:2.0:1746147185.994379:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463699712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3091us (3314us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147185.994391:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11617 00000100:00100000:1.0:1746147186.000163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.000200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.000260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.000280:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463700096 00000100:00100000:1.0:1746147186.000289:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463700096 00000100:00100000:1.0:1746147186.000325:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463700224 00000100:00100000:1.0:1746147186.000327:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463700224 00000100:00100000:1.0:1746147186.000341:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11618 00000100:00100000:1.0:1746147186.000348:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463700096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.000363:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.000378:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6588 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e671f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.000423:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392320:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.000483:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.000500:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11619 00000100:00100000:1.0:1746147186.000506:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463700224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.000512:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.000520:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac658f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6726 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.000543:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466392448:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.000564:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.000756:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463699968 00000100:00100000:0.0:1746147186.000761:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463699968 00000100:00100000:0.0:1746147186.000788:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4147 00000100:00100000:0.0:1746147186.000793:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28838:x1830967463699968:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147186.000925:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28838:x1830967463699968:12345-192.168.203.36@tcp:35:cat.0 Request processed in 130us (768us total) trans 8589944222 rc 0/0 00000100:00100000:0.0:1746147186.000930:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4147 00000100:00100000:2.0:1746147186.003710:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463699328:12345-192.168.203.36@tcp:4:cat.0 Request processed in 14014us (14934us total) trans 21474840627 rc 0/0 00000100:00100000:2.0:1746147186.003721:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1509 00002000:00100000:2.0:1746147186.003731:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1581055) req@ffff880134d00a80 x1830967463699328/t21474840627(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.003740:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00a80 with x1830967463699328 ext(1048576->1581055) 00010000:00010000:2.0:1746147186.003748:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 41 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147186.003760:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 41 pid: 6881 timeout: 672 lvb_type: 0 00002000:00010000:2.0:1746147186.003766:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d00a80 00000100:00100000:1.0:1746147186.004574:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466392448:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147186.004600:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac658f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6726 expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.004621:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ee00/0xb4b2209fbdac658f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6726 expref: 40 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.004633:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ee00, rc 0) 00000100:00100000:1.0:1746147186.004660:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463700224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4149us (4395us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.004666:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11619 00000100:00100000:2.0:1746147186.004790:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392320:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147186.004804:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6588 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e671f expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.004812:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065800/0xb4b2209fbdac6588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e671f expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.004822:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f065800, rc 0) 00000100:00100000:2.0:1746147186.004839:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463700096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4492us (4638us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147186.004844:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11618 00000100:00100000:0.0:1746147186.005834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.006139:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463700352 00000100:00100000:2.0:1746147186.006146:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463700352 00010000:00010000:2.0:1746147186.006176:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 39 pid: 6881 timeout: 672 lvb_type: 0 00000100:00100000:2.0:1746147186.006215:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5715 00000100:00100000:2.0:1746147186.006222:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463700352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.006234:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.006247:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 39 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147186.006258:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 39 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147186.006273:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0a2000/0xb4b2209fbdac6549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66e0 expref: 39 pid: 6881 timeout: 672 lvb_type: 0 00010000:00010000:2.0:1746147186.006284:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.006286:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.006292:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.006299:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.006324:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.006334:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466392576:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.006396:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ca80 going to sleep for 11 seconds 00000100:00080000:0.0:1746147186.006506:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147186.014144:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466392576:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.014163:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.014200:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463700352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7979us (8368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.014210:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5715 00000100:00100000:0.0:1746147186.014355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.014519:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463700608 00000100:00100000:2.0:1746147186.014525:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463700608 00002000:00100000:2.0:1746147186.014558:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1482752->1486847) req@ffff88009ee5d880 x1830967463700608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.014566:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d880 with x1830967463700608 ext(1482752->1486847) 00002000:00010000:2.0:1746147186.014570:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5d880 00000100:00100000:2.0:1746147186.014733:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4421 00000100:00100000:2.0:1746147186.014740:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463700608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.015319:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463700608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 577us (963us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147186.015325:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4421 00002000:00100000:2.0:1746147186.015330:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1482752->1486847) req@ffff88009ee5d880 x1830967463700608/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.015337:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d880 with x1830967463700608 ext(1482752->1486847) 00002000:00010000:2.0:1746147186.015340:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5d880 00000100:00100000:0.0:1746147186.020033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.020238:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463700864 00000100:00100000:2.0:1746147186.020247:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463700864 00000100:00080000:0.0:1746147186.020589:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147186.021715:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4148 00000100:00100000:2.0:1746147186.021727:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28830:x1830967463700864:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147186.022850:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28830:x1830967463700864:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 1123us (2820us total) trans 8589944223 rc 0/0 00000100:00100000:2.0:1746147186.022859:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4148 00000100:00100000:0.0:1746147186.134575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.134647:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463701120 00000100:00100000:2.0:1746147186.134657:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463701120 00000100:00100000:2.0:1746147186.134726:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10484 00000100:00100000:2.0:1746147186.134735:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:28847:x1830967463701120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.134759:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.134774:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e672d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.134875:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.134885:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.134895:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.134905:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.134911:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.134916:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135023:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135030:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135035:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147186.135042:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00080000:0.0:1746147186.135137:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147186.135409:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135416:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135421:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135426:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb89600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.135428:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135434:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135442:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147186.135445:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.135448:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135452:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89600/0xb4b2209fbdac659d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135474:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135478:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135485:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135489:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb89e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.135491:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135494:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135499:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9800) 00010000:00010000:2.0:1746147186.135500:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.135502:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135505:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89e00/0xb4b2209fbdac65a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.135531:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 306 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.135540:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 305 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.135545:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.135547:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147186.135549:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89000, rc 0) 00000100:00100000:2.0:1746147186.136634:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28847:x1830967463701120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1897us (2063us total) trans 8589944224 rc 0/0 00000100:00100000:2.0:1746147186.136642:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10484 00000100:00100000:1.0:1746147186.140415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.141969:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463701376 00000100:00100000:2.0:1746147186.141980:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463701376 00000100:00100000:2.0:1746147186.142030:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4149 00000100:00100000:2.0:1746147186.142038:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+305:28847:x1830967463701376:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147186.142231:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28847:x1830967463701376:12345-192.168.203.36@tcp:35:cat.0 Request processed in 192us (1823us total) trans 8589944225 rc 0/0 00000100:00100000:2.0:1746147186.142237:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4149 00000100:00100000:0.0:1746147186.144636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.144678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.144745:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463701504 00000100:00100000:2.0:1746147186.144753:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463701504 00000100:00100000:2.0:1746147186.144799:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463701632 00000100:00100000:2.0:1746147186.144801:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463701632 00000100:00100000:2.0:1746147186.144816:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11620 00000100:00100000:2.0:1746147186.144822:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463701504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.144836:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.144851:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb89a00/0xb4b2209fbdac65b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6734 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.144895:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392704:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147186.144990:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.145069:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11621 00000100:00100000:2.0:1746147186.145074:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463701632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.145081:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.145089:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0xb4b2209fbdac65c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e673b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.145111:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466392832:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147186.145136:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00080000:0.0:1746147186.145292:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147186.149673:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466392832:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147186.149702:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0xb4b2209fbdac65c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e673b expref: 39 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.149715:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0xb4b2209fbdac65c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e673b expref: 39 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.149743:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89200, rc 0) 00000100:00100000:3.0:1746147186.149801:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463701632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4725us (5121us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.149808:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11621 00000100:00100000:0.0:1746147186.150134:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392704:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147186.150163:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb89a00/0xb4b2209fbdac65b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6734 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.150175:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb89a00/0xb4b2209fbdac65b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6734 expref: 40 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.150201:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89a00, rc 0) 00000100:00100000:0.0:1746147186.150252:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463701504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5429us (5620us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.150260:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11620 00000100:00100000:0.0:1746147186.156118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.156176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.156351:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702016 00000100:00100000:2.0:1746147186.156359:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702016 00002000:00100000:2.0:1746147186.156403:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009ee5df80 x1830967463702016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.156413:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5df80 with x1830967463702016 ext(0->1048575) 00002000:00010000:2.0:1746147186.156419:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5df80 00000100:00100000:2.0:1746147186.156442:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702144 00000100:00100000:2.0:1746147186.156445:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702144 00002000:00100000:2.0:1746147186.156459:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009a80c380 x1830967463702144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.156466:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c380 with x1830967463702144 ext(1048576->2097151) 00002000:00010000:2.0:1746147186.156469:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80c380 00000100:00100000:2.0:1746147186.156491:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4422 00000100:00100000:2.0:1746147186.156498:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463702016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.157325:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4423 00000100:00100000:3.0:1746147186.157335:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463702144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.170181:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463702016:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13670us (14061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.170195:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4422 00002000:00100000:2.0:1746147186.170207:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009ee5df80 x1830967463702016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.170217:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5df80 with x1830967463702016 ext(0->1048575) 00002000:00010000:2.0:1746147186.170223:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5df80 00000100:00100000:3.0:1746147186.175397:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463702144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18052us (19209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.175410:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4423 00002000:00100000:3.0:1746147186.175422:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009a80c380 x1830967463702144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.175432:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c380 with x1830967463702144 ext(1048576->2097151) 00002000:00010000:3.0:1746147186.175438:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80c380 00000100:00100000:0.0:1746147186.182131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.182908:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702272 00000100:00100000:2.0:1746147186.182917:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702272 00000100:00100000:2.0:1746147186.183001:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11622 00000100:00100000:2.0:1746147186.183009:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28847:x1830967463702272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.183027:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.183051:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6742 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.183080:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.183086:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.183088:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.183091:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.183120:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.183131:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 26 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.183141:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392960:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.183229:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.186380:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466392960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.186410:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.186427:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dcc00, rc 0) 00000100:00100000:2.0:1746147186.186484:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:28847:x1830967463702272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3474us (4362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.186492:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11622 00000100:00100000:0.0:1746147186.186892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.187262:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702400 00000100:00100000:3.0:1746147186.187268:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702400 00002000:00100000:3.0:1746147186.187310:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1572864->2097151) req@ffff88009a80ce00 x1830967463702400/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.187318:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ce00 with x1830967463702400 ext(1572864->2097151) 00010000:00010000:3.0:1746147186.187325:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.187335:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.187340:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80ce00 00000100:00100000:3.0:1746147186.187359:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1510 00000100:00100000:3.0:1746147186.187365:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463702400:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147186.198624:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463702400:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11241us (11716us total) trans 17179873220 rc 0/0 00000100:00100000:3.0:1746147186.198637:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1510 00002000:00100000:3.0:1746147186.198648:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1572864->2097151) req@ffff88009a80ce00 x1830967463702400/t17179873220(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.198657:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ce00 with x1830967463702400 ext(1572864->2097151) 00010000:00010000:3.0:1746147186.198667:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.198683:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.198689:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80ce00 00000100:00100000:2.0:1746147186.203581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.203599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.203637:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702656 00000100:00100000:2.0:1746147186.203644:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702656 00000100:00100000:3.0:1746147186.203683:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463702784 00000100:00100000:3.0:1746147186.203687:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463702784 00000100:00100000:2.0:1746147186.203701:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10485 00000100:00100000:2.0:1746147186.203708:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:28849:x1830967463702656:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.203732:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.203750:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6749 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.203752:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.203777:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5716 00000100:00100000:3.0:1746147186.203783:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463702784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.203793:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.203815:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.203825:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.203838:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.203845:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac6542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66d9 expref: 29 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.203851:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.203858:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.203886:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.203896:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 307 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.203908:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466393088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.203973:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.203976:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.203983:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.203994:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.204017:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.204019:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.204025:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466393216:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.204048:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.206481:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466393216:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147186.206501:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.206539:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463702784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2756us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.206548:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5716 00000100:00100000:2.0:1746147186.206622:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466393088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.206642:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.208148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.208195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.208199:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703040 00000100:00100000:3.0:1746147186.208206:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703040 00002000:00100000:3.0:1746147186.208242:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009a80f100 x1830967463703040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.208252:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f100 with x1830967463703040 ext(1048576->2097151) 00002000:00010000:3.0:1746147186.208256:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f100 00000100:00100000:3.0:1746147186.208989:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4424 00000100:00100000:3.0:1746147186.208997:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463703040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.209155:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703168 00000100:00100000:2.0:1746147186.209160:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703168 00010000:00010000:2.0:1746147186.209180:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 308 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.209203:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5717 00000100:00100000:2.0:1746147186.209207:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1956:x1830967463703168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.209216:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.209221:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 308 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.209231:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 308 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.209248:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89000/0xb4b2209fbdac65ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e672d expref: 308 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.209264:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.209269:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.209277:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.209283:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.209302:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.209334:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1956:x1830967463703168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.209339:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5717 00010000:00010000:2.0:1746147186.209358:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.209363:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147186.209379:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147186.209505:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 308 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.209516:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 307 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.209522:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.209524:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147186.209526:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dd000, rc 0) 00000100:00100000:2.0:1746147186.209547:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:28849:x1830967463702656:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5840us (5949us total) trans 8589944226 rc 0/0 00000100:00100000:2.0:1746147186.209552:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10485 00000100:00100000:3.0:1746147186.219037:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463703040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10026us (10879us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.219051:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4424 00002000:00100000:3.0:1746147186.219065:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009a80f100 x1830967463703040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.219075:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f100 with x1830967463703040 ext(1048576->2097151) 00002000:00010000:3.0:1746147186.219082:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f100 00000100:00100000:0.0:1746147186.236497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.236588:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703424 00000100:00100000:2.0:1746147186.236601:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703424 00000100:00100000:2.0:1746147186.237158:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10486 00000100:00100000:2.0:1746147186.237166:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28852:x1830967463703424:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.237186:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.237200:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac65e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6750 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.237277:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237286:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237293:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237302:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237307:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237311:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237383:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237388:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237393:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147186.237398:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147186.237452:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237457:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237462:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237467:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4ba200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.237470:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237474:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237481:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147186.237483:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.237485:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.237489:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac65ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147186.238062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.238102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147186.238804:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238814:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238819:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238823:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dde00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.238826:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238831:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238842:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9200) 00010000:00010000:2.0:1746147186.238844:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.238846:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238850:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac65f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.238890:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac65e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.238899:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.238904:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.238906:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147186.238908:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e9dd200, rc 0) 00000100:00100000:2.0:1746147186.238984:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28852:x1830967463703424:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1818us (2497us total) trans 8589944227 rc 0/0 00000100:00100000:2.0:1746147186.238991:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10486 00000100:00100000:2.0:1746147186.239538:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703552 00000100:00100000:2.0:1746147186.239545:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703552 00000100:00100000:2.0:1746147186.239576:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703680 00000100:00100000:2.0:1746147186.239578:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703680 00000100:00100000:2.0:1746147186.239642:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11623 00000100:00100000:2.0:1746147186.239648:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:28849:x1830967463703552:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.239658:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.239668:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6757 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.239687:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239694:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239699:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239704:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.239705:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.239708:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3723264->4169727] (req 3723264->4169727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.239738:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239747:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.239755:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393344:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.239811:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 27 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239817:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 27 pid: 21080 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.239824:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393472:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.239844:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.239851:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 12 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.239858:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393600:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.239872:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.239976:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11624 00000100:00100000:3.0:1746147186.239983:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28847:x1830967463703680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.239990:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.239998:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e675e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.240010:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.240015:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.240016:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.240019:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.240033:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.240040:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 21 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.240047:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466393728:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.240075:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.246855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.247135:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704064 00000100:00100000:2.0:1746147186.247143:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704064 00000100:00100000:2.0:1746147186.247302:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10487 00000100:00100000:2.0:1746147186.247309:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28854:x1830967463704064:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.247333:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.247351:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911000/0xb4b2209fbdac6614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e676c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.247456:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.247469:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.247965:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.247982:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.247990:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.247995:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248105:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911600/0xb4b2209fbdac6629 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248114:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911600/0xb4b2209fbdac6629 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248120:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911600/0xb4b2209fbdac6629 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147186.248238:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466393728:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147186.248241:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393344:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147186.248253:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393472:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.248263:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147186.248263:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466393600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.248277:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c600, rc 0) 00010000:00010000:0.0:1746147186.248294:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3723264->4169727] (req 3723264->4169727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 41 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.248306:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0efa00, rc 0) 00000100:00100000:3.0:1746147186.248311:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28847:x1830967463703680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8329us (10208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.248319:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11624 00000100:00100000:0.0:1746147186.248338:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+41:28849:x1830967463703552:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8690us (10345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.248345:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11623 00000100:00100000:3.0:1746147186.248371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00200000:2.0:1746147186.248385:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00100000:0.0:1746147186.248394:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463703808 00000100:00100000:0.0:1746147186.248398:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463703808 00000100:00100000:3.0:1746147186.248405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.248421:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11625 00000100:00100000:0.0:1746147186.248425:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463703808:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147186.248433:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.248442:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6765 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.248455:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.248456:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.248462:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.248469:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.248472:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 29 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.248476:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.248478:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18400, rc 0) 00010000:00010000:2.0:1746147186.248481:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248486:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092911200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.248490:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.248494:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463703808:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (137us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147186.248496:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.248498:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11625 00010000:00010000:2.0:1746147186.248505:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147186.248508:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.248511:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248516:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911200/0xb4b2209fbdac661b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248528:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248533:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248538:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248541:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092911400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.248543:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248548:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248553:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9b00) 00010000:00010000:2.0:1746147186.248555:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.248556:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248561:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac6622 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.248591:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911000/0xb4b2209fbdac6614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e676c expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.248613:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911600/0xb4b2209fbdac6629 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e676c expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.248619:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.248621:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147186.248623:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092911600, rc 0) 00000100:00100000:2.0:1746147186.248652:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28854:x1830967463704064:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1344us (1807us total) trans 8589944228 rc 0/0 00000100:00100000:2.0:1746147186.248658:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10487 00000100:00100000:3.0:1746147186.249257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.249270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.249303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.249320:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704448 00000100:00100000:3.0:1746147186.249324:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704448 00002000:00100000:3.0:1746147186.249350:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1486847) req@ffff8800a5a0d500 x1830967463704448/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.249357:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967463704448 ext(1048576->1486847) 00010000:00010000:3.0:1746147186.249363:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 22 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.249372:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 22 pid: 6881 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.249378:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0d500 00000100:00100000:2.0:1746147186.249395:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704192 00000100:00100000:0.0:1746147186.249395:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704320 00000100:00100000:2.0:1746147186.249399:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704192 00000100:00100000:0.0:1746147186.249399:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704320 00010000:00010000:2.0:1746147186.249416:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 13 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.249418:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.249432:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5718 00000100:00100000:0.0:1746147186.249436:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704576 00000100:00100000:2.0:1746147186.249437:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463704192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147186.249438:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704576 00010000:00010000:0.0:1746147186.249445:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 29 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:2.0:1746147186.249446:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.249463:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 13 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:0.0:1746147186.249467:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5719 00010000:00010000:2.0:1746147186.249472:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 13 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:0.0:1746147186.249472:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463704320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.249477:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.249486:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac63d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e662a expref: 13 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.249486:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.249494:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.249503:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064800/0xb4b2209fbdac64d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6677 expref: 41 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:1.0:1746147186.249557:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5720 00000100:00100000:1.0:1746147186.249565:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463704576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.249577:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.249835:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.249862:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463704192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 424us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.249868:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5718 00010000:00010000:0.0:1746147186.249963:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.249979:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463704320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 506us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.249985:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5719 00000100:00100000:3.0:1746147186.250051:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1511 00000100:00100000:3.0:1746147186.250058:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463704448:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:1.0:1746147186.250491:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 29 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:1.0:1746147186.250502:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 29 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:1.0:1746147186.250519:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e17d200/0xb4b2209fbdac650a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a8 expref: 29 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:1.0:1746147186.250533:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.250535:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.250540:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.250547:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.250572:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.250582:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466393856:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147186.250643:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.258264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.258441:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704704 00000100:00100000:2.0:1746147186.258449:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704704 00000100:00100000:2.0:1746147186.258501:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 588 00000100:00100000:2.0:1746147186.258509:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463704704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.258522:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.258540:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911600/0xb4b2209fbdac6629 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e676c expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.258556:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.258560:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.258614:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463704704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.258621:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 588 00000100:00100000:3.0:1746147186.260868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.260906:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466393856:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147186.260926:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147186.260995:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463704576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 11430us (11722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.261003:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5720 00000100:00100000:2.0:1746147186.261088:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463704960 00000100:00100000:2.0:1746147186.261094:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463704960 00002000:00100000:2.0:1746147186.261123:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3723264->3727359) req@ffff8800a5a0ea00 x1830967463704960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.261132:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ea00 with x1830967463704960 ext(3723264->3727359) 00002000:00010000:2.0:1746147186.261136:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ea00 00000100:00100000:2.0:1746147186.261150:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4425 00000100:00100000:2.0:1746147186.261156:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463704960:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147186.261291:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463704960:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 134us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147186.261308:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4425 00002000:00100000:2.0:1746147186.261312:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3723264->3727359) req@ffff8800a5a0ea00 x1830967463704960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.261319:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ea00 with x1830967463704960 ext(3723264->3727359) 00002000:00010000:2.0:1746147186.261321:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ea00 00000100:00100000:3.0:1746147186.266923:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463704448:12345-192.168.203.36@tcp:4:cat.0 Request processed in 16855us (17608us total) trans 21474840628 rc 0/0 00000100:00100000:3.0:1746147186.266958:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1511 00002000:00100000:3.0:1746147186.266969:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1486847) req@ffff8800a5a0d500 x1830967463704448/t21474840628(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.266978:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d500 with x1830967463704448 ext(1048576->1486847) 00010000:00010000:3.0:1746147186.266989:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 24 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.267005:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 24 pid: 6881 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.267011:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0d500 00000100:00100000:2.0:1746147186.269315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.269341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.269353:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463705472 00000100:00100000:2.0:1746147186.269354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.269366:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463705472 00002000:00100000:0.0:1746147186.269417:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012d499180 x1830967463705472/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.269428:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499180 with x1830967463705472 ext(1048576->2097151) 00002000:00010000:0.0:1746147186.269433:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499180 00000100:00100000:2.0:1746147186.269446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.272453:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463705728 00000100:00100000:0.0:1746147186.272469:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463705728 00002000:00100000:0.0:1746147186.272531:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d499880 x1830967463705728/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.272548:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967463705728 ext(1048576->2097151) 00002000:00010000:0.0:1746147186.272564:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:3.0:1746147186.272625:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463705216 00000100:00100000:3.0:1746147186.272631:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463705216 00000100:00100000:2.0:1746147186.272638:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463705984 00000100:00100000:2.0:1746147186.272647:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463705984 00000100:00100000:3.0:1746147186.272660:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4426 00000100:00100000:3.0:1746147186.272670:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463705472:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147186.272699:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (4165632->4169727) req@ffff88008d5df480 x1830967463705984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.272708:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967463705984 ext(4165632->4169727) 00002000:00010000:2.0:1746147186.272712:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:2.0:1746147186.272743:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4427 00000100:00100000:2.0:1746147186.272749:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463705728:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.273446:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4428 00000100:00100000:0.0:1746147186.273457:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463705984:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.273627:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463705984:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 172us (4199us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147186.273633:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4428 00002000:00100000:0.0:1746147186.273639:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (4165632->4169727) req@ffff88008d5df480 x1830967463705984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.273646:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967463705984 ext(4165632->4169727) 00002000:00010000:0.0:1746147186.273649:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df480 00002000:00100000:3.0:1746147186.275274:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d49b480 x1830967463705216/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.275283:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b480 with x1830967463705216 ext(0->1048575) 00002000:00010000:3.0:1746147186.275287:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b480 00000100:00100000:3.0:1746147186.275314:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4429 00000100:00100000:3.0:1746147186.275321:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463705216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.283980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.284558:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463706112 00000100:00100000:1.0:1746147186.284568:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463706112 00010000:00010000:1.0:1746147186.284615:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 26 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.285290:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5721 00000100:00100000:1.0:1746147186.285300:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463706112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.285313:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147186.285337:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 26 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.285354:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 26 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.285378:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac656c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6703 expref: 26 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.285427:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.285429:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.285437:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.285445:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.285477:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.285489:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466393984:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147186.285564:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.286351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.287010:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463706240 00000100:00100000:2.0:1746147186.287018:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463706240 00000100:00100000:2.0:1746147186.287055:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11626 00000100:00100000:2.0:1746147186.287061:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28854:x1830967463706240:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.287075:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.287089:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6773 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.287111:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.287118:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.287120:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.287123:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1585152->2002943] (req 1585152->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.287142:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.287151:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 38 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.287160:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394112:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.287215:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.287519:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463705472:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14850us (18211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.287530:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4426 00002000:00100000:3.0:1746147186.287539:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012d499180 x1830967463705472/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.287549:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499180 with x1830967463705472 ext(1048576->2097151) 00002000:00010000:3.0:1746147186.287553:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499180 00000100:00100000:2.0:1746147186.291898:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463705728:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19140us (22547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.291910:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4427 00002000:00100000:2.0:1746147186.291919:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d499880 x1830967463705728/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.291928:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967463705728 ext(1048576->2097151) 00002000:00010000:2.0:1746147186.291934:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:3.0:1746147186.292055:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463705216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16734us (22698us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.292063:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4429 00002000:00100000:3.0:1746147186.292067:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d49b480 x1830967463705216/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.292074:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b480 with x1830967463705216 ext(0->1048575) 00002000:00010000:3.0:1746147186.292078:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b480 00000100:00100000:1.0:1746147186.294132:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466393984:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147186.294155:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147186.294190:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463706112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8891us (10218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.294199:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5721 00000100:00100000:2.0:1746147186.294713:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.294734:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1585152->2002943] (req 1585152->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.294748:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092911600, rc 0) 00000100:00100000:2.0:1746147186.294770:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28854:x1830967463706240:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7709us (8421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.294776:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11626 00000100:00100000:0.0:1746147186.295140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.295204:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463706496 00000100:00100000:3.0:1746147186.295210:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463706496 00002000:00100000:3.0:1746147186.295244:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012ba59500 x1830967463706496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.295254:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59500 with x1830967463706496 ext(1048576->2097151) 00010000:00010000:3.0:1746147186.295260:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.295273:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.295280:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba59500 00000100:00100000:3.0:1746147186.295308:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1512 00000100:00100000:3.0:1746147186.295314:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463706496:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147186.307013:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463706496:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11688us (11863us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.307025:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1512 00002000:00100000:3.0:1746147186.307038:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012ba59500 x1830967463706496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.307048:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59500 with x1830967463706496 ext(1048576->2097151) 00010000:00010000:3.0:1746147186.307058:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.307071:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.307078:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba59500 00000100:00100000:0.0:1746147186.314920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.315057:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463706624 00000100:00100000:2.0:1746147186.315069:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463706624 00000100:00100000:1.0:1746147186.316150:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.316182:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463706752 00000100:00100000:1.0:1746147186.316189:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463706752 00010000:00010000:1.0:1746147186.316224:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.316266:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5722 00000100:00100000:1.0:1746147186.316278:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463706752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.316290:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147186.316319:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.316330:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.316358:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac660d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e675e expref: 39 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.316381:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.316383:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.316390:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.316402:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.316430:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.316450:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466394240:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.316479:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11627 00000100:00100000:2.0:1746147186.316490:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28852:x1830967463706624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.316508:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.316522:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e677a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.316534:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455480 going to sleep for 11 seconds 00010000:00010000:2.0:1746147186.316546:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.316554:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.316555:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.316558:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.316584:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.316595:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.316618:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394368:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.317810:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.318221:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466394240:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.318236:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.318264:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463706752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1986us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.318272:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5722 00000100:00100000:0.0:1746147186.318659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.318756:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463707008 00000100:00100000:3.0:1746147186.318763:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463707008 00002000:00100000:3.0:1746147186.318798:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1585152->1589247) req@ffff88012ba58380 x1830967463707008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.318806:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58380 with x1830967463707008 ext(1585152->1589247) 00010000:00010000:3.0:1746147186.318812:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 26 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.318842:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 26 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.318848:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba58380 00000100:00100000:3.0:1746147186.318924:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1513 00000100:00100000:3.0:1746147186.318932:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463707008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147186.319115:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463707008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 184us (457us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147186.319124:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1513 00002000:00100000:3.0:1746147186.319129:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1585152->1589247) req@ffff88012ba58380 x1830967463707008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147186.319130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147186.319136:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58380 with x1830967463707008 ext(1585152->1589247) 00010000:00010000:3.0:1746147186.319140:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 26 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.319149:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 26 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.319154:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba58380 00000100:00100000:3.0:1746147186.319206:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463707392 00000100:00100000:3.0:1746147186.319209:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463707392 00000100:00100000:0.0:1746147186.319218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147186.319223:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ba5aa00 x1830967463707392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.319229:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5aa00 with x1830967463707392 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.319232:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5aa00 00000100:00100000:0.0:1746147186.319241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.319538:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463707648 00000100:00100000:3.0:1746147186.319541:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463707648 00002000:00100000:3.0:1746147186.319554:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f5180 x1830967463707648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.319560:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5180 with x1830967463707648 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.319563:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f5180 00000100:00100000:3.0:1746147186.319581:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463707776 00000100:00100000:3.0:1746147186.319583:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463707776 00000100:00100000:2.0:1746147186.319587:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4430 00000100:00100000:2.0:1746147186.319593:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463707392:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147186.319594:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800929f5500 x1830967463707776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 504/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.319599:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5500 with x1830967463707776 ext(3145728->4194303) 00002000:00010000:3.0:1746147186.319602:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5500 00000100:00100000:3.0:1746147186.319623:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4431 00000100:00100000:3.0:1746147186.319627:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463707648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.321334:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4432 00000100:00100000:2.0:1746147186.321343:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463707776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.323380:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394368:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.323408:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.323422:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092911200, rc 0) 00000100:00100000:3.0:1746147186.323464:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28852:x1830967463706624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6976us (8552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.323471:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11627 00000100:00100000:0.0:1746147186.323967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.324018:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463708032 00000100:00100000:1.0:1746147186.324025:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463708032 00002000:00100000:1.0:1746147186.324053:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1998848->2002943) req@ffff8800929f6a00 x1830967463708032/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.324062:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6a00 with x1830967463708032 ext(1998848->2002943) 00010000:00010000:1.0:1746147186.324068:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.324079:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.324085:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f6a00 00000100:00100000:1.0:1746147186.324099:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1514 00000100:00100000:1.0:1746147186.324106:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463708032:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147186.324211:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463708032:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 105us (245us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147186.324216:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1514 00002000:00100000:1.0:1746147186.324221:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1998848->2002943) req@ffff8800929f6a00 x1830967463708032/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.324228:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6a00 with x1830967463708032 ext(1998848->2002943) 00010000:00010000:1.0:1746147186.324232:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.324241:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.324247:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f6a00 00000100:00100000:2.0:1746147186.330223:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463707392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10621us (11084us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.330234:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4430 00002000:00100000:2.0:1746147186.330245:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ba5aa00 x1830967463707392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.330254:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5aa00 with x1830967463707392 ext(2097152->3145727) 00002000:00010000:2.0:1746147186.330259:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5aa00 00000100:00100000:3.0:1746147186.331295:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463707648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11664us (12074us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.331302:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4431 00002000:00100000:3.0:1746147186.331308:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f5180 x1830967463707648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.331315:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5180 with x1830967463707648 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.331319:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f5180 00000100:00100000:1.0:1746147186.335092:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.335128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.335304:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463707776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13961us (16059us total) trans 0 rc 602112/602112 00000100:00100000:1.0:1746147186.335314:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4432 00002000:00100000:1.0:1746147186.335324:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800929f5500 x1830967463707776/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 504/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.335332:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5500 with x1830967463707776 ext(3145728->4194303) 00002000:00010000:1.0:1746147186.335337:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5500 00000100:00100000:1.0:1746147186.335354:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463708288 00000100:00100000:1.0:1746147186.335361:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463708288 00002000:00100000:1.0:1746147186.335384:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1585152->2002943) req@ffff88009b209500 x1830967463708288/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.335391:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463708288 ext(1585152->2002943) 00010000:00010000:1.0:1746147186.335398:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.335408:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 25 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.335417:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b209500 00000100:00100000:1.0:1746147186.335432:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1515 00000100:00100000:1.0:1746147186.335439:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463708288:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147186.335822:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463708544 00000100:00100000:2.0:1746147186.335826:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463708544 00000100:00100000:2.0:1746147186.335849:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4150 00000100:00100000:2.0:1746147186.335854:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28854:x1830967463708544:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147186.336042:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28854:x1830967463708544:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 187us (958us total) trans 8589944229 rc 0/0 00000100:00100000:2.0:1746147186.336047:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4150 00000100:00100000:1.0:1746147186.342802:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463708288:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7354us (7665us total) trans 21474840629 rc 0/0 00000100:00100000:1.0:1746147186.342814:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1515 00002000:00100000:1.0:1746147186.342826:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1585152->2002943) req@ffff88009b209500 x1830967463708288/t21474840629(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.342835:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463708288 ext(1585152->2002943) 00010000:00010000:1.0:1746147186.342844:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.342857:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.342863:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b209500 00000100:00100000:0.0:1746147186.343992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.344166:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463708672 00000100:00100000:3.0:1746147186.344174:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463708672 00000100:00100000:3.0:1746147186.344210:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11628 00000100:00100000:3.0:1746147186.344216:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463708672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.345313:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.345331:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac664c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6781 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.345379:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394496:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.345849:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.348643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.348720:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463708800 00000100:00100000:2.0:1746147186.348737:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463708800 00010000:00010000:2.0:1746147186.348773:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.348815:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5723 00000100:00100000:2.0:1746147186.348822:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463708800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.348833:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147186.348847:0:16058:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147185 -> 1746147186 00002000:00010000:2.0:1746147186.348850:0:16058:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147185 -> 1746147186 00010000:00010000:2.0:1746147186.348855:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.348865:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.348884:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.348885:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.348891:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.348898:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.348933:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.348966:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466394624:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.349049:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00010000:00010000:3.0:1746147186.349118:0:8478:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a5a0f100 x1830967466394496) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.349132:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092911600/0xb4b2209fbdac663e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6773 expref: 27 pid: 8478 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.349144:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466394496:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147186.349162:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac664c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6781 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.349170:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50c600/0xb4b2209fbdac664c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6781 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.349176:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50c600, rc 0) 00000100:00100000:3.0:1746147186.349195:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463708672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4980us (5207us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.349201:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11628 00000100:00100000:2.0:1746147186.353577:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466394624:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.353596:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.353645:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463708800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4822us (5009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.353654:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5723 00000100:00100000:0.0:1746147186.356104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.356392:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709056 00000100:00100000:1.0:1746147186.356401:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709056 00002000:00100000:1.0:1746147186.356437:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008f81bb80 x1830967463709056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.356445:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81bb80 with x1830967463709056 ext(1048576->2097151) 00002000:00010000:1.0:1746147186.356450:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81bb80 00000100:00100000:1.0:1746147186.356476:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4433 00000100:00100000:1.0:1746147186.356483:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463709056:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.359264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.359342:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709184 00000100:00100000:3.0:1746147186.359349:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709184 00000100:00100000:3.0:1746147186.359387:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11629 00000100:00100000:3.0:1746147186.359393:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463709184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.359407:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.359419:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6788 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.359437:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.359439:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.359445:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.359457:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 39 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.359464:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50d600, rc 0) 00000100:00100000:3.0:1746147186.359502:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463709184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.359508:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11629 00000100:00100000:1.0:1746147186.369225:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463709056:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12733us (13118us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147186.369236:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4433 00002000:00100000:1.0:1746147186.369246:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008f81bb80 x1830967463709056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.369253:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81bb80 with x1830967463709056 ext(1048576->2097151) 00002000:00010000:1.0:1746147186.369258:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81bb80 00000100:00100000:0.0:1746147186.378749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.378805:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709312 00000100:00100000:2.0:1746147186.378815:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709312 00000100:00100000:2.0:1746147186.378869:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11630 00000100:00100000:2.0:1746147186.378877:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28852:x1830967463709312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.378892:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.378906:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e678f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.378931:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.378956:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.378958:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.378961:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.378994:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.379004:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 39 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.379015:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466394752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.379437:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.384169:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466394752:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147186.384172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147186.384195:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.384209:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4bbe00, rc 0) 00000100:00100000:2.0:1746147186.384246:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28852:x1830967463709312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5370us (5505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.384253:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11630 00000100:00100000:1.0:1746147186.385017:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709440 00000100:00100000:1.0:1746147186.385026:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709440 00002000:00100000:1.0:1746147186.385058:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3723264->4169727) req@ffff88008f818a80 x1830967463709440/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.385066:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463709440 ext(3723264->4169727) 00010000:00010000:1.0:1746147186.385072:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 40 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.385082:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 40 pid: 21080 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.385088:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f818a80 00000100:00100000:1.0:1746147186.387495:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1516 00000100:00100000:1.0:1746147186.387512:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463709440:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147186.398263:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463709440:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10748us (14083us total) trans 17179873221 rc 0/0 00000100:00100000:1.0:1746147186.398278:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1516 00002000:00100000:1.0:1746147186.398290:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3723264->4169727) req@ffff88008f818a80 x1830967463709440/t17179873221(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.398300:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463709440 ext(3723264->4169727) 00010000:00010000:1.0:1746147186.398308:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.398321:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00002000:00010000:1.0:1746147186.398328:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f818a80 00000100:00100000:0.0:1746147186.403766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.403856:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709568 00000100:00100000:2.0:1746147186.403867:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709568 00010000:00010000:2.0:1746147186.403902:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.403969:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5724 00000100:00100000:2.0:1746147186.403978:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463709568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.403992:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147186.404007:0:16058:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147185 -> 1746147186 00002000:00010000:2.0:1746147186.404010:0:16058:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147185 -> 1746147186 00002000:00010000:2.0:1746147186.404012:0:16058:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147185 -> 1746147186 00010000:00010000:2.0:1746147186.404017:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.404029:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.404049:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0efa00/0xb4b2209fbdac6606 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4169727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6757 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.404080:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.404082:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.404088:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.404095:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.404124:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.404134:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466394880:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.404227:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.406594:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466394880:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.406619:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.406973:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463709568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2994us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.406982:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5724 00000100:00100000:0.0:1746147186.408877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.410867:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463709824 00000100:00100000:2.0:1746147186.410879:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463709824 00000100:00100000:2.0:1746147186.410925:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10488 00000100:00100000:2.0:1746147186.410933:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:28859:x1830967463709824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.410971:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.410987:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6796 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.411069:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411079:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411087:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411096:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411100:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411105:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411182:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411188:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411194:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147186.411200:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147186.411266:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411272:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411278:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411282:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dde00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.411286:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411291:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411300:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147186.411303:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.411306:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411310:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dde00/0xb4b2209fbdac6668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411323:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411327:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411335:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411339:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e9dce00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.411341:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411345:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411350:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9200) 00010000:00010000:2.0:1746147186.411352:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.411354:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411359:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dce00/0xb4b2209fbdac666f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.411386:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac6661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 310 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.411396:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 309 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.411402:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.411404:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147186.411406:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18c00, rc 0) 00000100:00100000:2.0:1746147186.411449:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28859:x1830967463709824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 516us (2577us total) trans 8589944230 rc 0/0 00000100:00100000:2.0:1746147186.411456:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10488 00000100:00100000:0.0:1746147186.412295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.412331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.412367:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463710208 00000100:00100000:3.0:1746147186.412373:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463710208 00000100:00100000:1.0:1746147186.412382:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463710080 00000100:00100000:1.0:1746147186.412385:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463710080 00002000:00100000:3.0:1746147186.412398:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090740a80 x1830967463710208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.412398:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090742d80 x1830967463710080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.412407:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740a80 with x1830967463710208 ext(3145728->4194303) 00002000:00100000:1.0:1746147186.412407:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742d80 with x1830967463710080 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.412410:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740a80 00002000:00010000:1.0:1746147186.412410:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742d80 00000100:00100000:3.0:1746147186.412423:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4434 00000100:00100000:1.0:1746147186.412426:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4435 00000100:00100000:3.0:1746147186.412428:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463710208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147186.412430:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463710080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.417152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.417208:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463710592 00000100:00100000:3.0:1746147186.417217:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463710592 00000100:00100000:3.0:1746147186.417254:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4151 00000100:00100000:3.0:1746147186.417262:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28859:x1830967463710592:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147186.417429:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:28859:x1830967463710592:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 167us (283us total) trans 8589944231 rc 0/0 00000100:00100000:3.0:1746147186.417435:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4151 00000100:00100000:1.0:1746147186.422351:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463710080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9912us (10011us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147186.422361:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4435 00002000:00100000:1.0:1746147186.422372:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090742d80 x1830967463710080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.422386:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742d80 with x1830967463710080 ext(2097152->3145727) 00002000:00010000:1.0:1746147186.422391:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742d80 00000100:00100000:2.0:1746147186.428686:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463710208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16246us (16383us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.428699:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4434 00002000:00100000:2.0:1746147186.428710:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090740a80 x1830967463710208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.428719:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740a80 with x1830967463710208 ext(3145728->4194303) 00002000:00010000:2.0:1746147186.428726:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740a80 00000100:00100000:0.0:1746147186.434670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.434793:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463710848 00000100:00100000:3.0:1746147186.434805:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463710848 00000100:00100000:3.0:1746147186.438117:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4152 00000100:00100000:3.0:1746147186.438135:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28852:x1830967463710848:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147186.438467:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28852:x1830967463710848:12345-192.168.203.36@tcp:35:cat.0 Request processed in 338us (3805us total) trans 8589944232 rc 0/0 00000100:00100000:3.0:1746147186.438474:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4152 00000100:00100000:0.0:1746147186.478398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.478514:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463710976 00000100:00100000:2.0:1746147186.478522:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463710976 00000100:00100000:2.0:1746147186.478562:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10489 00000100:00100000:2.0:1746147186.478569:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+6:28861:x1830967463710976:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147186.478592:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.478618:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac6684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e679d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.478673:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.478685:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.478696:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.478710:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.478715:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.478724:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.479443:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.479454:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 309 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.479462:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.479491:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 309 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.479503:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 309 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.479515:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466395008:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.480168:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.485449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.485597:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711104 00000100:00100000:3.0:1746147186.485616:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711104 00010000:00010000:3.0:1746147186.485651:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 310 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.485681:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5725 00000100:00100000:3.0:1746147186.485686:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+310:1956:x1830967463711104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.485698:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.485702:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 310 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.485711:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 310 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.485731:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.485736:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.485744:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.485749:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.485764:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147186.485837:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd000/0xb4b2209fbdac65d5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6749 expref: 310 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.485860:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466395008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.485879:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.485887:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.485896:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147186.485963:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147186.485968:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147186.485984:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.485997:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486007:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486012:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486018:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486023:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a1fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.486027:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486033:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486044:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147186.486046:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.486050:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486054:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a1fa00/0xb4b2209fbdac668b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486063:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486068:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486073:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486076:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea56a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147186.486079:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486083:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486088:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9b00) 00010000:00010000:2.0:1746147186.486090:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147186.486092:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.486096:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147186.486166:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1956:x1830967463711104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 478us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.486172:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5725 00010000:00010000:2.0:1746147186.487768:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac6684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.487784:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 7 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.487791:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.487794:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147186.487796:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea57400, rc 0) 00000100:00100000:2.0:1746147186.489134:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+7:28861:x1830967463710976:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10559us (10739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.489144:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10489 00000100:00100000:0.0:1746147186.490197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.490259:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711232 00000100:00100000:2.0:1746147186.490266:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711232 00000100:00100000:2.0:1746147186.490317:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11631 00000100:00100000:2.0:1746147186.490323:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28859:x1830967463711232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.490342:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.490359:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67a4 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.492003:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492022:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492030:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492036:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.492038:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.492041:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.492075:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492088:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.492100:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.492205:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 25 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492213:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 25 pid: 21080 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.492219:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395264:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.492239:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.492245:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 14 pid: 8478 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.492252:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395392:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.492266:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.496676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.496769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.497186:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711360 00000100:00100000:3.0:1746147186.497194:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711360 00000100:00100000:3.0:1746147186.497228:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711488 00000100:00100000:3.0:1746147186.497230:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711488 00000100:00100000:3.0:1746147186.497904:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11632 00000100:00100000:3.0:1746147186.497911:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463711360:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147186.497919:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11633 00010000:00010000:3.0:1746147186.497929:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147186.497951:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463711488:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147186.497958:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67ab expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.497968:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.497980:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.497982:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.497983:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67b2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.497990:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.498002:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.498003:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.498008:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.498011:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.498024:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.498027:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092910a00, rc 0) 00010000:00010000:1.0:1746147186.498033:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4400, rc 0) 00000100:00100000:3.0:1746147186.498071:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463711360:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 161us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.498075:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463711488:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 147us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.498077:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11632 00000100:00100000:1.0:1746147186.498081:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11633 00000100:00100000:0.0:1746147186.498429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.498680:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711616 00000100:00100000:2.0:1746147186.498685:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711616 00000100:00100000:2.0:1746147186.498716:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11634 00000100:00100000:2.0:1746147186.498722:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463711616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147186.498731:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.498739:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67b9 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.498749:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.498750:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.498755:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.498764:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.498770:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49ec800, rc 0) 00000100:00100000:2.0:1746147186.498804:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463711616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.498809:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11634 00000100:00100000:2.0:1746147186.502369:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.502385:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.502393:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466395392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.502430:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 40 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.502721:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea57e00, rc 0) 00000100:00100000:2.0:1746147186.502877:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+40:28859:x1830967463711232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12551us (12684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.503441:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11631 00000100:00100000:1.0:1746147186.503726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.503804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.503865:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711872 00000100:00100000:3.0:1746147186.503872:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711872 00010000:00010000:3.0:1746147186.503897:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 16 pid: 8478 timeout: 673 lvb_type: 1 00000100:00100000:3.0:1746147186.503915:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463711744 00000100:00100000:3.0:1746147186.503916:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463711744 00010000:00010000:3.0:1746147186.503923:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 673 lvb_type: 1 00000100:00100000:3.0:1746147186.503951:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5726 00000100:00100000:3.0:1746147186.503957:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463711872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.503967:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.503988:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 16 pid: 8478 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.503998:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 16 pid: 8478 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.504026:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac63eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6623 expref: 16 pid: 8478 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.504041:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.504064:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463711872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.504069:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5726 00000100:00100000:3.0:1746147186.504081:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5727 00000100:00100000:3.0:1746147186.504085:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463711744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.504092:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.504099:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.504106:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.504117:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064600/0xb4b2209fbdac64d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6670 expref: 40 pid: 8480 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.504124:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.504137:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463711744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.504141:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5727 00000100:00100000:2.0:1746147186.510179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.510263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.510380:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463712256 00000100:00100000:3.0:1746147186.510389:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463712256 00000100:00100000:3.0:1746147186.510428:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10490 00000100:00100000:3.0:1746147186.510435:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+7:28861:x1830967463712256:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147186.510454:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.510471:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092910600/0xb4b2209fbdac66bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67c0 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.510565:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.510579:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.510586:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.510627:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.510637:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 8 pid: 14048 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.510648:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466395520:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.510705:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.512118:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463712000 00000100:00100000:0.0:1746147186.512126:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463712000 00010000:00010000:0.0:1746147186.512155:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 26 pid: 21080 timeout: 673 lvb_type: 1 00000100:00100000:0.0:1746147186.512248:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5728 00000100:00100000:0.0:1746147186.512255:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463712000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.512266:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.512287:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 26 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.512297:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 26 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.512322:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e17cc00/0xb4b2209fbdac6503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66a1 expref: 26 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:0.0:1746147186.512957:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.512959:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.512968:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.512976:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.513007:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147186.513019:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466395648:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147186.514062:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.515847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.515933:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466395520:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.515989:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147186.516101:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463712384 00000100:00100000:2.0:1746147186.516107:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463712384 00010000:00010000:2.0:1746147186.516135:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 9 pid: 14048 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.516575:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466395648:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147186.516589:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147186.516637:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463712000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4381us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.516647:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5728 00000100:00100000:2.0:1746147186.517526:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5729 00000100:00100000:2.0:1746147186.517535:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463712384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.517548:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.517555:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 9 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.517567:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 9 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.517588:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea57400/0xb4b2209fbdac6699 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e679d expref: 9 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.518054:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.518060:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.518069:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.518076:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147186.518104:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147186.518172:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.518183:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147186.518201:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.518343:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092910600/0xb4b2209fbdac66bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 10 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.518376:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463712384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 843us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.518383:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5729 00010000:00010000:3.0:1746147186.519424:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 8 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.519433:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.519436:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147186.519438:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092910e00, rc 0) 00000100:00100000:3.0:1746147186.519501:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463712256:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9066us (9238us total) trans 8589944233 rc 0/0 00000100:00100000:3.0:1746147186.519509:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10490 00000100:00100000:0.0:1746147186.523766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.523822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.524216:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463712896 00000100:00100000:2.0:1746147186.524224:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463712896 00002000:00100000:2.0:1746147186.524267:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3772416->3776511) req@ffff88009f7ce300 x1830967463712896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.524278:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce300 with x1830967463712896 ext(3772416->3776511) 00002000:00010000:2.0:1746147186.524284:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ce300 00000100:00100000:2.0:1746147186.524314:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4436 00000100:00100000:2.0:1746147186.524321:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463712896:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147186.524487:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463712896:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 166us (1119us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147186.524494:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4436 00002000:00100000:2.0:1746147186.524500:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3772416->3776511) req@ffff88009f7ce300 x1830967463712896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.524507:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce300 with x1830967463712896 ext(3772416->3776511) 00002000:00010000:2.0:1746147186.524510:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ce300 00000100:00100000:3.0:1746147186.524704:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463712768 00000100:00100000:3.0:1746147186.524708:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463712768 00000100:00100000:3.0:1746147186.524733:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10491 00000100:00100000:3.0:1746147186.524738:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+309:28864:x1830967463712768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.524753:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.524770:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911a00/0xb4b2209fbdac66d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67c7 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.524859:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.524872:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.524884:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.524895:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.524901:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.524906:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525018:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911c00/0xb4b2209fbdac66e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525027:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092911c00/0xb4b2209fbdac66e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525032:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092911c00/0xb4b2209fbdac66e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147186.525040:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.525119:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525126:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525131:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525137:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092911400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.525141:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525148:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525158:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147186.525161:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.525164:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525169:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911400/0xb4b2209fbdac66d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525179:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525183:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525188:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525191:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092911e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.525193:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525197:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525202:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13900) 00010000:00010000:3.0:1746147186.525204:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.525206:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525211:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911e00/0xb4b2209fbdac66df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.525241:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911a00/0xb4b2209fbdac66d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c7 expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.525251:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092911c00/0xb4b2209fbdac66e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c7 expref: 311 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.525257:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.525259:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147186.525261:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092911c00, rc 0) 00000100:00100000:3.0:1746147186.525296:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+311:28864:x1830967463712768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 557us (1510us total) trans 8589944234 rc 0/0 00000100:00100000:3.0:1746147186.525302:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10491 00000100:00100000:0.0:1746147186.525422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.525797:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713024 00000100:00100000:1.0:1746147186.525802:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713024 00000100:00100000:1.0:1746147186.525824:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10492 00000100:00100000:1.0:1746147186.525829:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463713024:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147186.525838:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.525844:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0xb4b2209fbdac66f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67ce expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.525882:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.525891:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.525898:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.525949:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 9 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.525961:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 9 pid: 14048 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.525972:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466395776:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.526037:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.530157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.530278:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466395776:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147186.530304:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147186.530541:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713536 00000100:00100000:3.0:1746147186.530547:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713536 00000100:00100000:3.0:1746147186.530586:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4153 00000100:00100000:3.0:1746147186.530593:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:28864:x1830967463713536:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147186.530797:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28864:x1830967463713536:12345-192.168.203.36@tcp:35:cat.0 Request processed in 204us (649us total) trans 8589944235 rc 0/0 00000100:00100000:3.0:1746147186.530804:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4153 00000100:00100000:0.0:1746147186.532442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.532471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.532507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.532666:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713280 00000100:00100000:1.0:1746147186.532672:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713280 00000100:00100000:1.0:1746147186.532702:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713152 00000100:00100000:1.0:1746147186.532704:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713152 00010000:00010000:1.0:1746147186.532715:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 10 pid: 14048 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.532730:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5730 00000100:00100000:1.0:1746147186.532736:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463713152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.532746:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147186.532752:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 10 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.532762:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 10 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.532781:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092910e00/0xb4b2209fbdac66c3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c0 expref: 10 pid: 14048 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.532798:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.532803:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.532812:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.532818:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.532837:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147186.532864:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463713152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.532869:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5730 00000100:00100000:1.0:1746147186.532881:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 589 00000100:00100000:1.0:1746147186.532885:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1957:x1830967463713280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.532891:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147186.532900:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092911c00/0xb4b2209fbdac66e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67c7 expref: 312 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.532909:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.532911:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147186.532923:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+311:1957:x1830967463713280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.532927:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 589 00010000:00010000:1.0:1746147186.532963:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.533516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.533571:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713664 00000100:00100000:2.0:1746147186.533576:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713664 00000100:00100000:2.0:1746147186.533611:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713792 00000100:00100000:2.0:1746147186.533613:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713792 00000100:00100000:2.0:1746147186.533630:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11635 00000100:00100000:2.0:1746147186.533635:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:28859:x1830967463713664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.533655:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.533669:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67d5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.533693:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.533701:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.533707:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.533709:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.533712:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.533720:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11636 00000100:00100000:3.0:1746147186.533729:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463713792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.533736:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.533737:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.533744:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092910800/0xb4b2209fbdac6709 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67dc expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.533746:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 13 pid: 17548 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.533756:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466395904:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.533762:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.533769:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092910800/0xb4b2209fbdac6709 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67dc expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.533778:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092910800/0xb4b2209fbdac6709 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67dc expref: 44 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.533785:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092910800, rc 0) 00000100:00100000:3.0:1746147186.533807:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463713792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 80us (292us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147186.533808:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.533813:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11636 00010000:00010000:2.0:1746147186.533816:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 28 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.533829:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466396032:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147186.533867:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147186.533906:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:1.0:1746147186.533910:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147186.533924:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.533968:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0xb4b2209fbdac66f4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.533982:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.533988:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.533990:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147186.533992:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4e00, rc 0) 00000100:00100000:1.0:1746147186.534012:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463713024:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8183us (8590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.534017:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10492 00000100:00100000:2.0:1746147186.534494:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.536590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.536748:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466396032:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.537009:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463713920 00000100:00100000:1.0:1746147186.537015:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463713920 00000100:00100000:1.0:1746147186.537052:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11637 00000100:00100000:1.0:1746147186.537059:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463713920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147186.537073:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.537087:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0xb4b2209fbdac6710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67e3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.537136:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396160:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.537203:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.537381:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466395904:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147186.537408:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 42 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.537419:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49eca00, rc 0) 00000100:00100000:0.0:1746147186.537439:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+42:28859:x1830967463713664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3804us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.537445:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11635 00000100:00100000:2.0:1746147186.537537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.537648:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463714048 00000100:00100000:3.0:1746147186.537653:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463714048 00010000:00010000:3.0:1746147186.537672:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 673 lvb_type: 1 00000100:00100000:3.0:1746147186.538851:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5731 00000100:00100000:3.0:1746147186.538860:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463714048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.538873:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.538895:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.538906:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.538930:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49ec800/0xb4b2209fbdac66b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b9 expref: 14 pid: 17548 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.538957:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.539063:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463714048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 204us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.539069:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5731 00000100:00100000:0.0:1746147186.539131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.539221:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463714176 00000100:00100000:3.0:1746147186.539225:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463714176 00010000:00010000:3.0:1746147186.539238:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.539614:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5732 00000100:00100000:3.0:1746147186.539620:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463714176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.539628:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.539636:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.539644:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.539656:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4bbe00/0xb4b2209fbdac665a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e678f expref: 29 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.539666:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.539668:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.539676:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.539684:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.539712:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.539722:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466396288:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.540707:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.546792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.546884:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463714432 00000100:00100000:2.0:1746147186.546892:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463714432 00002000:00100000:2.0:1746147186.546982:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8801312a6680 x1830967463714432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.546992:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967463714432 ext(1048576->2097151) 00002000:00010000:2.0:1746147186.546998:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6680 00000100:00100000:2.0:1746147186.547018:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4437 00000100:00100000:2.0:1746147186.547025:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463714432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.551801:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466396288:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147186.551823:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.551867:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463714176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12246us (12736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.551877:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5732 00002000:00010000:1.0:1746147186.552302:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147185 -> 1746147186 00002000:00010000:1.0:1746147186.552306:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147185 -> 1746147186 00002000:00010000:1.0:1746147186.552308:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147185 -> 1746147186 00000100:00100000:1.0:1746147186.552328:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396160:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147186.552357:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0xb4b2209fbdac6710 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67e3 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.552374:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0xb4b2209fbdac6710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67e3 expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.552384:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5000, rc 0) 00000100:00100000:1.0:1746147186.552417:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463713920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 15358us (15832us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.552423:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11637 00000100:00100000:0.0:1746147186.556907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.559455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.559828:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463714432:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12799us (13041us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.559838:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4437 00002000:00100000:2.0:1746147186.559849:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8801312a6680 x1830967463714432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.559860:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967463714432 ext(1048576->2097151) 00002000:00010000:2.0:1746147186.559866:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6680 00000100:00100000:1.0:1746147186.560042:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463714688 00000100:00100000:1.0:1746147186.560049:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463714688 00000100:00100000:1.0:1746147186.560065:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463714944 00000100:00100000:1.0:1746147186.560067:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463714944 00000100:00100000:1.0:1746147186.560111:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10493 00000100:00100000:1.0:1746147186.560118:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463714944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147186.560140:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.560157:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5200/0xb4b2209fbdac6717 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67ea expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.560262:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560275:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560291:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560301:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560314:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560320:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560325:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147186.560328:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560334:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560349:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.560352:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147186.560355:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560360:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac671e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.560386:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5200/0xb4b2209fbdac6717 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ea expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.560392:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5200/0xb4b2209fbdac6717 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ea expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.560398:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5200, rc 0) 00000100:00100000:1.0:1746147186.560422:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463714944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 304us (975us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.560426:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10493 00002000:00100000:1.0:1746147186.560458:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3305472->3309567) req@ffff8801312a4000 x1830967463714688/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.560465:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967463714688 ext(3305472->3309567) 00002000:00010000:1.0:1746147186.560472:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4000 00000100:00100000:1.0:1746147186.560484:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4438 00000100:00100000:1.0:1746147186.560488:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463714688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147186.561331:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463714688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 839us (4430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147186.561338:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4438 00002000:00100000:1.0:1746147186.561345:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3305472->3309567) req@ffff8801312a4000 x1830967463714688/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.561353:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967463714688 ext(3305472->3309567) 00002000:00010000:1.0:1746147186.561356:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4000 00000100:00100000:0.0:1746147186.568183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.568317:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463715200 00000100:00100000:1.0:1746147186.568326:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463715200 00000100:00100000:1.0:1746147186.568385:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10494 00000100:00100000:1.0:1746147186.568393:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28869:x1830967463715200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.568419:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.568437:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5800/0xb4b2209fbdac6725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67f1 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.568546:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568560:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568575:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568588:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568593:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568597:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568711:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568720:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568726:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147186.568734:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147186.568824:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568830:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568835:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568841:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147186.568845:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568850:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568860:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147186.568863:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147186.568866:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568870:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac672c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568879:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568883:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568887:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568890:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147186.568892:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568896:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568900:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:1.0:1746147186.568902:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147186.568904:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568907:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0xb4b2209fbdac6733 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.568959:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5800/0xb4b2209fbdac6725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.568971:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147186.569388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.570119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147186.570133:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.570137:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147186.570140:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5e00, rc 0) 00000100:00100000:2.0:1746147186.570199:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463715456 00000100:00100000:1.0:1746147186.570203:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28869:x1830967463715200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1807us (2028us total) trans 8589944236 rc 0/0 00000100:00100000:2.0:1746147186.570206:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463715456 00000100:00100000:1.0:1746147186.570212:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10494 00000100:00100000:2.0:1746147186.570239:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463715712 00000100:00100000:2.0:1746147186.570241:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463715712 00000100:00100000:2.0:1746147186.570260:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4154 00000100:00100000:2.0:1746147186.570265:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28861:x1830967463715456:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147186.570302:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4155 00000100:00100000:3.0:1746147186.570311:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:28859:x1830967463715712:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147186.570427:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28859:x1830967463715712:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 118us (308us total) trans 8589944237 rc 0/0 00000100:00100000:3.0:1746147186.570434:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4155 00000100:00100000:2.0:1746147186.571070:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28861:x1830967463715456:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 803us (1681us total) trans 8589944238 rc 0/0 00000100:00100000:2.0:1746147186.571077:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4154 00000100:00100000:0.0:1746147186.572107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.572233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.572261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.572278:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716224 00000100:00100000:0.0:1746147186.572284:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716224 00002000:00100000:0.0:1746147186.572317:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3309568->4194303) req@ffff8801312a5c00 x1830967463716224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.572326:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5c00 with x1830967463716224 ext(3309568->4194303) 00002000:00010000:0.0:1746147186.572331:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5c00 00000100:00100000:0.0:1746147186.572356:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716096 00000100:00100000:0.0:1746147186.572359:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716096 00002000:00100000:0.0:1746147186.572371:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8801312a4a80 x1830967463716096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.572376:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4a80 with x1830967463716096 ext(2097152->3145727) 00002000:00010000:0.0:1746147186.572379:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4a80 00000100:00100000:0.0:1746147186.573220:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716480 00000100:00100000:0.0:1746147186.573225:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716480 00002000:00100000:0.0:1746147186.573244:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c9180 x1830967463716480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147186.573284:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4439 00000100:00100000:2.0:1746147186.573293:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463716224:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147186.574243:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9180 with x1830967463716480 ext(2097152->3145727) 00002000:00010000:0.0:1746147186.574247:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9180 00000100:00100000:0.0:1746147186.574268:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4440 00000100:00100000:0.0:1746147186.574275:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463716096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.575063:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4441 00000100:00100000:3.0:1746147186.575073:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463716480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147186.575906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.575929:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716608 00000100:00100000:2.0:1746147186.575948:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716608 00002000:00100000:2.0:1746147186.575977:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3772415) req@ffff88009b20b480 x1830967463716608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.575986:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463716608 ext(3145728->3772415) 00002000:00010000:2.0:1746147186.575990:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b480 00000100:00100000:2.0:1746147186.576010:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4442 00000100:00100000:2.0:1746147186.576016:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463716608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.578555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.578672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.578698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.579195:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716864 00000100:00100000:1.0:1746147186.579202:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716864 00000100:00100000:1.0:1746147186.579238:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463716992 00000100:00100000:1.0:1746147186.579239:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463716992 00000100:00100000:1.0:1746147186.579270:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11638 00000100:00100000:1.0:1746147186.579277:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463716864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.579295:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.579312:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb89c00/0xb4b2209fbdac6748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67f8 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.579363:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396416:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.579426:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.579443:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11639 00000100:00100000:1.0:1746147186.579454:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463716992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.579462:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.579472:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb89200/0xb4b2209fbdac674f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e67ff expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.579497:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466396544:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.579520:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.579533:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463717248 00000100:00100000:1.0:1746147186.579535:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463717248 00000100:00100000:1.0:1746147186.579561:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10495 00000100:00100000:1.0:1746147186.579564:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28867:x1830967463717248:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147186.579577:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.579587:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064800/0xb4b2209fbdac6756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6806 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.579687:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.579702:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.579708:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.579713:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147186.579735:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.579750:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 18 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.579758:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466396672:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147186.579784:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.579791:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 8 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.579797:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466396800:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.579812:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.589919:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463716608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13893us (14004us total) trans 0 rc 626688/626688 00000100:00100000:3.0:1746147186.589931:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4442 00002000:00100000:3.0:1746147186.589964:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3772415) req@ffff88009b20b480 x1830967463716608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.589973:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463716608 ext(3145728->3772415) 00002000:00010000:3.0:1746147186.589977:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20b480 00000100:00100000:2.0:1746147186.590030:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463716224:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16737us (17924us total) trans 0 rc 884736/884736 00000100:00100000:2.0:1746147186.590036:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4439 00002000:00100000:2.0:1746147186.590042:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3309568->4194303) req@ffff8801312a5c00 x1830967463716224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 884736/884736 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.590055:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5c00 with x1830967463716224 ext(3309568->4194303) 00002000:00010000:2.0:1746147186.590059:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a5c00 00000100:00100000:3.0:1746147186.590087:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466396672:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.590132:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466396544:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147186.590175:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb89200/0xb4b2209fbdac674f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ff expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.590188:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb89200/0xb4b2209fbdac674f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ff expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.590212:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89200, rc 0) 00000100:00100000:3.0:1746147186.590244:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463716992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10789us (11544us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.590250:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11639 00000100:00100000:1.0:1746147186.590978:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396416:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147186.590996:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb89c00/0xb4b2209fbdac6748 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f8 expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.591007:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb89c00/0xb4b2209fbdac6748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f8 expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.591544:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89c00, rc 0) 00000100:00100000:1.0:1746147186.591628:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463716864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12349us (12954us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.591634:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11638 00000100:00100000:0.0:1746147186.596068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.596965:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463717376 00000100:00100000:3.0:1746147186.596974:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463717376 00000100:00100000:0.0:1746147186.596998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147186.597007:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 19 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.597030:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463717504 00000100:00100000:3.0:1746147186.597032:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463717504 00010000:00010000:3.0:1746147186.597041:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 9 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.597057:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5733 00000100:00100000:3.0:1746147186.597063:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463717376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147186.597069:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5734 00010000:00010000:3.0:1746147186.597075:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147186.597076:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463717504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.597081:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 19 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.597084:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.597088:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 9 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.597090:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 19 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.597099:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 9 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.597118:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5e00/0xb4b2209fbdac673a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67f1 expref: 19 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.597347:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463716096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23072us (25112us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147186.597357:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4440 00002000:00100000:1.0:1746147186.597365:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8801312a4a80 x1830967463716096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.597374:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4a80 with x1830967463716096 ext(2097152->3145727) 00002000:00010000:1.0:1746147186.597378:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a4a80 00010000:00010000:0.0:1746147186.597443:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147186.597449:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.597458:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.597465:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.597482:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.597498:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463717504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 423us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.597508:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5734 00010000:00010000:3.0:1746147186.597509:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.597513:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.597532:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463717376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 468us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.597538:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5733 00010000:00010000:3.0:1746147186.597612:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0xb4b2209fbdac66fb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ce expref: 8 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.597621:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466396800:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.597639:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.597646:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.597655:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.597672:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.597806:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064800/0xb4b2209fbdac6756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.597819:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.597825:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.597827:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147186.597829:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f064200, rc 0) 00000100:00100000:3.0:1746147186.597849:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28867:x1830967463717248:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 18284us (19304us total) trans 8589944239 rc 0/0 00000100:00100000:3.0:1746147186.597855:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10495 00000100:00100000:3.0:1746147186.600987:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463716480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25511us (28319us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.600998:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4441 00002000:00100000:3.0:1746147186.601009:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c9180 x1830967463716480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.601019:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9180 with x1830967463716480 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.601024:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9180 00000100:00100000:0.0:1746147186.614804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.614848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.614879:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463717760 00000100:00100000:1.0:1746147186.614887:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463717760 00000100:00100000:0.0:1746147186.614895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.614924:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463717888 00000100:00100000:1.0:1746147186.614926:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463717888 00000100:00100000:1.0:1746147186.614980:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11640 00000100:00100000:1.0:1746147186.614989:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463717760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.615008:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.615025:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e756a00/0xb4b2209fbdac676b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e680d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.615079:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396928:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.615141:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11641 00000100:00100000:3.0:1746147186.615149:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463717888:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147186.615158:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147186.615159:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.615169:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092911800/0xb4b2209fbdac6772 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6814 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.615194:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466397056:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.615215:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.615321:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718016 00000100:00100000:2.0:1746147186.615325:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718016 00002000:00100000:2.0:1746147186.615352:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e5c8000 x1830967463718016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.615361:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8000 with x1830967463718016 ext(4194304->4927487) 00002000:00010000:2.0:1746147186.615366:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8000 00000100:00100000:2.0:1746147186.615389:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4443 00000100:00100000:2.0:1746147186.615395:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463718016:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.618652:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466397056:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.618652:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466396928:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147186.618685:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092911800/0xb4b2209fbdac6772 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6814 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.618685:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e756a00/0xb4b2209fbdac676b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e680d expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.618700:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092911800/0xb4b2209fbdac6772 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6814 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.618701:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e756a00/0xb4b2209fbdac676b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e680d expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.618723:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092911800, rc 0) 00010000:00010000:1.0:1746147186.618726:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e756a00, rc 0) 00000100:00100000:1.0:1746147186.618759:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463717760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3771us (3966us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.618797:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11640 00000100:00100000:3.0:1746147186.618850:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463717888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3701us (4000us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.618856:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11641 00000100:00100000:2.0:1746147186.624887:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463718016:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9481us (9980us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147186.624899:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4443 00002000:00100000:2.0:1746147186.624911:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e5c8000 x1830967463718016/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.624921:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8000 with x1830967463718016 ext(4194304->4927487) 00002000:00010000:2.0:1746147186.624927:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8000 00000100:00100000:0.0:1746147186.625156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.625217:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718144 00000100:00100000:3.0:1746147186.625224:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718144 00000100:00100000:3.0:1746147186.625253:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11642 00000100:00100000:3.0:1746147186.625259:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28869:x1830967463718144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.625273:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.625289:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e681b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.625313:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.625321:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.625323:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.625326:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.625353:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.625364:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 38 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.625375:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466397184:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.625453:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.629561:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466397184:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.629591:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.629617:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092910200, rc 0) 00000100:00100000:3.0:1746147186.629677:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28869:x1830967463718144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4417us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.629684:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11642 00000100:00100000:0.0:1746147186.630716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.630809:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718272 00000100:00100000:2.0:1746147186.630816:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718272 00002000:00100000:2.0:1746147186.630853:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3772416->4194303) req@ffff88008e5c9880 x1830967463718272/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.630862:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9880 with x1830967463718272 ext(3772416->4194303) 00010000:00010000:2.0:1746147186.630869:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 39 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.630881:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 39 pid: 21080 timeout: 673 lvb_type: 0 00002000:00010000:2.0:1746147186.630892:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9880 00000100:00100000:2.0:1746147186.630919:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1517 00000100:00100000:2.0:1746147186.630925:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463718272:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147186.637983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.638027:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718400 00000100:00100000:2.0:1746147186.638036:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718400 00000100:00100000:2.0:1746147186.638079:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11643 00000100:00100000:2.0:1746147186.638086:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1959:x1830967463718400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.638103:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.638121:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac6780 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6822 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.638171:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466397312:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147186.638256:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.639898:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466397312:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147186.639963:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac6780 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6822 expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.639976:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fa8000/0xb4b2209fbdac6780 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6822 expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.639990:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fa8000, rc 0) 00000100:00100000:2.0:1746147186.640044:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1959:x1830967463718400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1957us (2071us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147186.640053:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11643 00000100:00100000:3.0:1746147186.641206:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463718272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10275us (10488us total) trans 21474840630 rc 0/0 00000100:00100000:3.0:1746147186.641215:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1517 00002000:00100000:3.0:1746147186.641225:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3772416->4194303) req@ffff88008e5c9880 x1830967463718272/t21474840630(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.641234:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9880 with x1830967463718272 ext(3772416->4194303) 00010000:00010000:3.0:1746147186.641242:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 41 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.641255:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 41 pid: 21080 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.641261:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9880 00000100:00100000:0.0:1746147186.643072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.643112:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718528 00000100:00100000:2.0:1746147186.643118:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718528 00000100:00100000:2.0:1746147186.643156:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11644 00000100:00100000:2.0:1746147186.643161:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:28864:x1830967463718528:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.643176:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.643190:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6829 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.643213:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.643215:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.643219:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->5242879] (req 4923392->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.643229:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->5242879] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.643238:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63e00, rc 0) 00000100:00100000:2.0:1746147186.643276:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:28864:x1830967463718528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.643281:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11644 00000100:00100000:0.0:1746147186.653252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.653327:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718656 00000100:00100000:2.0:1746147186.653336:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718656 00010000:00010000:2.0:1746147186.653372:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.653415:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5735 00000100:00100000:2.0:1746147186.653422:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463718656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.653436:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.653462:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.653475:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.653497:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea57e00/0xb4b2209fbdac66a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67a4 expref: 42 pid: 21080 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.653530:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.653532:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.653540:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.653548:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.653557:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.653558:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.653561:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.653567:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.653613:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.653626:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466397440:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.653723:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.653731:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466397568:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.653750:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.656520:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466397440:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.656533:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466397568:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.656554:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.656612:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463718656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3190us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.656623:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5735 00000100:00100000:0.0:1746147186.657252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.657318:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463718912 00000100:00100000:3.0:1746147186.657324:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463718912 00002000:00100000:3.0:1746147186.657358:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4923392->4927487) req@ffff8800a47aa300 x1830967463718912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.657367:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47aa300 with x1830967463718912 ext(4923392->4927487) 00002000:00010000:3.0:1746147186.657371:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47aa300 00000100:00100000:3.0:1746147186.657400:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4444 00000100:00100000:3.0:1746147186.657407:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463718912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.657559:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463718912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 151us (308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147186.657564:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4444 00002000:00100000:3.0:1746147186.657569:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (4923392->4927487) req@ffff8800a47aa300 x1830967463718912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.657575:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47aa300 with x1830967463718912 ext(4923392->4927487) 00002000:00010000:3.0:1746147186.657578:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47aa300 00000100:00100000:0.0:1746147186.658301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.658572:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719168 00000100:00100000:3.0:1746147186.658576:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719168 00002000:00100000:3.0:1746147186.658595:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba5ad80 x1830967463719168/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.658611:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5ad80 with x1830967463719168 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.658615:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5ad80 00000100:00100000:3.0:1746147186.658818:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4445 00000100:00100000:3.0:1746147186.658825:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463719168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147186.667582:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463719168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8745us (9270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.667595:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4445 00002000:00100000:3.0:1746147186.667616:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba5ad80 x1830967463719168/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.667626:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5ad80 with x1830967463719168 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.667632:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5ad80 00000100:00100000:0.0:1746147186.673075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.673189:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719296 00000100:00100000:1.0:1746147186.673199:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719296 00000100:00100000:1.0:1746147186.673930:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11645 00000100:00100000:1.0:1746147186.673960:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28869:x1830967463719296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.673980:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.673999:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6830 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.674025:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.674032:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147186.674034:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147186.674036:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.674063:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.674074:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 41 pid: 17548 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.674085:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466397696:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.674188:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.677440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.677557:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719424 00000100:00100000:3.0:1746147186.677563:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719424 00000100:00100000:1.0:1746147186.677577:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466397696:192.168.203.36@tcp:104: 00002000:00100000:3.0:1746147186.677609:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3309567) req@ffff880134d01c00 x1830967463719424/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147186.677618:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147186.677619:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01c00 with x1830967463719424 ext(3145728->3309567) 00010000:00010000:3.0:1746147186.677626:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 42 pid: 17548 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.677634:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ea00, rc 0) 00010000:00010000:3.0:1746147186.677638:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 42 pid: 17548 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.677650:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d01c00 00000100:00100000:3.0:1746147186.677671:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1518 00000100:00100000:1.0:1746147186.677676:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28869:x1830967463719296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3738us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.677677:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463719424:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147186.677683:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11645 00000100:00100000:3.0:1746147186.681138:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463719424:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3452us (3697us total) trans 17179873222 rc 0/0 00000100:00100000:3.0:1746147186.681148:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1518 00002000:00100000:3.0:1746147186.681157:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3309567) req@ffff880134d01c00 x1830967463719424/t17179873222(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.681164:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01c00 with x1830967463719424 ext(3145728->3309567) 00010000:00010000:3.0:1746147186.681173:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.681183:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.681188:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d01c00 00000100:00100000:0.0:1746147186.682862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.684482:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719552 00000100:00100000:3.0:1746147186.684491:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719552 00000100:00100000:3.0:1746147186.684546:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10496 00000100:00100000:3.0:1746147186.684552:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:28873:x1830967463719552:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147186.684572:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.684589:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdac6795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6837 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.684694:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684707:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684717:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684731:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684736:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684741:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684850:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684860:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.684866:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.684896:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.684907:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 17 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.684922:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466397824:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.685049:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147186.685369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.685700:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719680 00000100:00100000:2.0:1746147186.685705:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719680 00010000:00010000:2.0:1746147186.685759:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.685801:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5736 00000100:00100000:2.0:1746147186.685807:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463719680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.685830:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.685863:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.685880:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.685915:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49eca00/0xb4b2209fbdac6702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67d5 expref: 44 pid: 17548 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.687027:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.687030:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.687039:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.687047:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.687073:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.687082:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466397952:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.687203:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466397824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.687351:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147186.687352:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.687413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.687452:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719808 00000100:00100000:2.0:1746147186.687456:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719808 00010000:00010000:2.0:1746147186.687473:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 18 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.687504:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5737 00000100:00100000:2.0:1746147186.687509:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463719808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.687517:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.687522:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 18 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.687535:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 18 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.687548:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f064200/0xb4b2209fbdac675d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6806 expref: 18 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.687558:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147186.687562:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.687568:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.687573:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.687597:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.687638:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463719808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.687647:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5737 00010000:00010000:3.0:1746147186.687758:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687765:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.687804:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147186.687808:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147186.687823:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687832:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687841:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687898:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687905:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687911:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.687916:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687922:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687930:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147186.687933:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.687960:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687966:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487e00/0xb4b2209fbdac679c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.687984:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688086:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688092:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688096:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.688099:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688104:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688111:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13b00) 00010000:00010000:3.0:1746147186.688113:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.688115:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688124:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0xb4b2209fbdac67a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.688154:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f065000/0xb4b2209fbdac6795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.688165:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.688172:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.688173:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147186.688179:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:3.0:1746147186.688214:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28873:x1830967463719552:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3661us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.688221:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10496 00000100:00100000:2.0:1746147186.690216:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466397952:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.690233:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.690277:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463719680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4469us (4908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.690286:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5736 00000100:00100000:1.0:1746147186.690486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.690709:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463719936 00000100:00100000:0.0:1746147186.690715:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463719936 00000100:00100000:2.0:1746147186.690760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.690776:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463720064 00000100:00100000:0.0:1746147186.690778:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463720064 00000100:00100000:0.0:1746147186.690793:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11646 00000100:00100000:0.0:1746147186.690798:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463719936:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147186.690800:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11647 00000100:00100000:2.0:1746147186.690806:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463720064:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147186.690822:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.690822:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.690837:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6845 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.690838:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e683e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.690869:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.690870:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.690877:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.690879:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.690879:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.690883:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.690892:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.690894:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.690903:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9b3200, rc 0) 00010000:00010000:0.0:1746147186.690906:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e756600, rc 0) 00000100:00100000:2.0:1746147186.690964:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463720064:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 158us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.690969:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11647 00000100:00100000:0.0:1746147186.691261:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463719936:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 460us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.691282:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11646 00000100:00100000:0.0:1746147186.693690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.694279:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463720320 00000100:00100000:3.0:1746147186.694286:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463720320 00000100:00100000:3.0:1746147186.694324:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10497 00000100:00100000:3.0:1746147186.694331:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28873:x1830967463720320:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147186.694350:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.694367:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac67bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e684c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.694468:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.694483:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.694495:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.694525:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.694537:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 10 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.694549:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466398080:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.694643:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.695266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.695291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.695324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.695388:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463720832 00000100:00100000:3.0:1746147186.695393:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463720832 00002000:00100000:3.0:1746147186.695423:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880099f6ad80 x1830967463720832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.695433:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967463720832 ext(3145728->4194303) 00002000:00010000:3.0:1746147186.695437:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6ad80 00000100:00100000:3.0:1746147186.695455:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721088 00000100:00100000:3.0:1746147186.695458:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721088 00002000:00100000:3.0:1746147186.695472:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f68000 x1830967463721088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.695479:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967463721088 ext(3145728->4194303) 00002000:00010000:3.0:1746147186.695482:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:3.0:1746147186.695492:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463720576 00000100:00100000:3.0:1746147186.695494:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463720576 00002000:00100000:3.0:1746147186.695502:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880099f69880 x1830967463720576/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.695508:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463720576 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.695510:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:3.0:1746147186.695521:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4446 00000100:00100000:3.0:1746147186.695526:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463720832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147186.695664:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4447 00000100:00100000:1.0:1746147186.695673:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463721088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.695763:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4448 00000100:00100000:0.0:1746147186.695769:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463720576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.696533:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466398080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.696552:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147186.697725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.697779:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721216 00000100:00100000:3.0:1746147186.697785:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721216 00010000:00010000:3.0:1746147186.697810:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 11 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.697831:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5738 00000100:00100000:3.0:1746147186.697837:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463721216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.697849:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.697854:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 11 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.697864:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 11 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.697883:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0xb4b2209fbdac67aa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6837 expref: 11 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.697897:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.697901:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.697910:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.697917:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.697934:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.697977:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463721216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.697984:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5738 00010000:00010000:3.0:1746147186.698002:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.698007:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.698026:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.698160:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55e00/0xb4b2209fbdac67bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e684c expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.698171:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e684c expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.698176:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.698178:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147186.698180:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54000, rc 0) 00000100:00100000:3.0:1746147186.698198:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28873:x1830967463720320:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3869us (4518us total) trans 8589944240 rc 0/0 00000100:00100000:3.0:1746147186.698204:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10497 00000100:00100000:3.0:1746147186.710055:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463720832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14513us (14775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147186.710073:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4446 00002000:00100000:3.0:1746147186.710192:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880099f6ad80 x1830967463720832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.710203:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6ad80 with x1830967463720832 ext(3145728->4194303) 00002000:00010000:3.0:1746147186.710209:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f6ad80 00000100:00100000:2.0:1746147186.714795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.715734:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463720576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19963us (20407us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147186.715747:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4448 00000100:00100000:0.0:1746147186.715749:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463721088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20076us (20454us total) trans 0 rc 1048576/1048576 00002000:00100000:1.0:1746147186.715757:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880099f69880 x1830967463720576/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147186.715758:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4447 00002000:00100000:0.0:1746147186.715765:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f68000 x1830967463721088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.715766:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463720576 ext(2097152->3145727) 00002000:00010000:1.0:1746147186.715772:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69880 00002000:00100000:0.0:1746147186.715773:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967463721088 ext(3145728->4194303) 00002000:00010000:0.0:1746147186.715777:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:3.0:1746147186.716321:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721472 00000100:00100000:3.0:1746147186.716328:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721472 00000100:00100000:3.0:1746147186.716361:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10498 00000100:00100000:3.0:1746147186.716367:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28873:x1830967463721472:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147186.716387:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.716390:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147186.716414:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac67c6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e684c expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.716444:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.716449:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147186.716463:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac67d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6853 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.716561:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716573:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716582:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716597:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716612:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716617:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716622:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a809a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.716626:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716632:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716639:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.716641:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147186.716644:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716649:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a809a00/0xb4b2209fbdac67db lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.716669:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac67d4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6853 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.716676:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dac4a00/0xb4b2209fbdac67d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6853 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.716683:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dac4a00, rc 0) 00000100:00100000:3.0:1746147186.716817:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28873:x1830967463721472:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 448us (2030us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.717428:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10498 00000100:00100000:0.0:1746147186.719755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.719805:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721728 00000100:00100000:1.0:1746147186.719812:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721728 00002000:00100000:1.0:1746147186.719855:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008f818e00 x1830967463721728/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.720017:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818e00 with x1830967463721728 ext(4194304->4927487) 00002000:00010000:1.0:1746147186.720025:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818e00 00000100:00100000:1.0:1746147186.720052:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4449 00000100:00100000:1.0:1746147186.720059:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463721728:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.722590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.722628:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721856 00000100:00100000:0.0:1746147186.722634:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721856 00000100:00100000:0.0:1746147186.722678:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11648 00000100:00100000:0.0:1746147186.722685:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28867:x1830967463721856:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147186.722703:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.722721:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e685a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.722748:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.722757:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.722763:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.722765:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.722768:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.722799:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.722815:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 13 pid: 21080 timeout: 673 lvb_type: 1 00000100:00100000:0.0:1746147186.722827:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f81aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466398208:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147186.722896:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.722903:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 673 lvb_type: 0 00000100:00100000:0.0:1746147186.722911:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466398336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147186.722929:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.726492:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f81aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466398208:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.726505:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466398336:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147186.726537:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.726555:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9ba000, rc 0) 00000100:00100000:1.0:1746147186.726612:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28867:x1830967463721856:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3915us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.726620:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11648 00000100:00100000:0.0:1746147186.726978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.727016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.727028:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463721984 00000100:00100000:2.0:1746147186.727035:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463721984 00010000:00010000:2.0:1746147186.727074:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 673 lvb_type: 1 00000100:00100000:2.0:1746147186.727095:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5739 00000100:00100000:2.0:1746147186.727101:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463721984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.727114:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.727135:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:2.0:1746147186.727144:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:2.0:1746147186.727165:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9b3200/0xb4b2209fbdac67b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6845 expref: 14 pid: 21080 timeout: 673 lvb_type: 1 00010000:00010000:2.0:1746147186.727183:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.727203:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463721984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.727208:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5739 00000100:00100000:3.0:1746147186.727278:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463722240 00000100:00100000:3.0:1746147186.727282:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463722240 00000100:00100000:3.0:1746147186.727307:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4156 00000100:00100000:3.0:1746147186.727312:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:28873:x1830967463722240:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147186.727486:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:28873:x1830967463722240:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 172us (468us total) trans 8589944241 rc 0/0 00000100:00100000:3.0:1746147186.727492:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4156 00000100:00100000:1.0:1746147186.728721:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463721728:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8658us (8969us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746147186.728731:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4449 00002000:00100000:1.0:1746147186.728739:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008f818e00 x1830967463721728/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 733184/733184 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.728748:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818e00 with x1830967463721728 ext(4194304->4927487) 00002000:00010000:1.0:1746147186.728753:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818e00 00000100:00100000:0.0:1746147186.736867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.736931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.737096:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463722496 00000100:00100000:1.0:1746147186.737104:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463722496 00000100:00100000:1.0:1746147186.737160:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11649 00000100:00100000:1.0:1746147186.737167:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463722496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.737185:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.737205:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5f800/0xb4b2209fbdac67e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6861 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.737227:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147186.737239:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5f800/0xb4b2209fbdac67e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6861 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.737249:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5f800/0xb4b2209fbdac67e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6861 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.737263:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5f800, rc 0) 00000100:00100000:1.0:1746147186.737302:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463722496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 137us (371us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.737307:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11649 00000100:00100000:2.0:1746147186.737627:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463722368 00000100:00100000:2.0:1746147186.737632:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463722368 00010000:00010000:2.0:1746147186.737650:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.737679:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5740 00000100:00100000:2.0:1746147186.737685:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463722368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.737694:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.737714:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.737725:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.737741:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ea00/0xb4b2209fbdac678e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6830 expref: 30 pid: 8481 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.737762:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.737764:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.737771:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.737779:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.737806:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.737817:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466398464:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147186.737873:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.740062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.740149:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466398464:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.740168:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.740206:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463722368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2520us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.740216:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5740 00000100:00100000:1.0:1746147186.740310:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463722752 00000100:00100000:1.0:1746147186.740316:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463722752 00002000:00100000:1.0:1746147186.740350:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3133440->3137535) req@ffff88009f7cca80 x1830967463722752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.740360:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cca80 with x1830967463722752 ext(3133440->3137535) 00002000:00010000:1.0:1746147186.740364:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cca80 00000100:00100000:1.0:1746147186.740379:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4450 00000100:00100000:1.0:1746147186.740385:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463722752:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147186.740528:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463722752:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 143us (475us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147186.740534:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4450 00002000:00100000:1.0:1746147186.740538:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3133440->3137535) req@ffff88009f7cca80 x1830967463722752/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.740547:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cca80 with x1830967463722752 ext(3133440->3137535) 00002000:00010000:1.0:1746147186.740549:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cca80 00000100:00100000:0.0:1746147186.745684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.745773:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463722880 00000100:00100000:3.0:1746147186.745782:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463722880 00000100:00100000:3.0:1746147186.745874:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11650 00000100:00100000:3.0:1746147186.745882:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28867:x1830967463722880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147186.745912:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.745975:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6868 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746017:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746035:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.746042:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746066:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.746069:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.746073:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->3985407] (req 3145728->3985407) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746117:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746130:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 40 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.746152:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398592:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.746267:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.746276:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 15 pid: 8481 timeout: 673 lvb_type: 1 00000100:00100000:3.0:1746147186.746298:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398720:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.746332:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.746340:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.746371:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.746387:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.749127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.749140:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398592:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.749151:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398720:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.749158:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466398848:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.749194:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->3985407] (req 3145728->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.749209:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e217000, rc 0) 00000100:00100000:3.0:1746147186.749255:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28867:x1830967463722880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3373us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.749262:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11650 00000100:00100000:0.0:1746147186.750344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.750364:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463723008 00000100:00100000:0.0:1746147186.750370:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463723008 00010000:00010000:0.0:1746147186.750393:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:0.0:1746147186.750429:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463723136 00000100:00100000:0.0:1746147186.750431:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463723136 00010000:00010000:0.0:1746147186.750441:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 673 lvb_type: 1 00000100:00100000:0.0:1746147186.750456:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5741 00000100:00100000:0.0:1746147186.750461:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463723008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.750472:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.750494:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.750504:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.750525:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bb63e00/0xb4b2209fbdac6787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6829 expref: 41 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.750557:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.750578:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463723008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.750584:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5741 00000100:00100000:3.0:1746147186.750589:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5742 00000100:00100000:3.0:1746147186.750594:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463723136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.750612:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147186.750621:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.750628:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.750638:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e756600/0xb4b2209fbdac67b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e683e expref: 16 pid: 8481 timeout: 673 lvb_type: 1 00010000:00010000:3.0:1746147186.750651:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.750666:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463723136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.750671:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5742 00000100:00100000:0.0:1746147186.754823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.754889:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463723520 00000100:00100000:3.0:1746147186.754899:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463723520 00000100:00100000:3.0:1746147186.756298:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4157 00000100:00100000:3.0:1746147186.756313:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28869:x1830967463723520:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147186.756592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.756891:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463723264 00000100:00100000:2.0:1746147186.756896:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463723264 00010000:00010000:2.0:1746147186.756920:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.756971:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5743 00000100:00100000:2.0:1746147186.756977:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463723264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147186.756987:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147186.757005:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.757015:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.757035:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092910200/0xb4b2209fbdac6779 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e681b expref: 27 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.757058:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.757060:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147186.757067:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.757074:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.757100:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.757111:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466398976:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.757401:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28869:x1830967463723520:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1094us (2583us total) trans 8589944242 rc 0/0 00000100:00100000:3.0:1746147186.757408:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4157 00000100:00100000:2.0:1746147186.757878:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.760026:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466398976:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147186.760045:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147186.760138:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463723264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3159us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.760147:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5743 00000100:00100000:1.0:1746147186.767052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.767383:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463723776 00000100:00100000:2.0:1746147186.767391:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463723776 00002000:00100000:2.0:1746147186.767433:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3981312->3985407) req@ffff88009b20bb80 x1830967463723776/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.767696:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967463723776 ext(3981312->3985407) 00002000:00010000:2.0:1746147186.767704:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20bb80 00000100:00100000:2.0:1746147186.767733:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4451 00000100:00100000:2.0:1746147186.767740:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463723776:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.767930:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463723776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 190us (887us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147186.767958:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4451 00002000:00100000:2.0:1746147186.767965:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3981312->3985407) req@ffff88009b20bb80 x1830967463723776/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.767972:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967463723776 ext(3981312->3985407) 00002000:00010000:2.0:1746147186.767974:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20bb80 00000100:00100000:0.0:1746147186.771557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.771993:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724032 00000100:00100000:3.0:1746147186.772003:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724032 00000100:00100000:3.0:1746147186.772057:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4158 00000100:00100000:3.0:1746147186.772065:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28867:x1830967463724032:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147186.772299:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28867:x1830967463724032:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 234us (752us total) trans 8589944243 rc 0/0 00000100:00100000:3.0:1746147186.772305:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4158 00000100:00100000:0.0:1746147186.800120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.800643:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724288 00000100:00100000:3.0:1746147186.800652:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724288 00000100:00100000:3.0:1746147186.800710:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10499 00000100:00100000:3.0:1746147186.800718:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:28879:x1830967463724288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147186.800744:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.800765:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac67f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e686f expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.801399:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801413:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801424:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801436:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801441:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801445:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801546:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801553:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801559:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.801568:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.801663:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801669:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801678:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801684:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.801687:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801694:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801704:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147186.801707:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.801710:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.801715:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217800/0xb4b2209fbdac67fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802218:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802223:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802228:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802231:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.802233:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802237:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802247:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13300) 00010000:00010000:3.0:1746147186.802249:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.802251:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802255:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217c00/0xb4b2209fbdac6805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.802291:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac67f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.802302:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 314 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.802308:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.802310:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147186.802312:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e217e00, rc 0) 00000100:00100000:3.0:1746147186.807482:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:28879:x1830967463724288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6750us (7356us total) trans 8589944244 rc 0/0 00000100:00100000:3.0:1746147186.807496:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10499 00010000:00010000:2.0:1746147186.825471:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147186.892471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.892547:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724544 00000100:00100000:3.0:1746147186.892558:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724544 00000100:00100000:3.0:1746147186.892643:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10500 00000100:00100000:3.0:1746147186.892652:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28886:x1830967463724544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.892678:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.892698:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac681a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6876 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.892818:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.892832:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.892842:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.892856:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.892861:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.892867:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893007:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893016:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893022:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.893031:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.893111:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893118:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893126:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893131:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e216000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.893135:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893141:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893151:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147186.893154:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.893157:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893162:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac6821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893193:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893198:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893203:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893206:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.893208:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893212:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893222:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13100) 00010000:00010000:3.0:1746147186.893224:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.893226:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893229:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac6828 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.893261:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac681a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.893272:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.893283:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.893285:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147186.893287:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e216200, rc 0) 00000100:00100000:3.0:1746147186.893332:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28886:x1830967463724544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 681us (869us total) trans 8589944245 rc 0/0 00000100:00100000:3.0:1746147186.893338:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10500 00000100:00100000:1.0:1746147186.893724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.894519:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724672 00000100:00100000:3.0:1746147186.894526:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724672 00000100:00100000:3.0:1746147186.894560:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11651 00000100:00100000:3.0:1746147186.894567:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:28879:x1830967463724672:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147186.894582:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.894595:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e687d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.894637:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.894648:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.894650:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147186.894653:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3485696->4071423] (req 3485696->4071423) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.894683:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 25 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.894695:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 25 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.894707:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466399104:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147186.894798:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.905094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.905186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.905382:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466399104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.905383:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724928 00000100:00100000:1.0:1746147186.905389:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724928 00010000:00010000:3.0:1746147186.905410:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3485696->4071423] (req 3485696->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 41 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.905426:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11652 00010000:00010000:3.0:1746147186.905427:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e217800, rc 0) 00000100:00100000:1.0:1746147186.905432:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463724928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.905448:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.905462:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5ea00/0xb4b2209fbdac6844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6884 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.905466:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:28879:x1830967463724672:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10900us (11743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.905472:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11651 00000100:00100000:1.0:1746147186.905504:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466399232:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147186.905562:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.905612:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463724800 00000100:00100000:2.0:1746147186.905625:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463724800 00002000:00100000:2.0:1746147186.905668:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3985407) req@ffff88008e5c8700 x1830967463724800/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.905687:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967463724800 ext(3145728->3985407) 00010000:00010000:2.0:1746147186.905695:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:2.0:1746147186.905712:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00002000:00010000:2.0:1746147186.905719:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8700 00000100:00100000:2.0:1746147186.905915:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1519 00000100:00100000:2.0:1746147186.905923:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463724800:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147186.909781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.910100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.910128:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725184 00000100:00100000:3.0:1746147186.910136:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725184 00000100:00100000:3.0:1746147186.910187:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11653 00000100:00100000:3.0:1746147186.910195:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463725184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147186.910213:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.910227:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e217600/0xb4b2209fbdac684b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6892 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.910272:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466399360:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.910339:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.910666:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725056 00000100:00100000:2.0:1746147186.910670:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725056 00000100:00100000:2.0:1746147186.910690:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11654 00000100:00100000:2.0:1746147186.910696:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463725056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.910702:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.910712:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6852 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e688b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.910737:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466399488:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147186.910766:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.910876:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466399232:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147186.910898:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5ea00/0xb4b2209fbdac6844 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6884 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.910908:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5ea00/0xb4b2209fbdac6844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6884 expref: 29 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147186.910920:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ea00, rc 0) 00000100:00100000:1.0:1746147186.910961:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463724928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5528us (5774us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147186.910967:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11652 00000100:00100000:3.0:1746147186.928308:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463724800:12345-192.168.203.36@tcp:4:cat.0 Request processed in 22378us (23215us total) trans 21474840631 rc 0/0 00000100:00100000:3.0:1746147186.928319:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1519 00002000:00100000:3.0:1746147186.928331:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3985407) req@ffff88008e5c8700 x1830967463724800/t21474840631(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.928339:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967463724800 ext(3145728->3985407) 00010000:00010000:3.0:1746147186.928347:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.928359:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.928365:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c8700 00000100:00100000:3.0:1746147186.928420:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466399360:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147186.928688:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e217600/0xb4b2209fbdac684b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6892 expref: 44 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147186.928705:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e217600/0xb4b2209fbdac684b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6892 expref: 44 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147186.928716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147186.928725:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e217600, rc 0) 00000100:00100000:3.0:1746147186.928746:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463725184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 18552us (18973us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147186.928751:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11653 00000100:00100000:2.0:1746147186.928789:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466399488:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.928805:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725440 00010000:00010000:2.0:1746147186.928815:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6852 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e688b expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.928832:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea56a00/0xb4b2209fbdac6852 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e688b expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147186.928845:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea56a00, rc 0) 00000100:00100000:2.0:1746147186.928873:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463725056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 18178us (18773us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147186.928879:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11654 00000100:00100000:3.0:1746147186.928910:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725440 00000100:00100000:2.0:1746147186.929031:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10501 00000100:00100000:2.0:1746147186.929040:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28888:x1830967463725440:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147186.929118:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.929131:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092910200/0xb4b2209fbdac6859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6899 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.929200:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.929212:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 313 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.929219:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.929225:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147186.929251:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.929264:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.929273:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466399616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.930157:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 313 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.930166:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 313 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.930175:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466399744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.930210:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.935771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.936213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.936267:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725696 00000100:00100000:3.0:1746147186.936277:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725696 00010000:00010000:3.0:1746147186.936307:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:3.0:1746147186.936331:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5744 00000100:00100000:3.0:1746147186.936336:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463725696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147186.936347:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147186.936457:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725568 00000100:00100000:2.0:1746147186.936461:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725568 00000100:00100000:2.0:1746147186.936482:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11655 00000100:00100000:2.0:1746147186.936487:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28886:x1830967463725568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.936499:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.936509:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68a0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.936526:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.936529:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.936532:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.936542:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.936550:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4200, rc 0) 00000100:00100000:2.0:1746147186.936646:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28886:x1830967463725568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 157us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147186.936652:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11655 00010000:00010000:3.0:1746147186.936910:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 28 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.936922:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 29 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.936952:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e217000/0xb4b2209fbdac67f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3985407) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6868 expref: 29 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.936975:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.936976:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.936982:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.936989:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.936994:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.936995:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.936998:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.937003:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.937026:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.937039:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466399872:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147186.937448:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.937457:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466400000:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.937484:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.939401:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466399616:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.939410:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466399744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147186.939428:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147186.939759:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466399872:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147186.943259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.943397:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463725952 00000100:00100000:3.0:1746147186.943407:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463725952 00002000:00100000:3.0:1746147186.943448:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012d49b100 x1830967463725952/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.943457:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967463725952 ext(2097152->3145727) 00002000:00010000:3.0:1746147186.943462:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:3.0:1746147186.943496:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4452 00000100:00100000:3.0:1746147186.943504:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463725952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.945468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.945708:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726208 00000100:00100000:1.0:1746147186.945717:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726208 00002000:00100000:1.0:1746147186.945753:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3133439) req@ffff88009a80d180 x1830967463726208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.945761:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d180 with x1830967463726208 ext(2097152->3133439) 00002000:00010000:1.0:1746147186.945766:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80d180 00000100:00100000:1.0:1746147186.945799:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4453 00000100:00100000:1.0:1746147186.945807:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463726208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147186.957679:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.957847:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466400000:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147186.957859:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726592 00000100:00100000:3.0:1746147186.957866:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726592 00010000:00010000:2.0:1746147186.957868:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.957902:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10502 00000100:00100000:2.0:1746147186.957903:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463725696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 21566us (21690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.957909:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:28889:x1830967463726592:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147186.957910:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5744 00010000:00010000:3.0:1746147186.958489:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.958504:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac686e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68a7 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.958547:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958555:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958563:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958571:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958579:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958583:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958687:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958694:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.958698:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.958710:0:14048:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.958715:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147186.962312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.962343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.962366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.962391:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726336 00000100:00100000:0.0:1746147186.962391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.962400:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726336 00000100:00100000:3.0:1746147186.962417:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726848 00000100:00100000:3.0:1746147186.962422:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726848 00010000:00010000:1.0:1746147186.962436:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 23 pid: 14049 timeout: 673 lvb_type: 0 00002000:00100000:3.0:1746147186.962447:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3485696->3489791) req@ffff8800b52e0000 x1830967463726848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.962456:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0000 with x1830967463726848 ext(3485696->3489791) 00002000:00010000:3.0:1746147186.962460:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0000 00000100:00100000:0.0:1746147186.962471:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726464 00000100:00100000:3.0:1746147186.962473:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4454 00000100:00100000:0.0:1746147186.962474:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726464 00000100:00100000:3.0:1746147186.962479:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463726848:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:0.0:1746147186.962489:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 314 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:0.0:1746147186.962506:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5745 00000100:00100000:0.0:1746147186.962511:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463726336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.962524:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.962529:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 23 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.962539:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 23 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.962555:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216200/0xb4b2209fbdac682f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6876 expref: 23 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.962571:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147186.962576:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.962584:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147186.962588:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147186.962592:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463726848:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 114us (225us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746147186.962592:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147186.962597:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.962608:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4454 00002000:00100000:3.0:1746147186.962613:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3485696->3489791) req@ffff8800b52e0000 x1830967463726848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.962620:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0000 with x1830967463726848 ext(3485696->3489791) 00002000:00010000:3.0:1746147186.962623:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e0000 00000100:00100000:0.0:1746147186.962639:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463726336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.962645:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5745 00000100:00100000:3.0:1746147186.962646:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463726976 00000100:00100000:3.0:1746147186.962648:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463726976 00000100:00100000:0.0:1746147186.962657:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5746 00000100:00100000:3.0:1746147186.962662:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11656 00000100:00100000:0.0:1746147186.962662:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+314:1957:x1830967463726464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147186.962666:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:28883:x1830967463726976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147186.962668:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.962672:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 314 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.962673:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.962678:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 314 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.962683:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68ae expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.962688:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217e00/0xb4b2209fbdac680c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e686f expref: 314 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:0.0:1746147186.962696:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.962699:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.962699:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.962701:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147186.962707:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.962711:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147186.962717:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.962719:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 42 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.962722:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.962726:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17c400, rc 0) 00010000:00010000:0.0:1746147186.962726:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147186.962730:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147186.962740:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:28883:x1830967463726976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (348us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147186.962743:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147186.962756:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11656 00000100:00100000:0.0:1746147186.962756:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1957:x1830967463726464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 94us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.962760:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5746 00010000:00010000:3.0:1746147186.962773:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147186.962780:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147186.962794:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147186.962886:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092910200/0xb4b2209fbdac6859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.962909:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.962916:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.962921:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e20000, rc 0) 00000100:00100000:3.0:1746147186.962956:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28888:x1830967463725440:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 33917us (34246us total) trans 8589944246 rc 0/0 00000100:00100000:3.0:1746147186.962961:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10501 00000100:00100000:1.0:1746147186.965130:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463726208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19318us (19660us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746147186.965141:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4453 00002000:00100000:1.0:1746147186.965537:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3133439) req@ffff88009a80d180 x1830967463726208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147186.965547:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d180 with x1830967463726208 ext(2097152->3133439) 00002000:00010000:1.0:1746147186.965552:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80d180 00000100:00100000:0.0:1746147186.968134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.968172:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463727232 00000100:00100000:2.0:1746147186.968180:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463727232 00002000:00100000:2.0:1746147186.968215:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800b52e3800 x1830967463727232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.968224:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967463727232 ext(2097152->3145727) 00002000:00010000:2.0:1746147186.968228:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e3800 00000100:00100000:2.0:1746147186.968260:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4455 00000100:00100000:2.0:1746147186.968267:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463727232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147186.969247:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463725952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25112us (25364us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147186.969256:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4452 00002000:00100000:0.0:1746147186.969263:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012d49b100 x1830967463725952/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.969274:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b100 with x1830967463725952 ext(2097152->3145727) 00002000:00010000:0.0:1746147186.969278:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d49b100 00000100:00100000:0.0:1746147186.976974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.977548:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463727616 00000100:00100000:2.0:1746147186.977559:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463727616 00002000:00100000:2.0:1746147186.977596:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4067328->4071423) req@ffff8800b52e2d80 x1830967463727616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.977614:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967463727616 ext(4067328->4071423) 00002000:00010000:2.0:1746147186.977619:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2d80 00000100:00100000:2.0:1746147186.977651:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4456 00000100:00100000:2.0:1746147186.977658:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463727616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147186.977792:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463727616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 134us (861us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147186.977799:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4456 00002000:00100000:2.0:1746147186.977804:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4067328->4071423) req@ffff8800b52e2d80 x1830967463727616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.977810:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967463727616 ext(4067328->4071423) 00002000:00010000:2.0:1746147186.977813:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2d80 00000100:00100000:0.0:1746147186.978055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147186.979412:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463727488 00000100:00100000:1.0:1746147186.979421:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463727488 00010000:00010000:1.0:1746147186.979447:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00000100:00100000:1.0:1746147186.979497:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5747 00000100:00100000:1.0:1746147186.979504:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463727488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147186.979515:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147186.979520:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.979530:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.979547:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e20000/0xb4b2209fbdac6860 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6899 expref: 22 pid: 14049 timeout: 673 lvb_type: 0 00010000:00010000:1.0:1746147186.979823:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147186.979828:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147186.979836:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147186.979842:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147186.979871:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147186.979895:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.979902:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147186.979906:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463727488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 401us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147186.979912:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5747 00000004:00200000:3.0:1746147186.979952:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147186.979955:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147186.979968:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.979976:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.979987:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.979991:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.979996:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980000:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d55800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.980003:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980009:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980016:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147186.980019:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.980022:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980026:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d55800/0xb4b2209fbdac6875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980149:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980155:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980159:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980163:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d54200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147186.980166:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980336:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980343:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13300) 00010000:00010000:3.0:1746147186.980345:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147186.980347:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980351:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54200/0xb4b2209fbdac687c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147186.980379:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54000/0xb4b2209fbdac686e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.980388:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 11 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.980394:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147186.980396:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147186.980397:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54e00, rc 0) 00000100:00100000:0.0:1746147186.980422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.980435:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:28889:x1830967463726592:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 22526us (22762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.980440:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10502 00000100:00100000:2.0:1746147186.980531:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463727744 00000100:00100000:2.0:1746147186.980535:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463727744 00000100:00100000:2.0:1746147186.980556:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11657 00000100:00100000:2.0:1746147186.980561:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28886:x1830967463727744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147186.980572:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.980581:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68b5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.980610:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.980653:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.980655:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147186.980658:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.980682:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147186.980692:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 43 pid: 6881 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.980704:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466400128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147186.980879:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.984024:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463727232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15749us (15889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147186.984033:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4455 00002000:00100000:2.0:1746147186.984043:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800b52e3800 x1830967463727232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147186.984052:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967463727232 ext(2097152->3145727) 00002000:00010000:2.0:1746147186.984056:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e3800 00000100:00100000:3.0:1746147186.985609:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466400128:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147186.985635:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147186.985655:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5600, rc 0) 00000100:00100000:3.0:1746147186.985688:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28886:x1830967463727744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5126us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147186.985694:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11657 00000100:00100000:0.0:1746147186.988563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147186.988613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.988670:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728128 00000100:00100000:2.0:1746147186.988678:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728128 00000100:00100000:3.0:1746147186.988689:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728256 00000100:00100000:3.0:1746147186.988695:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728256 00000100:00100000:2.0:1746147186.988712:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4159 00000100:00100000:2.0:1746147186.988718:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+313:28879:x1830967463728128:12345-192.168.203.36@tcp:35:multiop.0 00002000:00100000:3.0:1746147186.988724:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3485696->4071423) req@ffff8800b52e0380 x1830967463728256/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147186.988731:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967463728256 ext(3485696->4071423) 00010000:00010000:3.0:1746147186.988739:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 42 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147186.988751:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 42 pid: 6881 timeout: 673 lvb_type: 0 00002000:00010000:3.0:1746147186.988757:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0380 00000100:00100000:3.0:1746147186.988774:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1520 00000100:00100000:3.0:1746147186.988779:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463728256:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147186.988875:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+314:28879:x1830967463728128:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 156us (317us total) trans 8589944247 rc 0/0 00000100:00100000:2.0:1746147186.988881:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4159 00000100:00100000:2.0:1746147186.993566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.993586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147186.993613:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728384 00000100:00100000:2.0:1746147186.993622:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728384 00000100:00100000:2.0:1746147186.993653:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728512 00000100:00100000:2.0:1746147186.993654:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728512 00000100:00100000:2.0:1746147186.993677:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11658 00000100:00100000:2.0:1746147186.993683:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463728384:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147186.993697:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147186.993710:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac689f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68bc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147186.993711:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11659 00000100:00100000:1.0:1746147186.993719:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:28883:x1830967463728512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147186.993727:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147186.993738:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68c3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147186.993753:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466400256:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147186.993755:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.993761:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147186.993763:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147186.993766:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 44 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.993785:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147186.993794:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 28 pid: 8481 timeout: 673 lvb_type: 0 00000100:00100000:2.0:1746147186.993802:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147186.993802:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466400384:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147186.993830:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093455d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147186.994557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147186.995403:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728640 00000100:00100000:3.0:1746147186.995410:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728640 00000100:00100000:3.0:1746147186.995437:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11660 00000100:00100000:3.0:1746147186.995443:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463728640:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147186.995454:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147186.995463:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68ca expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147186.995493:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466400512:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147186.996028:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147187.002230:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466400256:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147187.002258:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac689f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68bc expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.002271:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0xb4b2209fbdac689f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68bc expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.002284:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5a00, rc 0) 00000100:00100000:2.0:1746147187.002323:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463728384:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8639us (8765us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147187.002330:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11658 00000100:00100000:2.0:1746147187.002991:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466400384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.003010:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 44 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.003021:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5e400, rc 0) 00000100:00100000:2.0:1746147187.003038:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28883:x1830967463728512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9320us (9451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.003044:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11659 00000100:00100000:3.0:1746147187.007310:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466400512:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.007336:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ca expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.007362:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ca expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.007376:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20600, rc 0) 00000100:00100000:3.0:1746147187.007418:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463728640:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 11974us (12861us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.007425:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11660 00000100:00100000:2.0:1746147187.011364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.017704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.021615:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729024 00000100:00100000:3.0:1746147187.021626:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729024 00000100:00100000:3.0:1746147187.021813:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10503 00000100:00100000:3.0:1746147187.021823:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:28889:x1830967463729024:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147187.021840:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.021853:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcffe00/0xb4b2209fbdac68b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68d1 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.021925:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.021951:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.021958:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.021984:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.021993:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 12 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.022002:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466400640:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.022077:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381e480 going to sleep for 11 seconds 00000100:00080000:0.0:1746147187.023532:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147187.025528:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463728768 00000100:00100000:3.0:1746147187.025540:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463728768 00002000:00100000:3.0:1746147187.025587:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3133440->3145727) req@ffff88008daad500 x1830967463728768/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 12776/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.025594:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad500 with x1830967463728768 ext(3133440->3145727) 00010000:00010000:3.0:1746147187.025613:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 29 pid: 8481 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147187.025624:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 29 pid: 8481 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.025630:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008daad500 00000100:00100000:3.0:1746147187.025655:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1521 00000100:00100000:3.0:1746147187.025662:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463728768:12345-192.168.203.36@tcp:4:cat.0 00000100:00080000:1.0:1746147187.025780:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147187.025975:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463728768:12345-192.168.203.36@tcp:4:cat.0 Request processed in 313us (14618us total) trans 17179873223 rc 0/0 00000100:00100000:3.0:1746147187.025982:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1521 00002000:00100000:3.0:1746147187.025987:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3133440->3145727) req@ffff88008daad500 x1830967463728768/t17179873223(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 12776/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.025993:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad500 with x1830967463728768 ext(3133440->3145727) 00010000:00010000:3.0:1746147187.025998:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.026005:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.026010:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008daad500 00000100:00100000:0.0:1746147187.026654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.027054:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729152 00000100:00100000:3.0:1746147187.027059:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729152 00000100:00100000:3.0:1746147187.027086:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11661 00000100:00100000:3.0:1746147187.027101:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28888:x1830967463729152:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147187.027111:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.027123:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68d8 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.027141:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.027146:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.027151:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147187.027154:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->3764223] (req 3272704->3764223) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.027188:0:17548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.027204:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->3764223] (req 3272704->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.027212:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64e0000, rc 0) 00000100:00100000:3.0:1746147187.027245:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28888:x1830967463729152:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 153us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.027251:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11661 00000100:00080000:3.0:1746147187.027309:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147187.029353:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466400640:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.029370:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147187.029433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.030007:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729280 00000100:00100000:0.0:1746147187.030014:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729280 00010000:00010000:0.0:1746147187.030038:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 13 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.030059:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5748 00000100:00100000:0.0:1746147187.030068:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463729280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.030080:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.030085:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 13 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.030093:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 13 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.030111:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d54e00/0xb4b2209fbdac6883 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a7 expref: 13 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.030125:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.030128:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.030136:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.030142:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.030154:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.030184:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463729280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.030189:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5748 00010000:00010000:0.0:1746147187.030230:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.030236:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147187.030249:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147187.030347:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcffe00/0xb4b2209fbdac68b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d1 expref: 13 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.030358:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d1 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.030364:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.030366:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147187.030368:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f20600, rc 0) 00000100:00100000:0.0:1746147187.030390:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:28889:x1830967463729024:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8569us (12692us total) trans 8589944248 rc 0/0 00000100:00100000:0.0:1746147187.030395:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10503 00000100:00100000:1.0:1746147187.033203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.033260:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729408 00000100:00100000:2.0:1746147187.033269:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729408 00010000:00010000:2.0:1746147187.033294:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.033317:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5749 00000100:00100000:2.0:1746147187.033324:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463729408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.033337:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.033354:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.033364:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.033388:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9ba000/0xb4b2209fbdac67e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e685a expref: 31 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.033408:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.033409:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.033415:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.033422:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.033449:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.033459:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466400896:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147187.035330:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.036010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.036031:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729664 00000100:00100000:0.0:1746147187.036038:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729664 00000100:00100000:0.0:1746147187.036071:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10504 00000100:00100000:0.0:1746147187.036077:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:28889:x1830967463729664:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147187.036095:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.036098:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147187.036115:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f20600/0xb4b2209fbdac68bb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d1 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.036128:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.036131:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147187.036140:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88400/0xb4b2209fbdac68d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68df expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.036206:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036215:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036222:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036231:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036236:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036241:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036245:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb89a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147187.036248:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036257:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036262:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.036265:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147187.036267:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036271:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb89a00/0xb4b2209fbdac68d7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.036289:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88400/0xb4b2209fbdac68d0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68df expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.036295:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88400/0xb4b2209fbdac68d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68df expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.036302:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88400, rc 0) 00000100:00100000:0.0:1746147187.036328:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:28889:x1830967463729664:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 251us (321us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.036334:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10504 00000100:00100000:0.0:1746147187.039261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.039283:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463729920 00000100:00100000:0.0:1746147187.039290:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463729920 00000100:00100000:0.0:1746147187.039320:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4160 00000100:00100000:0.0:1746147187.039326:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:28889:x1830967463729920:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147187.039458:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:28889:x1830967463729920:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 131us (200us total) trans 8589944249 rc 0/0 00000100:00100000:0.0:1746147187.039466:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4160 00000100:00100000:1.0:1746147187.039724:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466400896:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147187.039739:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.039764:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463729408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6440us (6567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.039774:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5749 00000100:00100000:3.0:1746147187.041026:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463728256:12345-192.168.203.36@tcp:4:cat.0 Request processed in 52243us (52409us total) trans 21474840632 rc 0/0 00000100:00100000:3.0:1746147187.041035:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1520 00002000:00100000:3.0:1746147187.041045:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3485696->4071423) req@ffff8800b52e0380 x1830967463728256/t21474840632(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:562/0 lens 488/448 e 0 to 0 dl 1746147197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.041052:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967463728256 ext(3485696->4071423) 00010000:00010000:3.0:1746147187.041061:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 673 lvb_type: 0 00010000:00010000:3.0:1746147187.041078:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.041084:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0380 00000100:00100000:0.0:1746147187.045151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.045797:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463730176 00000100:00100000:0.0:1746147187.045806:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463730176 00002000:00100000:0.0:1746147187.045841:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e2680 x1830967463730176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.045849:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2680 with x1830967463730176 ext(2097152->3145727) 00002000:00010000:0.0:1746147187.045853:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2680 00000100:00100000:0.0:1746147187.046711:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4457 00000100:00100000:0.0:1746147187.046720:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463730176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147187.048425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.049072:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463730304 00000100:00100000:0.0:1746147187.049079:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463730304 00010000:00010000:0.0:1746147187.049104:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.049331:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5750 00000100:00100000:0.0:1746147187.049339:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463730304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.049350:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.049365:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.049376:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.049400:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e217800/0xb4b2209fbdac683d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3485696->4071423) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e687d expref: 44 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.049411:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.049412:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.049418:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.049425:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.049453:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.049464:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.049474:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466401024:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147187.049521:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5b8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.056013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.056038:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463730688 00000100:00100000:0.0:1746147187.056046:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463730688 00002000:00100000:0.0:1746147187.056079:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e0e00 x1830967463730688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.056088:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0e00 with x1830967463730688 ext(3145728->4194303) 00010000:00010000:0.0:1746147187.056096:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.056108:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.056114:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0e00 00000100:00100000:0.0:1746147187.056132:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1522 00000100:00100000:0.0:1746147187.056140:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463730688:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.056809:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466401024:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147187.056822:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.056857:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463730304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7519us (8435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.056865:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5750 00000100:00100000:0.0:1746147187.063410:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463730176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16683us (18257us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.063420:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4457 00002000:00100000:0.0:1746147187.063431:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e2680 x1830967463730176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.063441:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2680 with x1830967463730176 ext(2097152->3145727) 00002000:00010000:0.0:1746147187.063445:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e2680 00000100:00100000:0.0:1746147187.080835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.080882:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463730816 00000100:00100000:0.0:1746147187.080890:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463730816 00000100:00100000:3.0:1746147187.081086:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11662 00000100:00100000:3.0:1746147187.081097:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+43:28883:x1830967463730816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.081113:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.081127:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68e6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.081147:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.081151:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->3764223] (req 3272704->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.081157:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.081159:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.081187:0:17548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->3764223] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.081195:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.081203:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a1200, rc 0) 00000100:00100000:3.0:1746147187.081250:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28883:x1830967463730816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 155us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.081255:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11662 00000100:00100000:2.0:1746147187.081549:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463730688:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 25409us (25543us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147187.081556:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1522 00002000:00100000:2.0:1746147187.081564:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e0e00 x1830967463730688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.081572:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0e00 with x1830967463730688 ext(3145728->4194303) 00010000:00010000:2.0:1746147187.081578:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.081592:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:2.0:1746147187.081606:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0e00 00000100:00100000:0.0:1746147187.095292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.095731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.095753:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463731072 00000100:00100000:0.0:1746147187.095761:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463731072 00010000:00010000:0.0:1746147187.095790:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.095815:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5751 00000100:00100000:0.0:1746147187.095823:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463731072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.095835:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147187.095849:0:8494:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5479 -> 5599 00010000:00010000:0.0:1746147187.095855:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.095866:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.095890:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5600/0xb4b2209fbdac6898 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68b5 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.095903:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.095904:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.095909:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.095916:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.095958:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.095968:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.095978:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466401280:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147187.096034:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.096349:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463730944 00000100:00100000:3.0:1746147187.096353:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463730944 00000100:00100000:3.0:1746147187.096375:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11663 00000100:00100000:3.0:1746147187.096380:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:28886:x1830967463730944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.096390:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.096401:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68ed expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.096413:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.096414:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.096418:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.096427:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.096434:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31c000, rc 0) 00000100:00100000:3.0:1746147187.096459:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28886:x1830967463730944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.096464:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11663 00000100:00100000:0.0:1746147187.099206:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466401280:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147187.099221:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.099250:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463731072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3427us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.099259:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5751 00000100:00100000:0.0:1746147187.103205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.103237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.103257:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463731328 00000100:00100000:0.0:1746147187.103265:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463731328 00002000:00100000:0.0:1746147187.103302:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3272704->3276799) req@ffff88009f7cc000 x1830967463731328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.103310:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc000 with x1830967463731328 ext(3272704->3276799) 00010000:00010000:0.0:1746147187.103318:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.103330:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.103336:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cc000 00000100:00100000:0.0:1746147187.103352:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463731584 00000100:00100000:0.0:1746147187.103354:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463731584 00002000:00100000:0.0:1746147187.103365:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009a80e680 x1830967463731584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.103371:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e680 with x1830967463731584 ext(3145728->4194303) 00002000:00010000:0.0:1746147187.103375:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e680 00000100:00100000:0.0:1746147187.103385:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1523 00000100:00100000:0.0:1746147187.103392:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463731328:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.103513:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463731328:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 120us (314us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.103519:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1523 00002000:00100000:0.0:1746147187.103524:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3272704->3276799) req@ffff88009f7cc000 x1830967463731328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.103531:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc000 with x1830967463731328 ext(3272704->3276799) 00010000:00010000:0.0:1746147187.103535:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.103544:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.103549:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cc000 00000100:00100000:0.0:1746147187.103561:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4458 00000100:00100000:0.0:1746147187.103566:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463731584:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.118543:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463731584:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14969us (15297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.118555:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4458 00002000:00100000:0.0:1746147187.118566:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009a80e680 x1830967463731584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.118574:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e680 with x1830967463731584 ext(3145728->4194303) 00002000:00010000:0.0:1746147187.118579:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e680 00000100:00100000:0.0:1746147187.121822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.122123:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463731840 00000100:00100000:0.0:1746147187.122132:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463731840 00002000:00100000:0.0:1746147187.122168:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3760128->3764223) req@ffff8800a4671c00 x1830967463731840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.122177:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671c00 with x1830967463731840 ext(3760128->3764223) 00010000:00010000:0.0:1746147187.122185:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.122198:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.122205:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671c00 00000100:00100000:0.0:1746147187.122223:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1524 00000100:00100000:0.0:1746147187.122230:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463731840:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.122342:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463731840:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 112us (524us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.122348:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1524 00002000:00100000:0.0:1746147187.122353:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3760128->3764223) req@ffff8800a4671c00 x1830967463731840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.122360:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671c00 with x1830967463731840 ext(3760128->3764223) 00010000:00010000:0.0:1746147187.122364:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.122372:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.122377:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4671c00 00000100:00100000:0.0:1746147187.133054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.133077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.133091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.133778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.133809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.133832:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463732096 00000100:00100000:0.0:1746147187.133840:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463732096 00000100:00100000:0.0:1746147187.133894:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10505 00000100:00100000:0.0:1746147187.133901:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+314:28893:x1830967463732096:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147187.133920:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.133951:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdac68ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68f4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.134028:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.134039:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.134047:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147187.134056:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147187.134139:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5cc00/0xb4b2209fbdac68ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 317 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.134149:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.134156:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.134158:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147187.134160:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5c400, rc 0) 00000100:00100000:0.0:1746147187.134197:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28893:x1830967463732096:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 296us (1147us total) trans 8589944250 rc 0/0 00000100:00100000:0.0:1746147187.134203:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10505 00000100:00100000:0.0:1746147187.134222:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463732352 00000100:00100000:0.0:1746147187.134224:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463732352 00002000:00100000:0.0:1746147187.134253:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76aa00 x1830967463732352/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.134261:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76aa00 with x1830967463732352 ext(4194304->4927487) 00010000:00010000:0.0:1746147187.134267:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.134277:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.134282:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76aa00 00000100:00100000:0.0:1746147187.134293:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463732736 00000100:00100000:0.0:1746147187.134295:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463732736 00002000:00100000:0.0:1746147187.134304:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3272704->3764223) req@ffff88009f76b480 x1830967463732736/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.134309:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b480 with x1830967463732736 ext(3272704->3764223) 00010000:00010000:0.0:1746147187.134312:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.134319:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 30 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.134324:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76b480 00000100:00100000:0.0:1746147187.134333:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1525 00000100:00100000:0.0:1746147187.134338:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463732352:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.135179:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463732992 00000100:00100000:0.0:1746147187.135184:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463732992 00000100:00100000:0.0:1746147187.135206:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4161 00000100:00100000:0.0:1746147187.135211:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28888:x1830967463732992:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147187.135316:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28888:x1830967463732992:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 104us (1505us total) trans 8589944251 rc 0/0 00000100:00100000:0.0:1746147187.135320:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4161 00000100:00100000:3.0:1746147187.138830:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463732480 00000100:00100000:3.0:1746147187.138842:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463732480 00000100:00100000:3.0:1746147187.138885:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11664 00000100:00100000:3.0:1746147187.138894:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463732480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.138911:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.138925:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac6901 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e68fb expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.139022:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466401408:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147187.139198:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130f023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.140240:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1526 00000100:00100000:0.0:1746147187.140249:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463732736:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147187.154232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.154295:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733120 00000100:00100000:2.0:1746147187.154304:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733120 00000100:00100000:2.0:1746147187.154341:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11665 00000100:00100000:2.0:1746147187.154348:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28893:x1830967463733120:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147187.154361:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.154374:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6902 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.154398:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.154407:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.154413:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.154418:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.154420:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.154423:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1626112->1916927] (req 1626112->1916927) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 45 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.154452:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 45 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.154461:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 45 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147187.154471:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.154532:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.154540:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 30 pid: 8481 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147187.154548:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147187.154561:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463732352:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 20222us (21481us total) trans 0 rc 733184/733184 00010000:00010000:2.0:1746147187.154572:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147187.154573:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1525 00010000:00010000:2.0:1746147187.154579:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 12 pid: 8480 timeout: 674 lvb_type: 1 00002000:00100000:0.0:1746147187.154582:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76aa00 x1830967463732352/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 733184/733184 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147187.154586:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401792:192.168.203.36@tcp:104: 00002000:00100000:0.0:1746147187.154590:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76aa00 with x1830967463732352 ext(4194304->4927487) 00010000:00010000:0.0:1746147187.154608:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 33 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.154616:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147187.154618:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 33 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.154624:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76aa00 00000100:00100000:0.0:1746147187.154722:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466401408:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147187.154743:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac6901 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68fb expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.154753:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac6901 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68fb expref: 32 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.154760:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31c600, rc 0) 00000100:00100000:0.0:1746147187.154778:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463732480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 15885us (21685us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.154784:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11664 00000100:00100000:0.0:1746147187.155236:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463732736:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 14987us (21458us total) trans 21474840633 rc 0/0 00000100:00100000:0.0:1746147187.155244:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1526 00002000:00100000:0.0:1746147187.155249:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3272704->3764223) req@ffff88009f76b480 x1830967463732736/t21474840633(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.155256:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b480 with x1830967463732736 ext(3272704->3764223) 00010000:00010000:0.0:1746147187.155261:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.155269:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.155274:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f76b480 00000100:00100000:0.0:1746147187.165222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.165236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.165247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.165260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.165286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.165307:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733248 00000100:00100000:0.0:1746147187.165315:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733248 00010000:00010000:0.0:1746147187.165342:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 46 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:0.0:1746147187.165363:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733504 00000100:00100000:0.0:1746147187.165365:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733504 00010000:00010000:0.0:1746147187.165373:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 31 pid: 8481 timeout: 674 lvb_type: 1 00000100:00100000:0.0:1746147187.165387:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733376 00000100:00100000:0.0:1746147187.165389:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733376 00010000:00010000:0.0:1746147187.165404:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 13 pid: 8480 timeout: 674 lvb_type: 1 00000100:00100000:0.0:1746147187.165411:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733760 00000100:00100000:0.0:1746147187.165413:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733760 00010000:00010000:0.0:1746147187.165420:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.165430:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5752 00000100:00100000:0.0:1746147187.165437:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967463733248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.165448:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.165466:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 46 pid: 6881 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165475:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 46 pid: 6881 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165494:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.165525:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967463733248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.165531:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5752 00000100:00100000:0.0:1746147187.165543:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5753 00000100:00100000:0.0:1746147187.165547:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463733504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.165555:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.165561:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 31 pid: 8481 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165568:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 31 pid: 8481 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165577:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.165586:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463733504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.165591:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5753 00000100:00100000:0.0:1746147187.165613:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5754 00000100:00100000:0.0:1746147187.165618:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463733376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.165623:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.165629:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 13 pid: 8480 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165637:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 13 pid: 8480 timeout: 674 lvb_type: 1 00010000:00010000:0.0:1746147187.165647:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165648:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165654:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 45 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165660:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 45 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165685:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 45 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.165696:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466401920:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147187.165741:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.165757:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5755 00000100:00100000:0.0:1746147187.165762:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463733760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.165769:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.165780:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.165787:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.165798:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64e0000/0xb4b2209fbdac68c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3272704->18446744073709551615] (req 3272704->3764223) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68d8 expref: 31 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.165807:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165809:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165812:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165819:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165839:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 43 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.165846:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466402048:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147187.165863:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.165876:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463733632 00000100:00100000:0.0:1746147187.165878:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463733632 00000100:00100000:0.0:1746147187.165895:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11666 00000100:00100000:0.0:1746147187.165899:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28886:x1830967463733632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147187.165910:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.165919:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6909 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165929:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165931:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.165952:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165962:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 32 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.165968:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b1600, rc 0) 00000100:00100000:0.0:1746147187.165984:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+32:28886:x1830967463733632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.165989:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11666 00000100:00080000:0.0:1746147187.166007:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147187.167260:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e17c800/0xb4b2209fbdac64bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e665b expref: 45 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147187.167276:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.167284:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f064400/0xb4b2209fbdac64ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e668c expref: 30 pid: 8481 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147187.167291:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401664:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.167299:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49edc00/0xb4b2209fbdac63c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e660e expref: 13 pid: 8480 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147187.167306:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466401792:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.167325:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 44 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.167332:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b4400, rc 0) 00000100:00100000:2.0:1746147187.167354:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:28893:x1830967463733120:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 13007us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.167359:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11665 00000100:00100000:0.0:1746147187.175820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.175845:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463734144 00000100:00100000:0.0:1746147187.175853:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463734144 00002000:00100000:0.0:1746147187.175886:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1626112->1630207) req@ffff88009f76bb80 x1830967463734144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.175895:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76bb80 with x1830967463734144 ext(1626112->1630207) 00002000:00010000:0.0:1746147187.175900:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76bb80 00000100:00100000:0.0:1746147187.175917:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4459 00000100:00100000:0.0:1746147187.175923:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463734144:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.176065:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967463734144:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 141us (252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.176081:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4459 00002000:00100000:0.0:1746147187.176086:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1626112->1630207) req@ffff88009f76bb80 x1830967463734144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.176092:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76bb80 with x1830967463734144 ext(1626112->1630207) 00002000:00010000:0.0:1746147187.176094:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76bb80 00000100:00100000:0.0:1746147187.176128:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466402048:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147187.176140:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.176155:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463733760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10393us (10868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.176162:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5755 00000100:00100000:0.0:1746147187.176179:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466401920:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147187.176185:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147187.176194:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463733376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10577us (10946us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.176199:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5754 00000100:00100000:0.0:1746147187.176332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.176367:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463734400 00000100:00100000:0.0:1746147187.176369:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463734400 00002000:00100000:0.0:1746147187.176384:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76b800 x1830967463734400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.176391:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b800 with x1830967463734400 ext(4194304->4927487) 00002000:00010000:0.0:1746147187.176394:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b800 00000100:00100000:0.0:1746147187.176403:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4460 00000100:00100000:0.0:1746147187.176408:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463734400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147187.189298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.189317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.189350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.189368:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463734656 00000100:00100000:0.0:1746147187.189377:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463734656 00002000:00100000:0.0:1746147187.189416:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f768380 x1830967463734656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.189424:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768380 with x1830967463734656 ext(3145728->4194303) 00002000:00010000:0.0:1746147187.189428:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f768380 00000100:00100000:0.0:1746147187.189466:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463734912 00000100:00100000:0.0:1746147187.189469:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463734912 00002000:00100000:0.0:1746147187.189481:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f769f80 x1830967463734912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.189486:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769f80 with x1830967463734912 ext(3145728->4194303) 00002000:00010000:0.0:1746147187.189490:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f769f80 00000100:00100000:0.0:1746147187.189497:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463735168 00000100:00100000:0.0:1746147187.189499:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463735168 00002000:00100000:0.0:1746147187.189511:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1912832->1916927) req@ffff88009f76a680 x1830967463735168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.189516:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a680 with x1830967463735168 ext(1912832->1916927) 00002000:00010000:0.0:1746147187.189519:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76a680 00000100:00100000:2.0:1746147187.189520:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4461 00000100:00100000:2.0:1746147187.189529:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463734656:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.189531:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4462 00000100:00100000:0.0:1746147187.189536:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967463734912:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.189753:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4463 00000100:00100000:0.0:1746147187.189759:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967463735168:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.189866:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967463735168:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 107us (515us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.189872:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4463 00002000:00100000:0.0:1746147187.189877:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41c:0x0] (1912832->1916927) req@ffff88009f76a680 x1830967463735168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.189883:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a680 with x1830967463735168 ext(1912832->1916927) 00002000:00010000:0.0:1746147187.189886:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76a680 00000100:00100000:0.0:1746147187.190421:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463734400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14010us (14086us total) trans 0 rc 733184/733184 00000100:00100000:0.0:1746147187.190427:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4460 00002000:00100000:0.0:1746147187.190433:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76b800 x1830967463734400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.190444:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b800 with x1830967463734400 ext(4194304->4927487) 00002000:00010000:0.0:1746147187.190447:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b800 00000100:00100000:0.0:1746147187.199244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.199270:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463735296 00000100:00100000:2.0:1746147187.199279:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463735296 00000100:00100000:2.0:1746147187.199316:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11667 00000100:00100000:2.0:1746147187.199323:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463735296:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.199339:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.199353:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac6916 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6910 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.199562:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402176:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147187.199635:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbce40 going to sleep for 11 seconds 00000001:00080000:2.0:1746147187.202775:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840626 is committed 00000001:00080000:2.0:1746147187.202809:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840572 is committed 00000001:00080000:2.0:1746147187.202820:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840629 is committed 00000001:00080000:2.0:1746147187.202834:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840580 is committed 00000001:00080000:2.0:1746147187.202850:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840631 is committed 00000001:00080000:2.0:1746147187.202856:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840627 is committed 00000001:00080000:2.0:1746147187.202896:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840630 is committed 00000001:00080000:2.0:1746147187.202906:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840617 is committed 00000100:00100000:0.0:1746147187.208350:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463734656:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18815us (19051us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.208359:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4461 00002000:00100000:0.0:1746147187.208370:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f768380 x1830967463734656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.208378:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768380 with x1830967463734656 ext(3145728->4194303) 00002000:00010000:0.0:1746147187.208383:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f768380 00002000:00010000:0.0:1746147187.209029:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147185 -> 1746147186 00002000:00010000:0.0:1746147187.209033:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147185 -> 1746147186 00002000:00010000:0.0:1746147187.209034:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147185 -> 1746147186 00000100:00100000:0.0:1746147187.209048:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402176:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147187.209071:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac6916 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6910 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.209081:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1b800/0xb4b2209fbdac6916 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6910 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.209090:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1b800, rc 0) 00000100:00100000:0.0:1746147187.209995:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463735296:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10671us (10757us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.210001:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11667 00000100:00100000:2.0:1746147187.212134:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463734912:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 22592us (22810us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147187.212143:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4462 00002000:00100000:2.0:1746147187.212153:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f769f80 x1830967463734912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.212161:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769f80 with x1830967463734912 ext(3145728->4194303) 00002000:00010000:2.0:1746147187.212165:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f769f80 00000100:00100000:0.0:1746147187.222878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.222981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.223004:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463735552 00000100:00100000:0.0:1746147187.223017:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463735552 00002000:00100000:0.0:1746147187.223056:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f769500 x1830967463735552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.223065:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769500 with x1830967463735552 ext(4194304->4927487) 00002000:00010000:0.0:1746147187.223069:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769500 00000100:00100000:0.0:1746147187.223086:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4464 00000100:00100000:0.0:1746147187.223093:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463735552:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.227783:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463735680 00000100:00100000:0.0:1746147187.227794:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463735680 00000100:00100000:0.0:1746147187.227834:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11668 00000100:00100000:0.0:1746147187.227842:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463735680:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147187.227856:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.227869:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdac691d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6917 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.227913:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402304:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147187.227985:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a780 going to sleep for 11 seconds 00002000:00010000:0.0:1746147187.233042:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147186 -> 1746147187 00000100:00100000:0.0:1746147187.233065:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402304:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147187.233091:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdac691d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6917 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.233108:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a537f000/0xb4b2209fbdac691d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6917 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.233118:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a537f000, rc 0) 00000100:00100000:0.0:1746147187.233168:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463735680:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5325us (10184us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.233175:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11668 00000100:00100000:0.0:1746147187.237735:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463735552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 13281us (13503us total) trans 0 rc 733184/733184 00000100:00100000:0.0:1746147187.237745:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4464 00002000:00100000:0.0:1746147187.237949:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f769500 x1830967463735552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 733184/733184 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.237957:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769500 with x1830967463735552 ext(4194304->4927487) 00002000:00010000:0.0:1746147187.237962:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769500 00000100:00100000:0.0:1746147187.238024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.238042:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463735936 00000100:00100000:0.0:1746147187.238049:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463735936 00000100:00100000:0.0:1746147187.238077:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4162 00000100:00100000:0.0:1746147187.238083:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28886:x1830967463735936:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147187.238211:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28886:x1830967463735936:12345-192.168.203.36@tcp:35:cat.0 Request processed in 128us (187us total) trans 8589944252 rc 0/0 00000100:00100000:0.0:1746147187.238217:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4162 00000001:00080000:0.0:1746147187.253048:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873214 is committed 00000001:00080000:0.0:1746147187.253070:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873179 is committed 00000001:00080000:0.0:1746147187.253084:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873221 is committed 00000001:00080000:0.0:1746147187.253090:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873218 is committed 00000001:00080000:0.0:1746147187.253107:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873198 is committed 00000001:00080000:0.0:1746147187.253148:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873223 is committed 00000001:00080000:0.0:1746147187.253154:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873222 is committed 00000001:00080000:0.0:1746147187.253170:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873210 is committed 00000100:00100000:0.0:1746147187.274901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.275070:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463736192 00000100:00100000:2.0:1746147187.275079:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463736192 00000100:00100000:2.0:1746147187.275114:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10506 00000100:00100000:2.0:1746147187.275121:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28899:x1830967463736192:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147187.275139:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.275153:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e691e expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.275238:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275248:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275256:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275267:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275273:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275277:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275366:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17ca00/0xb4b2209fbdac6939 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275374:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17ca00/0xb4b2209fbdac6939 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275379:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17ca00/0xb4b2209fbdac6939 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147187.275386:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147187.275451:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275457:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275462:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275466:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308b5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.275468:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275473:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275481:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147187.275484:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.275486:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275490:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac692b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275516:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275521:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275525:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275528:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e17c800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.275530:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275533:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275542:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9200) 00010000:00010000:2.0:1746147187.275544:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.275546:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275549:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17c800/0xb4b2209fbdac6932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.275579:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e691e expref: 26 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.275589:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17ca00/0xb4b2209fbdac6939 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e691e expref: 25 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.275594:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.275606:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147187.275608:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e17ca00, rc 0) 00000100:00100000:2.0:1746147187.275655:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28899:x1830967463736192:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 534us (760us total) trans 8589944253 rc 0/0 00000100:00100000:2.0:1746147187.275660:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10506 00000100:00100000:0.0:1746147187.278761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.278858:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463736320 00000100:00100000:2.0:1746147187.278867:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463736320 00000100:00100000:2.0:1746147187.279005:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 590 00000100:00100000:2.0:1746147187.279014:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463736320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.279027:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.279047:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e17ca00/0xb4b2209fbdac6939 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e691e expref: 25 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.279064:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.279068:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147187.279122:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463736320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.279128:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 590 00000100:00100000:0.0:1746147187.404080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.404147:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463736576 00000100:00100000:2.0:1746147187.404157:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463736576 00000100:00100000:2.0:1746147187.404208:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10507 00000100:00100000:2.0:1746147187.404217:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:28902:x1830967463736576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.404237:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.404252:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6925 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.404338:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404348:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404357:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404367:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404372:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404377:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404456:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac695c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404464:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac695c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404469:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac695c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147187.404476:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147187.404542:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404548:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404553:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404558:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308b5c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.404560:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404565:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404575:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147187.404577:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.404581:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404585:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5c00/0xb4b2209fbdac694e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404625:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404630:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404634:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404638:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f409800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.404640:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404645:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404650:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9b00) 00010000:00010000:2.0:1746147187.404652:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.404654:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404659:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f409800/0xb4b2209fbdac6955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.404692:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6925 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.404701:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac695c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6925 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.404706:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.404709:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147187.404711:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f408a00, rc 0) 00000100:00100000:2.0:1746147187.404747:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28902:x1830967463736576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 531us (675us total) trans 8589944254 rc 0/0 00000100:00100000:2.0:1746147187.404753:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10507 00000100:00100000:0.0:1746147187.410390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.411149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.411216:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463736704 00000100:00100000:1.0:1746147187.411225:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463736704 00000100:00100000:2.0:1746147187.411303:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463736832 00000100:00100000:2.0:1746147187.411306:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463736832 00000100:00100000:2.0:1746147187.411330:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11669 00000100:00100000:2.0:1746147187.411337:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1959:x1830967463736832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.411349:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.411361:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0xb4b2209fbdac696a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e692c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.411405:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402432:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147187.411462:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.411547:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 591 00000100:00100000:1.0:1746147187.411552:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463736704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.411561:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.411575:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f408a00/0xb4b2209fbdac695c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6925 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.411588:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147187.411591:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.411617:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463736704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.411622:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 591 00002000:00010000:2.0:1746147187.426845:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147186 -> 1746147187 00002000:00010000:2.0:1746147187.426852:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147186 -> 1746147187 00000100:00100000:2.0:1746147187.426872:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402432:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147187.426899:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0xb4b2209fbdac696a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e692c expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.426912:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f409600/0xb4b2209fbdac696a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e692c expref: 9 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.426925:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f409600, rc 0) 00000100:00100000:2.0:1746147187.427639:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1959:x1830967463736832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 16300us (17253us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147187.427648:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11669 00000100:00100000:0.0:1746147187.437032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.437087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.439249:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737216 00000100:00100000:2.0:1746147187.439249:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737088 00000100:00100000:3.0:1746147187.439258:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737216 00000100:00100000:2.0:1746147187.439258:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737088 00002000:00100000:2.0:1746147187.439297:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1581056->1585151) req@ffff8800b52e1c00 x1830967463737088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.439306:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967463737088 ext(1581056->1585151) 00002000:00010000:2.0:1746147187.439311:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:3.0:1746147187.439313:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11670 00000100:00100000:3.0:1746147187.439320:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+8:28902:x1830967463737216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.439332:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147187.439337:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4465 00000100:00100000:2.0:1746147187.439343:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463737088:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147187.439344:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6933 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.439365:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.439371:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.439372:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.439375:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.439403:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.439412:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.439427:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402560:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.439504:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147187.439516:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463737088:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 172us (2492us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147187.439522:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4465 00002000:00100000:2.0:1746147187.439527:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1581056->1585151) req@ffff8800b52e1c00 x1830967463737088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.439534:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967463737088 ext(1581056->1585151) 00010000:00010000:2.0:1746147187.439538:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.439548:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:2.0:1746147187.439553:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b52e1c00 00000100:00100000:0.0:1746147187.451068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.451348:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737344 00000100:00100000:1.0:1746147187.451358:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737344 00002000:00100000:1.0:1746147187.451395:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1626112->1916927) req@ffff880090741880 x1830967463737344/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.451404:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741880 with x1830967463737344 ext(1626112->1916927) 00010000:00010000:1.0:1746147187.451412:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.451425:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 22 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.451431:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090741880 00000100:00100000:1.0:1746147187.451463:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1527 00000100:00100000:1.0:1746147187.451471:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463737344:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147187.451860:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402560:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.451880:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 9 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.451892:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31de00, rc 0) 00000100:00100000:3.0:1746147187.451920:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28902:x1830967463737216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12600us (14831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.451927:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11670 00000100:00100000:0.0:1746147187.452120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.452211:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737472 00000100:00100000:3.0:1746147187.452214:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737472 00000100:00100000:3.0:1746147187.452231:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11671 00000100:00100000:3.0:1746147187.452236:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:28899:x1830967463737472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147187.452244:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.452254:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e693a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452269:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452276:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452286:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.452288:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.452290:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452311:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452319:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.452329:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402688:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.452379:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.452387:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 23 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.452394:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402816:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.452410:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.459797:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402688:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.459806:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402816:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.459833:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 10 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.459852:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31d400, rc 0) 00000100:00100000:3.0:1746147187.461091:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:28899:x1830967463737472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8847us (8964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.461101:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11671 00000100:00100000:1.0:1746147187.461164:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463737344:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 9693us (10102us total) trans 17179873224 rc 0/0 00000100:00100000:1.0:1746147187.461172:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1527 00002000:00100000:1.0:1746147187.461180:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1626112->1916927) req@ffff880090741880 x1830967463737344/t17179873224(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.461188:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741880 with x1830967463737344 ext(1626112->1916927) 00010000:00010000:1.0:1746147187.461196:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 24 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.461206:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 24 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.461213:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090741880 00000100:00100000:0.0:1746147187.465139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.465226:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737856 00000100:00100000:1.0:1746147187.465236:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737856 00002000:00100000:1.0:1746147187.465275:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1581056->1638399) req@ffff88008f9e0000 x1830967463737856/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.465283:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0000 with x1830967463737856 ext(1581056->1638399) 00010000:00010000:1.0:1746147187.465291:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 24 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.465301:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 24 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.465310:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9e0000 00000100:00100000:1.0:1746147187.465342:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1528 00000100:00100000:1.0:1746147187.465350:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463737856:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147187.467327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.467543:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737600 00000100:00100000:3.0:1746147187.467551:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737600 00010000:00010000:3.0:1746147187.467581:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.467616:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5756 00000100:00100000:3.0:1746147187.467623:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463737600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147187.467634:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147187.467647:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.467657:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.467673:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31c000/0xb4b2209fbdac68e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ed expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.467687:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.467719:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463737600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.467724:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5756 00000100:00100000:1.0:1746147187.467913:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463737856:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2564us (2780us total) trans 17179873225 rc 0/0 00000100:00100000:1.0:1746147187.467921:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1528 00002000:00100000:1.0:1746147187.467928:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1581056->1638399) req@ffff88008f9e0000 x1830967463737856/t17179873225(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.467958:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0000 with x1830967463737856 ext(1581056->1638399) 00010000:00010000:1.0:1746147187.467965:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.467975:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.467981:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f9e0000 00000100:00100000:3.0:1746147187.484364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.484382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.484396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.484419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.484437:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463738368 00000100:00100000:3.0:1746147187.484444:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463738368 00000100:00100000:3.0:1746147187.484472:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463738240 00000100:00100000:3.0:1746147187.484473:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463738240 00000100:00100000:3.0:1746147187.484483:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11672 00000100:00100000:3.0:1746147187.484489:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463738368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.484503:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.484516:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b385400/0xb4b2209fbdac697f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6948 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.484533:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.484541:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b385400/0xb4b2209fbdac697f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6948 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.484550:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b385400/0xb4b2209fbdac697f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6948 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.484560:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b385400, rc 0) 00000100:00100000:3.0:1746147187.484592:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463738368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 103us (194us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.484629:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11672 00000100:00100000:3.0:1746147187.484642:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11673 00000100:00100000:3.0:1746147187.484646:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463738240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.484653:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.484659:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b384e00/0xb4b2209fbdac6986 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6941 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.484689:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402944:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147187.484728:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.484866:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463737984 00000100:00100000:0.0:1746147187.484870:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463737984 00000100:00100000:2.0:1746147187.484884:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463738112 00010000:00010000:0.0:1746147187.484886:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 28 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.484887:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463738112 00010000:00010000:2.0:1746147187.484902:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147187.484918:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5757 00000100:00100000:2.0:1746147187.484929:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5758 00000100:00100000:2.0:1746147187.484933:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463738112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.484954:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.484971:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.484983:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 29 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.484997:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.484998:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.485004:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.485011:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.485028:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.485036:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466403072:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147187.485063:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.485080:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463737984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147187.485089:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147187.485101:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 29 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.485114:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 29 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.485125:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e400/0xb4b2209fbdac68a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68c3 expref: 29 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.485136:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.485138:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.485141:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.485147:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.485163:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.485271:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f9e0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466403200:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147187.485326:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147187.487555:0:17548:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff8800a5a0ca80 x1830967466402944) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 28 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.487581:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b4400/0xb4b2209fbdac6908 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1626112->1916927) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6902 expref: 28 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.487592:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466402944:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.487628:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b384e00/0xb4b2209fbdac6986 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6941 expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.487639:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b384e00/0xb4b2209fbdac6986 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6941 expref: 27 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.487646:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b384e00, rc 0) 00000100:00100000:3.0:1746147187.487677:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463738240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3030us (3256us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.487684:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11673 00000100:00100000:3.0:1746147187.487722:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466403072:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147187.487731:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.487747:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463738112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2813us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.487752:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5758 00000100:00100000:0.0:1746147187.490780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.490884:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463738624 00000100:00100000:1.0:1746147187.490893:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463738624 00002000:00100000:1.0:1746147187.490929:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f9e0a80 x1830967463738624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.491257:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0a80 with x1830967463738624 ext(1048576->2097151) 00002000:00010000:1.0:1746147187.491263:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0a80 00000100:00100000:1.0:1746147187.491293:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4466 00000100:00100000:1.0:1746147187.491301:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1959:x1830967463738624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.491676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.491720:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463738880 00000100:00100000:3.0:1746147187.491724:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463738880 00002000:00100000:3.0:1746147187.491742:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3682304->3686399) req@ffff88008f9e0e00 x1830967463738880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.491749:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0e00 with x1830967463738880 ext(3682304->3686399) 00002000:00010000:3.0:1746147187.491752:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0e00 00000100:00100000:3.0:1746147187.491765:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4467 00000100:00100000:3.0:1746147187.491770:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463738880:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147187.491878:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463738880:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 107us (201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147187.491883:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4467 00002000:00100000:3.0:1746147187.491889:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3682304->3686399) req@ffff88008f9e0e00 x1830967463738880/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.491896:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0e00 with x1830967463738880 ext(3682304->3686399) 00002000:00010000:3.0:1746147187.491898:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0e00 00000100:00100000:2.0:1746147187.491967:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f9e0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466403200:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147187.491984:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147187.492007:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463737984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7083us (7650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.492014:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5757 00000100:00100000:0.0:1746147187.498858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.499109:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739008 00000100:00100000:3.0:1746147187.499119:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739008 00000100:00100000:3.0:1746147187.499160:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11674 00000100:00100000:3.0:1746147187.499168:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:28908:x1830967463739008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.499183:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.499196:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e694f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.499222:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.499224:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.499229:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.499241:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.499249:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b385a00, rc 0) 00000100:00100000:3.0:1746147187.499284:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28908:x1830967463739008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.499290:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11674 00000100:00100000:1.0:1746147187.501374:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1959:x1830967463738624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10068us (10597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147187.501383:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4466 00002000:00100000:1.0:1746147187.501393:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f9e0a80 x1830967463738624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.501402:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0a80 with x1830967463738624 ext(1048576->2097151) 00002000:00010000:1.0:1746147187.501415:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0a80 00000100:00100000:0.0:1746147187.502411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.503042:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739136 00000100:00100000:1.0:1746147187.503050:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739136 00000100:00100000:1.0:1746147187.503095:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11675 00000100:00100000:1.0:1746147187.503102:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28899:x1830967463739136:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147187.503117:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.503136:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6956 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503163:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503171:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503176:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.503178:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.503180:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4665343] (req 4194304->4665343) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503211:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503221:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.503232:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403328:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.503309:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.503317:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 17 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.503325:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147187.503342:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.504557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.504637:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739392 00000100:00100000:1.0:1746147187.504644:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739392 00002000:00100000:1.0:1746147187.504672:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f9e1880 x1830967463739392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.504680:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1880 with x1830967463739392 ext(1048576->2097151) 00002000:00010000:1.0:1746147187.504684:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1880 00000100:00100000:1.0:1746147187.504793:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4468 00000100:00100000:1.0:1746147187.504800:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463739392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147187.512072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.512572:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147187.512582:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403456:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.512620:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4665343] (req 4194304->4665343) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 12 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.512635:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f564800, rc 0) 00000100:00100000:1.0:1746147187.512679:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28899:x1830967463739136:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9576us (10270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.512686:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11675 00000100:00100000:2.0:1746147187.513295:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739520 00000100:00100000:2.0:1746147187.513302:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739520 00010000:00010000:2.0:1746147187.513528:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.513557:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5759 00000100:00100000:2.0:1746147187.513564:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463739520:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.513577:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.513594:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.513613:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.513629:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac690f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6909 expref: 12 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.513644:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147187.513661:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463739520:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.513666:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5759 00000100:00100000:0.0:1746147187.514200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.514276:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739648 00000100:00100000:2.0:1746147187.514279:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739648 00010000:00010000:2.0:1746147187.514291:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 18 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.514318:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5760 00000100:00100000:2.0:1746147187.514324:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463739648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.514330:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.514339:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 18 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.514347:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 18 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.514359:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac68de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68e6 expref: 18 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.514368:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.514369:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.514374:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.514382:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.514406:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.514415:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466403584:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147187.514459:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.514864:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463739392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10064us (10310us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147187.514871:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4468 00002000:00100000:1.0:1746147187.514878:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f9e1880 x1830967463739392/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.514886:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1880 with x1830967463739392 ext(1048576->2097151) 00002000:00010000:1.0:1746147187.514889:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1880 00000100:00100000:0.0:1746147187.515061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.515286:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463739904 00000100:00100000:1.0:1746147187.515289:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463739904 00002000:00100000:1.0:1746147187.515307:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008f9e1f80 x1830967463739904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.515313:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1f80 with x1830967463739904 ext(2097152->3145727) 00002000:00010000:1.0:1746147187.515316:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1f80 00000100:00100000:1.0:1746147187.515855:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4469 00000100:00100000:1.0:1746147187.515862:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1958:x1830967463739904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.516045:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466403584:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147187.516057:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147187.516084:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463739648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1760us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.516091:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5760 00000100:00100000:1.0:1746147187.522744:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1958:x1830967463739904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6872us (7673us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147187.522755:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4469 00002000:00100000:1.0:1746147187.522767:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008f9e1f80 x1830967463739904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.522776:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1f80 with x1830967463739904 ext(2097152->3145727) 00002000:00010000:1.0:1746147187.522781:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1f80 00000100:00100000:0.0:1746147187.525835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.526155:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740160 00000100:00100000:1.0:1746147187.526165:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740160 00002000:00100000:1.0:1746147187.526204:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4661248->4665343) req@ffff88008f9e2300 x1830967463740160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.526215:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e2300 with x1830967463740160 ext(4661248->4665343) 00002000:00010000:1.0:1746147187.526219:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9e2300 00000100:00100000:1.0:1746147187.526252:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4470 00000100:00100000:1.0:1746147187.526259:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463740160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147187.526407:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463740160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 148us (578us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147187.526413:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4470 00002000:00100000:1.0:1746147187.526418:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4661248->4665343) req@ffff88008f9e2300 x1830967463740160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.526425:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e2300 with x1830967463740160 ext(4661248->4665343) 00002000:00010000:1.0:1746147187.526427:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9e2300 00000100:00100000:0.0:1746147187.527408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.527457:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740288 00000100:00100000:1.0:1746147187.527462:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740288 00000100:00100000:1.0:1746147187.527495:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11676 00000100:00100000:1.0:1746147187.527501:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463740288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.527511:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.527523:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xb4b2209fbdac699b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e695d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.527561:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403712:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147187.527965:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.527967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.528014:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740416 00000100:00100000:2.0:1746147187.528018:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740416 00000100:00100000:2.0:1746147187.528047:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11677 00000100:00100000:2.0:1746147187.528052:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463740416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.528060:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.528069:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6964 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.528321:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466403840:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147187.528370:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.530126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147187.530549:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147186 -> 1746147187 00002000:00010000:1.0:1746147187.530554:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147186 -> 1746147187 00002000:00010000:1.0:1746147187.530555:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147186 -> 1746147187 00000100:00100000:1.0:1746147187.530572:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466403712:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.530608:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xb4b2209fbdac699b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e695d expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.530620:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xb4b2209fbdac699b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e695d expref: 18 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.530646:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541400, rc 0) 00000100:00100000:1.0:1746147187.530682:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463740288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3180us (3276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147187.530689:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11676 00000100:00100000:2.0:1746147187.530762:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740672 00000100:00100000:2.0:1746147187.530769:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740672 00000100:00100000:2.0:1746147187.530799:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4163 00000100:00100000:2.0:1746147187.530805:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:28899:x1830967463740672:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147187.530994:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28899:x1830967463740672:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 187us (869us total) trans 8589944255 rc 0/0 00000100:00100000:2.0:1746147187.530999:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4163 00000100:00100000:0.0:1746147187.531325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147187.531779:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147186 -> 1746147187 00002000:00010000:2.0:1746147187.531781:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147186 -> 1746147187 00002000:00010000:2.0:1746147187.531783:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147186 -> 1746147187 00000100:00100000:2.0:1746147187.531795:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466403840:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147187.531812:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6964 expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.531822:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6964 expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.531829:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5c00, rc 0) 00000100:00100000:2.0:1746147187.531849:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463740416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3797us (3882us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147187.531854:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11677 00000100:00100000:2.0:1746147187.531864:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740800 00000100:00100000:2.0:1746147187.531867:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740800 00000100:00100000:2.0:1746147187.532208:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11678 00000100:00100000:2.0:1746147187.532215:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28902:x1830967463740800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.532224:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.532235:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e696b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.532251:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.532253:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.532257:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.532268:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.532275:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5600, rc 0) 00000100:00100000:2.0:1746147187.532304:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28902:x1830967463740800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 90us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.532309:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11678 00000100:00100000:0.0:1746147187.541034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.541399:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463740928 00000100:00100000:2.0:1746147187.541408:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463740928 00000100:00100000:2.0:1746147187.541456:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11679 00000100:00100000:2.0:1746147187.541463:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28908:x1830967463740928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.541478:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.541492:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6972 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.541517:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.541524:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.541526:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.541529:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.541554:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.541563:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 8 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.541573:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466403968:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147187.542569:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.544621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.544799:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463741184 00000100:00100000:3.0:1746147187.544805:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463741184 00000100:00100000:2.0:1746147187.544852:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466403968:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.544878:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147187.544912:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008f9e3800 x1830967463741184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.544919:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e3800 with x1830967463741184 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.544923:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9e3800 00010000:00010000:2.0:1746147187.545112:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5000, rc 0) 00000100:00100000:3.0:1746147187.545227:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4471 00000100:00100000:3.0:1746147187.545234:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463741184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.546207:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28908:x1830967463740928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4743us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.546214:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11679 00000100:00100000:2.0:1746147187.550717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.550758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.550822:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463741312 00000100:00100000:3.0:1746147187.550830:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463741312 00002000:00100000:3.0:1746147187.550867:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3682304->4194303) req@ffff88008e135c00 x1830967463741312/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.550877:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135c00 with x1830967463741312 ext(3682304->4194303) 00010000:00010000:3.0:1746147187.550886:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 9 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.550900:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 9 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.550905:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e135c00 00000100:00100000:3.0:1746147187.550927:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463741568 00000100:00100000:3.0:1746147187.550930:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463741568 00002000:00100000:3.0:1746147187.550952:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3682303) req@ffff88008e136a00 x1830967463741568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.550959:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136a00 with x1830967463741568 ext(3145728->3682303) 00010000:00010000:3.0:1746147187.550963:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.550971:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 10 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.550976:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e136a00 00000100:00100000:3.0:1746147187.550989:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1529 00000100:00100000:3.0:1746147187.550996:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463741312:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147187.551483:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1530 00000100:00100000:1.0:1746147187.551489:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463741568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147187.562726:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463741312:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11721us (12013us total) trans 17179873226 rc 0/0 00000100:00100000:3.0:1746147187.562739:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1529 00002000:00100000:3.0:1746147187.562750:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3682304->4194303) req@ffff88008e135c00 x1830967463741312/t17179873226(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.562765:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135c00 with x1830967463741312 ext(3682304->4194303) 00010000:00010000:3.0:1746147187.562773:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 13 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.562789:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 13 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.562796:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e135c00 00000100:00100000:3.0:1746147187.563061:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463741184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17827us (18446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147187.563067:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4471 00002000:00100000:3.0:1746147187.563072:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008f9e3800 x1830967463741184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.563079:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e3800 with x1830967463741184 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.563082:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f9e3800 00000100:00100000:0.0:1746147187.564696:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463741568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13200us (13930us total) trans 0 rc 536576/536576 00000100:00100000:0.0:1746147187.564704:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1530 00002000:00100000:0.0:1746147187.564712:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3682303) req@ffff88008e136a00 x1830967463741568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.564719:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136a00 with x1830967463741568 ext(3145728->3682303) 00010000:00010000:0.0:1746147187.564728:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 11 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147187.564741:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 11 pid: 17548 timeout: 674 lvb_type: 0 00002000:00010000:0.0:1746147187.564746:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e136a00 00000100:00100000:0.0:1746147187.571037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.571589:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463741696 00000100:00100000:2.0:1746147187.571607:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463741696 00000100:00100000:2.0:1746147187.571659:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11680 00000100:00100000:2.0:1746147187.571667:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28902:x1830967463741696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.571682:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.571699:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6979 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.571721:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.571723:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.571727:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.571737:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.571747:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5c00, rc 0) 00000100:00100000:2.0:1746147187.572671:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28902:x1830967463741696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1002us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.572678:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11680 00000100:00100000:0.0:1746147187.574909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.575179:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463741824 00000100:00100000:2.0:1746147187.575188:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463741824 00010000:00010000:2.0:1746147187.575217:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.575250:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5761 00000100:00100000:2.0:1746147187.575257:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463741824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147187.575270:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147187.575286:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.575297:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.575317:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31d400/0xb4b2209fbdac6978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e693a expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.575335:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.575337:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.575344:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.575352:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.575364:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.575365:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.575368:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.575374:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.575399:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 11 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.575410:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466404096:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147187.575498:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.575506:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466404224:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147187.575524:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.579677:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466404096:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147187.579688:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466404224:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147187.579705:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.579961:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463741824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4702us (5056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.579970:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5761 00000100:00100000:0.0:1746147187.584386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.584432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.584527:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463742208 00000100:00100000:3.0:1746147187.584537:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463742208 00002000:00100000:3.0:1746147187.584577:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008f9e1c00 x1830967463742208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.584584:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1c00 with x1830967463742208 ext(2097152->3145727) 00002000:00010000:3.0:1746147187.584589:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1c00 00000100:00100000:3.0:1746147187.584628:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463742336 00000100:00100000:3.0:1746147187.584631:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463742336 00002000:00100000:3.0:1746147187.584643:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008f9e0700 x1830967463742336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.584648:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0700 with x1830967463742336 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.584651:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0700 00000100:00100000:3.0:1746147187.584662:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4472 00000100:00100000:3.0:1746147187.584668:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463742208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.584669:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4473 00000100:00100000:2.0:1746147187.584677:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463742336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147187.597857:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463742208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13179us (13468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147187.597867:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4472 00002000:00100000:3.0:1746147187.597880:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008f9e1c00 x1830967463742208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.597889:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e1c00 with x1830967463742208 ext(2097152->3145727) 00002000:00010000:3.0:1746147187.597893:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e1c00 00000100:00100000:2.0:1746147187.602848:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463742336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18164us (18407us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147187.602860:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4473 00002000:00100000:2.0:1746147187.602871:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008f9e0700 x1830967463742336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.602887:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f9e0700 with x1830967463742336 ext(3145728->4194303) 00002000:00010000:2.0:1746147187.602892:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f9e0700 00000100:00100000:0.0:1746147187.605896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.606071:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463742464 00000100:00100000:2.0:1746147187.606080:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463742464 00000100:00100000:2.0:1746147187.606587:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11681 00000100:00100000:2.0:1746147187.606604:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28908:x1830967463742464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.606620:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.606634:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6980 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.606997:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.607000:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.607007:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.607020:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.607029:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568a00, rc 0) 00000100:00100000:2.0:1746147187.607065:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28908:x1830967463742464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 471us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.607071:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11681 00000100:00100000:0.0:1746147187.607139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.607318:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463742592 00000100:00100000:1.0:1746147187.607322:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463742592 00000100:00100000:1.0:1746147187.607347:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11682 00000100:00100000:1.0:1746147187.607352:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463742592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.607359:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.607365:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac69c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6987 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.607398:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404352:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147187.607466:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.609092:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404352:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.609118:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac69c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6987 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.609127:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac69c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6987 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.609148:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f3e00, rc 0) 00000100:00100000:1.0:1746147187.609178:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463742592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1825us (2038us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147187.609184:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11682 00000100:00100000:0.0:1746147187.613169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.613250:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463742848 00000100:00100000:2.0:1746147187.613260:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463742848 00002000:00100000:2.0:1746147187.613300:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4665344->4927487) req@ffff8800a6570700 x1830967463742848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.613314:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570700 with x1830967463742848 ext(4665344->4927487) 00002000:00010000:2.0:1746147187.613318:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6570700 00000100:00100000:2.0:1746147187.613346:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4474 00000100:00100000:2.0:1746147187.613354:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463742848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147187.615159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.615194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.615240:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743104 00000100:00100000:3.0:1746147187.615248:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743104 00002000:00100000:3.0:1746147187.615279:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a6570a80 x1830967463743104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.615286:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570a80 with x1830967463743104 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.615290:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6570a80 00000100:00100000:3.0:1746147187.615305:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743360 00000100:00100000:3.0:1746147187.615307:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743360 00002000:00100000:3.0:1746147187.615318:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a6570e00 x1830967463743360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.615323:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570e00 with x1830967463743360 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.615326:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570e00 00000100:00100000:3.0:1746147187.615344:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4475 00000100:00100000:3.0:1746147187.615351:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463743104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.615375:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4476 00000100:00100000:2.0:1746147187.615381:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463743360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.622067:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463742848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8704us (8895us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1746147187.622079:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4474 00002000:00100000:2.0:1746147187.622092:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4665344->4927487) req@ffff8800a6570700 x1830967463742848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.622101:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570700 with x1830967463742848 ext(4665344->4927487) 00002000:00010000:2.0:1746147187.622107:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6570700 00000100:00100000:2.0:1746147187.626154:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463743360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10765us (10952us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147187.626164:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4476 00002000:00100000:2.0:1746147187.626175:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a6570e00 x1830967463743360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.626184:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570e00 with x1830967463743360 ext(3145728->4194303) 00002000:00010000:2.0:1746147187.626188:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570e00 00000100:00100000:0.0:1746147187.628039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.628646:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463743104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13294us (13489us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147187.628655:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4475 00002000:00100000:3.0:1746147187.628664:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a6570a80 x1830967463743104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.628672:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570a80 with x1830967463743104 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.628677:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6570a80 00000100:00100000:1.0:1746147187.629163:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743488 00000100:00100000:1.0:1746147187.629171:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743488 00000100:00100000:1.0:1746147187.629211:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11683 00000100:00100000:1.0:1746147187.629218:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463743488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.629231:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.629244:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2600/0xb4b2209fbdac69cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e698e expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.629285:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404480:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147187.629503:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.636164:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404480:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.636200:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2600/0xb4b2209fbdac69cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e698e expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.636213:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2600/0xb4b2209fbdac69cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e698e expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.636245:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f2600, rc 0) 00000100:00100000:1.0:1746147187.636289:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463743488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7071us (8255us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147187.636297:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11683 00000100:00100000:0.0:1746147187.638706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.638752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.639905:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743616 00000100:00100000:1.0:1746147187.639916:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743616 00000100:00100000:1.0:1746147187.639975:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743744 00000100:00100000:1.0:1746147187.639978:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743744 00000100:00100000:1.0:1746147187.639999:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11684 00000100:00100000:1.0:1746147187.640006:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463743616:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.640021:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.640036:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3400/0xb4b2209fbdac69d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6995 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.640088:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466404608:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147187.640488:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.640504:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11685 00000100:00100000:1.0:1746147187.640510:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463743744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.640517:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.640524:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2200/0xb4b2209fbdac69da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e699c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.640544:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404736:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147187.640562:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.641996:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466404608:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.642023:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3400/0xb4b2209fbdac69d3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6995 expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.642034:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9f3400/0xb4b2209fbdac69d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6995 expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.642042:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f3400, rc 0) 00000100:00100000:1.0:1746147187.642080:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463743616:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2074us (3379us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147187.642086:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11684 00000100:00100000:2.0:1746147187.642751:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404736:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147187.642769:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2200/0xb4b2209fbdac69da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e699c expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.642776:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9f2200/0xb4b2209fbdac69da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e699c expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.643432:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f2200, rc 0) 00000100:00100000:2.0:1746147187.643676:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463743744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3164us (4922us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147187.643683:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11685 00000100:00100000:0.0:1746147187.649640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.649692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.649908:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463743872 00000100:00100000:2.0:1746147187.649918:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463743872 00000100:00100000:2.0:1746147187.649981:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11686 00000100:00100000:2.0:1746147187.649989:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28908:x1830967463743872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.650004:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.650017:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69a3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.650044:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.650051:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.650052:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147187.650056:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4927487] (req 4194304->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.650082:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.650093:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 11 pid: 21080 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.650103:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147187.650168:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.650504:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463744128 00000100:00100000:1.0:1746147187.650508:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463744128 00000100:00100000:1.0:1746147187.650534:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4164 00000100:00100000:1.0:1746147187.650539:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:28902:x1830967463744128:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147187.650681:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28902:x1830967463744128:12345-192.168.203.36@tcp:35:cat.0 Request processed in 141us (988us total) trans 8589944256 rc 0/0 00000100:00100000:1.0:1746147187.650687:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4164 00000100:00100000:2.0:1746147187.654095:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466404864:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.654123:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4927487] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.654138:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569e00, rc 0) 00000100:00100000:2.0:1746147187.654176:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28908:x1830967463743872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4187us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.654184:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11686 00000100:00100000:0.0:1746147187.657211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.657424:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463744384 00000100:00100000:3.0:1746147187.657432:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463744384 00000100:00100000:3.0:1746147187.657471:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10508 00000100:00100000:3.0:1746147187.657477:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:28911:x1830967463744384:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147187.657493:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.657507:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b4400/0xb4b2209fbdac69e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69aa expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.657603:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657615:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657624:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657634:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657639:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657643:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657724:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac69fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657731:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac69fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657736:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac69fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147187.657742:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147187.657801:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657807:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657812:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657819:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a1200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147187.657821:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657827:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657834:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147187.657836:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147187.657839:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657843:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a1200/0xb4b2209fbdac69ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657857:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657861:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657865:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657869:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b384e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147187.657871:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657875:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657879:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13c00) 00010000:00010000:3.0:1746147187.657881:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147187.657883:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657886:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b384e00/0xb4b2209fbdac69f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.657914:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b4400/0xb4b2209fbdac69e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69aa expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.657922:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac69fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69aa expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.657927:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147187.657928:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147187.657930:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b385800, rc 0) 00000100:00100000:3.0:1746147187.657981:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28911:x1830967463744384:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 504us (777us total) trans 8589944257 rc 0/0 00000100:00100000:3.0:1746147187.657986:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10508 00000100:00100000:0.0:1746147187.658279:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.658480:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463744512 00000100:00100000:1.0:1746147187.658485:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463744512 00000100:00100000:1.0:1746147187.658516:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10509 00000100:00100000:1.0:1746147187.658522:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:28912:x1830967463744512:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147187.658532:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.658539:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f2a00/0xb4b2209fbdac6a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69b1 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.658568:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658573:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658579:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658588:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658593:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658607:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658660:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658670:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.658675:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.658698:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 315 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.658706:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 315 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.658717:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466404992:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147187.658766:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.658857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.658989:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463744640 00000100:00100000:2.0:1746147187.658993:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463744640 00002000:00100000:2.0:1746147187.659014:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4665343) req@ffff8800a6572680 x1830967463744640/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.659022:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572680 with x1830967463744640 ext(4194304->4665343) 00010000:00010000:2.0:1746147187.659029:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 12 pid: 21080 timeout: 674 lvb_type: 0 00010000:00010000:2.0:1746147187.659037:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 12 pid: 21080 timeout: 674 lvb_type: 0 00002000:00010000:2.0:1746147187.659048:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6572680 00000100:00100000:2.0:1746147187.659061:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1531 00000100:00100000:2.0:1746147187.659066:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463744640:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147187.663046:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466404992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.663067:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147187.665389:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463744640:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6316us (6526us total) trans 21474840634 rc 0/0 00000100:00100000:3.0:1746147187.665400:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1531 00002000:00100000:3.0:1746147187.665410:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4665343) req@ffff8800a6572680 x1830967463744640/t21474840634(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.665418:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572680 with x1830967463744640 ext(4194304->4665343) 00010000:00010000:3.0:1746147187.665426:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.665437:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00002000:00010000:3.0:1746147187.665443:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6572680 00000100:00100000:0.0:1746147187.668159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.668366:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463744768 00000100:00100000:3.0:1746147187.668375:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463744768 00000100:00100000:0.0:1746147187.668409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.668433:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 592 00000100:00100000:0.0:1746147187.668440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.668441:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463744768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147187.668481:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745152 00000100:00100000:1.0:1746147187.668485:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745152 00000100:00100000:0.0:1746147187.668495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147187.668501:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.668517:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5762 00000100:00100000:1.0:1746147187.668522:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463745152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.668530:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.668546:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.668560:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.668578:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f564800/0xb4b2209fbdac6994 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6956 expref: 14 pid: 21080 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.668584:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745024 00000100:00100000:2.0:1746147187.668588:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745024 00010000:00010000:1.0:1746147187.668605:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.668607:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.668613:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.668621:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.668627:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4165 00000100:00100000:2.0:1746147187.668631:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:27372:x1830967463745024:12345-192.168.203.36@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746147187.668647:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.668657:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466405120:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147187.668710:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147187.668762:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:27372:x1830967463745024:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 129us (352us total) trans 8589944258 rc 0/0 00000100:00100000:2.0:1746147187.668768:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4165 00000100:00100000:2.0:1746147187.668787:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745280 00000100:00100000:2.0:1746147187.668789:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745280 00010000:00010000:3.0:1746147187.669284:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147187.669298:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385800/0xb4b2209fbdac69fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69aa expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.669311:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147187.669315:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.669321:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.669324:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.669328:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.669918:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463744768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1477us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.669924:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 592 00000100:00100000:1.0:1746147187.670671:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466405120:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147187.670686:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.670706:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463745152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2183us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.670712:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5762 00000100:00100000:3.0:1746147187.670786:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11687 00000100:00100000:3.0:1746147187.670794:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:28911:x1830967463745280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147187.670806:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.670818:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69b8 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670837:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670843:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670848:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.670849:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.670852:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2584576->2703359] (req 2584576->2703359) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670868:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670877:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.670886:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466405248:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.670930:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.670954:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 25 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.670961:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466405376:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.670982:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.673579:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466405248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.673589:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466405376:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.673623:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2584576->2703359] (req 2584576->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.673638:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094069800, rc 0) 00000100:00100000:3.0:1746147187.673670:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28911:x1830967463745280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2877us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.673677:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11687 00000100:00100000:0.0:1746147187.674336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.675219:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745536 00000100:00100000:1.0:1746147187.675227:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745536 00010000:00010000:1.0:1746147187.675250:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.675358:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5763 00000100:00100000:0.0:1746147187.676215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.676777:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463745536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.676792:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.676810:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.676821:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.676837:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac69b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6979 expref: 12 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.676848:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.676879:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463745536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1514us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.676884:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5763 00000100:00100000:2.0:1746147187.677183:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745664 00000100:00100000:2.0:1746147187.677189:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745664 00002000:00100000:2.0:1746147187.677214:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a6573b80 x1830967463745664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.677222:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573b80 with x1830967463745664 ext(4194304->4927487) 00002000:00010000:2.0:1746147187.677226:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6573b80 00000100:00100000:2.0:1746147187.677241:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4477 00000100:00100000:2.0:1746147187.677246:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463745664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147187.681143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.681199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.681533:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745792 00000100:00100000:1.0:1746147187.681542:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745792 00000100:00100000:3.0:1746147187.681549:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463745920 00000100:00100000:3.0:1746147187.681554:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463745920 00010000:00010000:1.0:1746147187.681569:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.681572:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 317 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.681609:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5764 00000100:00100000:1.0:1746147187.681616:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463745792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.681631:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.681648:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.681659:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.681678:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac69b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6972 expref: 26 pid: 17548 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.681690:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.681691:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.681697:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.681704:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.681733:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.681744:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466405504:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147187.681750:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5765 00000100:00100000:3.0:1746147187.681756:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1959:x1830967463745920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147187.681764:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147187.681769:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 317 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.681777:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 317 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.681789:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5c400/0xb4b2209fbdac68f3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68f4 expref: 317 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.681803:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147187.681804:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147187.681808:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.681814:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.681818:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.681832:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.681851:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1959:x1830967463745920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.681856:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5765 00010000:00010000:1.0:1746147187.683453:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683465:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:1.0:1746147187.683498:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:1.0:1746147187.683500:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147187.683512:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683520:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683527:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683532:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683536:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683541:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9f3000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147187.683544:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683550:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683561:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147187.683566:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147187.683569:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683573:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3000/0xb4b2209fbdac6a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683585:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683589:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683600:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683604:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9f3c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147187.683606:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683609:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683614:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:1.0:1746147187.683616:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147187.683618:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683621:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3c00/0xb4b2209fbdac6a19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.683650:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f2a00/0xb4b2209fbdac6a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 14 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.683659:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 13 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.683664:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147187.683666:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147187.683668:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f3e00, rc 0) 00000100:00100000:1.0:1746147187.683710:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:28912:x1830967463744512:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 25188us (25430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.683717:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10509 00000100:00100000:1.0:1746147187.684869:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466405504:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147187.684887:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.684921:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463745792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3304us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.684928:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5764 00000100:00100000:3.0:1746147187.685159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.685218:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746176 00000100:00100000:2.0:1746147187.685225:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746176 00002000:00100000:2.0:1746147187.685250:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2584576->2588671) req@ffff8800a5a0ed80 x1830967463746176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.685258:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463746176 ext(2584576->2588671) 00002000:00010000:2.0:1746147187.685261:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:2.0:1746147187.685785:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4478 00000100:00100000:2.0:1746147187.685794:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463746176:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147187.685912:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463746176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 119us (753us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147187.685917:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4478 00002000:00100000:2.0:1746147187.685922:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2584576->2588671) req@ffff8800a5a0ed80 x1830967463746176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.685928:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463746176 ext(2584576->2588671) 00002000:00010000:2.0:1746147187.685931:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:0.0:1746147187.687330:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463745664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10079us (11111us total) trans 0 rc 733184/733184 00000100:00100000:0.0:1746147187.687338:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4477 00002000:00100000:0.0:1746147187.687345:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a6573b80 x1830967463745664/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.687352:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573b80 with x1830967463745664 ext(4194304->4927487) 00002000:00010000:0.0:1746147187.687356:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6573b80 00000100:00100000:0.0:1746147187.692200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.692232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.694103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.694307:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746432 00000100:00100000:2.0:1746147187.694308:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746304 00000100:00100000:3.0:1746147187.694316:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746432 00000100:00100000:2.0:1746147187.694316:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746304 00000100:00100000:2.0:1746147187.694355:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746560 00000100:00100000:2.0:1746147187.694357:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746560 00000100:00100000:2.0:1746147187.694372:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11688 00000100:00100000:2.0:1746147187.694379:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463746304:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147187.694394:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.694407:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69bf expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.694425:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.694427:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147187.694435:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.694446:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147187.694455:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673e000, rc 0) 00000100:00100000:2.0:1746147187.694491:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463746304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 113us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.694497:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11688 00000100:00100000:2.0:1746147187.694510:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11689 00000100:00100000:2.0:1746147187.694514:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463746560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147187.694519:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.694524:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013673f800/0xb4b2209fbdac6a35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69cd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.694556:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466405632:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147187.694707:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.694874:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11690 00000100:00100000:3.0:1746147187.694879:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463746432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147187.694886:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147187.694910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.694929:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746816 00000100:00100000:0.0:1746147187.694932:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746816 00002000:00100000:0.0:1746147187.694966:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2699264->2703359) req@ffff880134c54000 x1830967463746816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.694975:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967463746816 ext(2699264->2703359) 00002000:00010000:0.0:1746147187.694978:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:0.0:1746147187.694990:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4479 00000100:00100000:0.0:1746147187.694995:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463746816:12345-192.168.203.36@tcp:3:multiop.0 00000100:00080000:1.0:1746147187.695150:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746147187.695181:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69c6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.695195:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.695196:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.695201:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.695214:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.695220:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0400, rc 0) 00000100:00100000:3.0:1746147187.695251:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463746432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 371us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.695256:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11690 00000100:00100000:0.0:1746147187.696799:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463746816:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1800us (1885us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.696807:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4479 00002000:00100000:0.0:1746147187.696813:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2699264->2703359) req@ffff880134c54000 x1830967463746816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.696820:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54000 with x1830967463746816 ext(2699264->2703359) 00002000:00010000:0.0:1746147187.696824:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54000 00000100:00100000:0.0:1746147187.700411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.701309:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463746944 00000100:00100000:3.0:1746147187.701318:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463746944 00000100:00100000:3.0:1746147187.702668:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11691 00000100:00100000:3.0:1746147187.702681:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463746944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.702697:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.702711:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6a43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69d4 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.702762:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466405760:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147187.702830:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.702878:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466405632:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.702897:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013673f800/0xb4b2209fbdac6a35 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69cd expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.702907:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013673f800/0xb4b2209fbdac6a35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69cd expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.702922:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673f800, rc 0) 00000100:00100000:3.0:1746147187.702960:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463746560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8444us (8859us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.702966:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11689 00000100:00100000:1.0:1746147187.703045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.703063:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463747456 00000100:00100000:1.0:1746147187.703068:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463747456 00000100:00100000:1.0:1746147187.703101:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10510 00000100:00100000:1.0:1746147187.703250:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:28915:x1830967463747456:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147187.703260:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.703270:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3800/0xb4b2209fbdac6a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69db expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.703325:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.703336:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.703341:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.703356:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 12 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.703368:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 12 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.703375:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466405888:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147187.703410:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147187.703489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.703758:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463747200 00000100:00100000:0.0:1746147187.703762:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463747200 00000100:00100000:0.0:1746147187.703790:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4166 00000100:00100000:0.0:1746147187.703795:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:28911:x1830967463747200:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147187.704136:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28911:x1830967463747200:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 340us (648us total) trans 8589944259 rc 0/0 00000100:00100000:1.0:1746147187.704142:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4166 00000100:00100000:0.0:1746147187.705319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.705405:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463747712 00000100:00100000:3.0:1746147187.705409:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463747712 00000100:00100000:3.0:1746147187.705444:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10511 00000100:00100000:3.0:1746147187.705449:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:28912:x1830967463747712:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147187.705459:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.705470:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69e2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.705518:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.705527:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147187.705533:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147187.706738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.706979:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466405888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.706992:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466405760:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.706995:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147187.707012:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463747840 00010000:00010000:3.0:1746147187.707013:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6a43 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69d4 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147187.707016:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463747840 00010000:00010000:3.0:1746147187.707023:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6a43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69d4 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.707032:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 15 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.707058:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5766 00000100:00100000:1.0:1746147187.707064:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463747840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.707074:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.707078:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 15 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.707087:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 15 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.707102:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3e00/0xb4b2209fbdac6a20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b1 expref: 15 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.707113:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147187.707117:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.707123:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.707128:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.707133:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147187.707138:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147187.707141:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.707163:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147187.707164:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147187.707171:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147187.707188:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00100000:1.0:1746147187.707194:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463747840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.707199:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5766 00010000:00010000:3.0:1746147187.707272:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0200, rc 0) 00010000:00010000:2.0:1746147187.707288:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.707292:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463746944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4617us (6887us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.707299:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11691 00010000:00010000:2.0:1746147187.707345:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.707351:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.707353:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147187.707355:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1c00, rc 0) 00010000:00010000:0.0:1746147187.707369:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147187.707377:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:2.0:1746147187.707379:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463747712:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1929us (2060us total) trans 8589944260 rc 0/0 00000100:00100000:2.0:1746147187.707385:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10511 00000004:00200000:0.0:1746147187.707387:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147187.707440:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3800/0xb4b2209fbdac6a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 319 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.707450:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 318 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.707455:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.707457:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147187.707459:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f3a00, rc 0) 00000100:00100000:0.0:1746147187.707475:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28915:x1830967463747456:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4369us (4431us total) trans 8589944261 rc 0/0 00000100:00100000:0.0:1746147187.707480:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10510 00000100:00100000:0.0:1746147187.716168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.716212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.716295:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463747968 00000100:00100000:2.0:1746147187.716303:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463747968 00000100:00100000:2.0:1746147187.716337:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10512 00000100:00100000:2.0:1746147187.716344:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463747968:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147187.716362:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.716376:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a74 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69e9 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.716437:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.716449:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 317 pid: 14048 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.716453:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748096 00010000:00010000:2.0:1746147187.716456:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.716457:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748096 00010000:00010000:2.0:1746147187.716461:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147187.716479:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11692 00000100:00100000:3.0:1746147187.716484:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463748096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.716486:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 15 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.716492:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.716496:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 15 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.716501:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6a82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69f0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147187.716505:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466406016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.716529:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406144:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147187.716562:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00010000:00010000:2.0:1746147187.716566:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 317 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.716573:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 317 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147187.716579:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466406272:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147187.716591:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.720155:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.720755:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406144:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.720787:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6a82 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69f0 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.720801:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6a82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69f0 expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147187.720874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.720917:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466406016:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147187.720927:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466406272:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147187.720961:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.721017:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0e00, rc 0) 00000100:00100000:3.0:1746147187.721059:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463748096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4574us (4846us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.721069:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11692 00000100:00100000:1.0:1746147187.721403:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748224 00000100:00100000:1.0:1746147187.721410:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748224 00010000:00010000:1.0:1746147187.721530:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 318 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.721551:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748352 00000100:00100000:1.0:1746147187.721553:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748352 00010000:00010000:1.0:1746147187.721562:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 16 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.721680:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5767 00000100:00100000:1.0:1746147187.721687:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1956:x1830967463748224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.721702:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.721707:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 318 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.721714:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 318 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.721729:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9f3a00/0xb4b2209fbdac6a51 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69db expref: 318 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.721740:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147187.721744:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.721751:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.721754:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147187.721758:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.721884:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5768 00000100:00100000:3.0:1746147187.721891:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463748352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147187.721898:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147187.721902:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 16 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.721910:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 16 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.721920:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1c00/0xb4b2209fbdac6a5f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e2 expref: 16 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147187.721928:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147187.721931:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.721952:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.721958:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147187.721983:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147187.721999:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463748352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.722004:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5768 00010000:00010000:2.0:1746147187.722097:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147187.722121:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1956:x1830967463748224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.722128:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5767 00010000:00010000:2.0:1746147187.722206:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147187.722437:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147187.722441:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147187.722455:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.722478:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a74 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.722496:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 14 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.722501:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.722503:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147187.722505:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673f600, rc 0) 00000100:00100000:2.0:1746147187.722873:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463747968:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6529us (6712us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.722879:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10512 00000100:00100000:0.0:1746147187.726081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.726157:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748480 00000100:00100000:3.0:1746147187.726165:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748480 00000100:00100000:3.0:1746147187.726202:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11693 00000100:00100000:3.0:1746147187.726209:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463748480:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147187.726224:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.726239:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6a89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69f7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147187.726283:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406400:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147187.726359:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.728422:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406400:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.728451:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6a89 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69f7 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.728463:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6a89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69f7 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.728472:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1200, rc 0) 00000100:00100000:3.0:1746147187.728519:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463748480:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2309us (2444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.728526:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11693 00000100:00100000:0.0:1746147187.736362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.736806:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748736 00000100:00100000:2.0:1746147187.736815:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748736 00000100:00100000:2.0:1746147187.736854:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10513 00000100:00100000:2.0:1746147187.736860:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b192050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463748736:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147187.736876:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.736890:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6a90 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e69fe expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.736984:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.736996:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737005:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737014:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737019:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737024:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737029:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013673fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.737033:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737037:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737045:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.737048:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147187.737051:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737054:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6a97 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.737093:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6a90 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69fe expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.737099:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6a90 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69fe expref: 15 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.737106:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5000, rc 0) 00000100:00100000:2.0:1746147187.737152:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b192050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463748736:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 291us (797us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147187.737157:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10513 00000100:00100000:0.0:1746147187.739306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.739354:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463748992 00000100:00100000:1.0:1746147187.739361:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463748992 00000100:00100000:1.0:1746147187.739402:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4167 00000100:00100000:1.0:1746147187.739409:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:28912:x1830967463748992:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147187.739575:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:28912:x1830967463748992:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 166us (275us total) trans 8589944262 rc 0/0 00000100:00100000:1.0:1746147187.739582:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4167 00000100:00100000:0.0:1746147187.812690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.812773:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463749120 00000100:00100000:3.0:1746147187.812781:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463749120 00000100:00100000:3.0:1746147187.812815:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11694 00000100:00100000:3.0:1746147187.812821:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28915:x1830967463749120:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147187.812835:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.812849:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a05 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.812875:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.812881:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.812882:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.812885:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3203072->4009983] (req 3203072->4009983) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.812906:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.812915:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 10 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.812924:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406528:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.813019:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.817328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.817401:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463749248 00000100:00100000:1.0:1746147187.817409:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463749248 00002000:00100000:1.0:1746147187.817444:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2584576->2703359) req@ffff880134c56300 x1830967463749248/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.817452:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56300 with x1830967463749248 ext(2584576->2703359) 00010000:00010000:1.0:1746147187.817459:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 11 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.817470:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 11 pid: 6881 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.817475:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c56300 00000100:00100000:1.0:1746147187.817502:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1532 00000100:00100000:1.0:1746147187.817507:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463749248:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147187.818744:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.818768:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3203072->4009983] (req 3203072->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.818779:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0c00, rc 0) 00000100:00100000:3.0:1746147187.819740:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28915:x1830967463749120:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6914us (7052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.819749:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11694 00000100:00100000:1.0:1746147187.824639:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463749248:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7121us (7307us total) trans 17179873227 rc 0/0 00000100:00100000:1.0:1746147187.824654:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1532 00002000:00100000:1.0:1746147187.824665:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2584576->2703359) req@ffff880134c56300 x1830967463749248/t17179873227(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.824673:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56300 with x1830967463749248 ext(2584576->2703359) 00010000:00010000:1.0:1746147187.824683:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.824696:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.824702:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c56300 00010000:00010000:2.0:1746147187.829051:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147187.829774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.829847:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463749376 00000100:00100000:1.0:1746147187.829856:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463749376 00010000:00010000:1.0:1746147187.829889:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.829929:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5769 00000100:00100000:1.0:1746147187.831253:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463749376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.831269:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.831288:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.831300:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.831323:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094069800/0xb4b2209fbdac6a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2703359) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69b8 expref: 13 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.831646:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.831648:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.831654:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.831662:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.831874:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.831888:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466406656:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147187.835852:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147187.837838:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466406656:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147187.837859:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.837894:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463749376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7958us (8124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.837903:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5769 00000100:00100000:0.0:1746147187.838072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.840272:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463749632 00000100:00100000:1.0:1746147187.840285:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463749632 00002000:00100000:1.0:1746147187.840324:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3203072->3207167) req@ffff880134c56a00 x1830967463749632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.840339:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967463749632 ext(3203072->3207167) 00002000:00010000:1.0:1746147187.840345:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56a00 00000100:00100000:1.0:1746147187.840364:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4480 00000100:00100000:1.0:1746147187.840371:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463749632:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147187.840527:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463749632:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 155us (2454us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147187.840533:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4480 00002000:00100000:1.0:1746147187.840538:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3203072->3207167) req@ffff880134c56a00 x1830967463749632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.840545:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56a00 with x1830967463749632 ext(3203072->3207167) 00002000:00010000:1.0:1746147187.840548:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56a00 00000100:00100000:1.0:1746147187.849556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.849628:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463749888 00000100:00100000:0.0:1746147187.849639:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463749888 00000100:00100000:0.0:1746147187.849690:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10514 00000100:00100000:0.0:1746147187.849698:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:28920:x1830967463749888:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147187.849719:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.849733:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540400/0xb4b2209fbdac6aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a0c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.849816:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849825:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849834:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849844:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849850:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849854:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849929:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849954:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.849960:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147187.849968:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147187.850029:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850034:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850040:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850045:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f541000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147187.850048:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850054:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850062:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147187.850064:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147187.850067:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850072:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541000/0xb4b2209fbdac6aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850098:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850103:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850107:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850114:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f540800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147187.850117:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850121:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850126:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880099ff9400) 00010000:00010000:0.0:1746147187.850128:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147187.850130:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850134:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540800/0xb4b2209fbdac6ab3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147187.850162:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540400/0xb4b2209fbdac6aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.850171:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 31 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.850177:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147187.850179:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147187.850181:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540000, rc 0) 00000100:00100000:0.0:1746147187.851915:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28920:x1830967463749888:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2211us (2361us total) trans 8589944263 rc 0/0 00000100:00100000:0.0:1746147187.851923:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10514 00000100:00100000:0.0:1746147187.863872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.863965:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463750144 00000100:00100000:2.0:1746147187.863974:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463750144 00002000:00100000:2.0:1746147187.864010:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (4005888->4009983) req@ffff880134c56d80 x1830967463750144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.864019:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56d80 with x1830967463750144 ext(4005888->4009983) 00002000:00010000:2.0:1746147187.864024:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56d80 00000100:00100000:2.0:1746147187.864052:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4481 00000100:00100000:2.0:1746147187.864060:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463750144:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147187.864206:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463750144:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 146us (341us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147187.864212:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4481 00002000:00100000:2.0:1746147187.864217:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (4005888->4009983) req@ffff880134c56d80 x1830967463750144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147187.864224:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56d80 with x1830967463750144 ext(4005888->4009983) 00002000:00010000:2.0:1746147187.864226:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56d80 00000100:00100000:0.0:1746147187.868473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.868559:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463750400 00000100:00100000:1.0:1746147187.868567:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463750400 00000100:00100000:1.0:1746147187.868624:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4168 00000100:00100000:1.0:1746147187.868631:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:28915:x1830967463750400:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147187.868812:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28915:x1830967463750400:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 180us (344us total) trans 8589944264 rc 0/0 00000100:00100000:1.0:1746147187.868819:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4168 00000100:00100000:0.0:1746147187.889253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147187.889322:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463750656 00000100:00100000:2.0:1746147187.889332:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463750656 00000100:00100000:2.0:1746147187.889390:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10515 00000100:00100000:2.0:1746147187.889398:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:28925:x1830967463750656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147187.889422:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.889439:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a13 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.889517:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.889530:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147187.889538:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147187.889547:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147187.889648:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 34 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.889680:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 33 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.889687:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.889689:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746147187.889692:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673fc00, rc 0) 00000100:00100000:2.0:1746147187.889731:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28925:x1830967463750656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 334us (486us total) trans 8589944265 rc 0/0 00000100:00100000:2.0:1746147187.889736:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10515 00000100:00100000:0.0:1746147187.892813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.892857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.892904:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463750784 00000100:00100000:1.0:1746147187.892913:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463750784 00000100:00100000:3.0:1746147187.892931:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463750912 00000100:00100000:1.0:1746147187.892969:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11695 00000100:00100000:3.0:1746147187.892970:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463750912 00000100:00100000:1.0:1746147187.892975:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463750784:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.892990:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147187.892992:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11696 00000100:00100000:3.0:1746147187.892997:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463750912:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147187.893003:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a1a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.893004:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.893013:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6ae4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a21 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.893020:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.893022:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.893029:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.893041:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147187.893048:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406784:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147187.893050:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee9d000, rc 0) 00000100:00100000:1.0:1746147187.893157:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463750784:12345-192.168.203.36@tcp:101:cat.0 Request processed in 181us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.893163:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11695 00000100:00100000:3.0:1746147187.893734:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147187.904872:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406784:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147187.904904:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6ae4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a21 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.904916:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6ae4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a21 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.906600:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0e00, rc 0) 00000100:00100000:3.0:1746147187.906858:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463750912:12345-192.168.203.36@tcp:101:cat.0 Request processed in 13855us (13994us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147187.906867:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11696 00000100:00100000:1.0:1746147187.922672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.922822:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751040 00000100:00100000:3.0:1746147187.922831:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751040 00000100:00100000:3.0:1746147187.922878:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11697 00000100:00100000:3.0:1746147187.922885:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+12:28925:x1830967463751040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.922901:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.922916:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a28 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.922955:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.922962:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.922964:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147187.922967:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.922992:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.923002:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 25 pid: 8478 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147187.923013:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406912:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147187.923088:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.928414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.928812:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751168 00000100:00100000:1.0:1746147187.928822:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751168 00002000:00100000:1.0:1746147187.928862:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3203072->4009983) req@ffff880134c57b80 x1830967463751168/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.928877:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967463751168 ext(3203072->4009983) 00010000:00010000:1.0:1746147187.928886:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 26 pid: 8478 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.928898:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 26 pid: 8478 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.928909:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c57b80 00000100:00100000:3.0:1746147187.929046:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466406912:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147187.929070:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.929081:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0200, rc 0) 00000100:00100000:3.0:1746147187.929116:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28925:x1830967463751040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6232us (6453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.929123:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11697 00000100:00100000:1.0:1746147187.930504:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1533 00000100:00100000:1.0:1746147187.930515:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463751168:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147187.959364:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463751168:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 28843us (30948us total) trans 17179873228 rc 0/0 00000100:00100000:1.0:1746147187.959374:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1533 00002000:00100000:1.0:1746147187.959386:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3203072->4009983) req@ffff880134c57b80 x1830967463751168/t17179873228(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:563/0 lens 488/448 e 0 to 0 dl 1746147198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147187.959394:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57b80 with x1830967463751168 ext(3203072->4009983) 00010000:00010000:1.0:1746147187.959403:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.959416:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00002000:00010000:1.0:1746147187.959422:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c57b80 00000100:00100000:0.0:1746147187.968023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147187.968074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.968167:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751296 00000100:00100000:1.0:1746147187.968176:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751296 00010000:00010000:1.0:1746147187.968210:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.968249:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5770 00000100:00100000:1.0:1746147187.968257:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463751296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147187.968265:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751424 00000100:00100000:2.0:1746147187.968269:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751424 00010000:00010000:1.0:1746147187.968274:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.968291:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.968303:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.968322:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6a9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3203072->4009983) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a05 expref: 28 pid: 8478 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147187.968348:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.968350:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.968357:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.968365:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.968395:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147187.968405:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466407040:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147187.968473:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147187.968860:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10516 00000100:00100000:2.0:1746147187.968867:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28929:x1830967463751424:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147187.968883:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147187.968899:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a2f expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.968970:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.968979:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.968987:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.968997:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969001:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969005:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969092:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969099:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969104:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147187.969131:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147187.969135:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147187.969147:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969155:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969161:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969165:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969171:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969174:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013673e400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.969177:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969182:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.969189:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147187.971317:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.971326:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971333:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673e400/0xb4b2209fbdac6af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971357:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971362:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971367:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971371:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013673f000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147187.971375:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971380:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971388:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9300) 00010000:00010000:2.0:1746147187.971390:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147187.971392:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971396:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147187.971427:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a2f expref: 17 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.971437:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a2f expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147187.971443:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147187.971445:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147187.971447:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5000, rc 0) 00000100:00100000:2.0:1746147187.972105:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28929:x1830967463751424:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3237us (4028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147187.972113:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10516 00000100:00100000:0.0:1746147187.974487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.975616:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751552 00000100:00100000:3.0:1746147187.975628:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751552 00000100:00100000:3.0:1746147187.975691:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11698 00000100:00100000:3.0:1746147187.975700:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463751552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147187.975717:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147187.975731:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a36 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147187.975753:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.975755:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147187.975762:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.975775:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147187.975784:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0800, rc 0) 00000100:00100000:3.0:1746147187.975836:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463751552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 138us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147187.975841:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11698 00000100:00100000:2.0:1746147187.982581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.983509:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466407040:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147187.983538:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.984454:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463751296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 16194us (16434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.984464:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5770 00000100:00100000:2.0:1746147187.984669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147187.984758:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751936 00000100:00100000:3.0:1746147187.984765:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751936 00002000:00100000:3.0:1746147187.984800:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76a300 x1830967463751936/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.984808:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463751936 ext(3145728->4194303) 00002000:00010000:3.0:1746147187.984812:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:3.0:1746147187.984825:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463751808 00000100:00100000:3.0:1746147187.984827:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463751808 00002000:00100000:3.0:1746147187.984835:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f768a80 x1830967463751808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147187.984841:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768a80 with x1830967463751808 ext(2097152->3145727) 00002000:00010000:3.0:1746147187.984844:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f768a80 00000100:00100000:3.0:1746147187.984853:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4482 00000100:00100000:3.0:1746147187.984860:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463751936:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147187.985958:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4483 00000100:00100000:3.0:1746147187.985967:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463751808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147187.989548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.989603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.989620:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463752192 00000100:00100000:1.0:1746147187.989628:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463752192 00000100:00100000:1.0:1746147187.989675:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 593 00000100:00100000:1.0:1746147187.989682:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:1958:x1830967463752192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147187.989695:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147187.989713:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308b5000/0xb4b2209fbdac6b07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a2f expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.989729:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147187.989732:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147187.989759:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463752192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.989765:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 593 00000100:00100000:1.0:1746147187.989804:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463752320 00000100:00100000:1.0:1746147187.989806:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463752320 00000100:00100000:1.0:1746147187.989822:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11699 00000100:00100000:1.0:1746147187.989826:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463752320:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147187.989836:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.989846:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a3d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.989862:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.989863:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147187.989870:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.989880:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.989888:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64c00, rc 0) 00000100:00100000:1.0:1746147187.989904:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463752320:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147187.989909:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11699 00000100:00100000:0.0:1746147187.995061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147187.995140:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463752448 00000100:00100000:1.0:1746147187.995150:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463752448 00000100:00100000:1.0:1746147187.995186:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11700 00000100:00100000:1.0:1746147187.995195:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28920:x1830967463752448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147187.995210:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147187.995221:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a44 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995245:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995252:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.995258:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.995268:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995275:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995280:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147187.995282:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147187.995285:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 8/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995309:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995319:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 18 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.995329:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407168:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.995412:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995420:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 15 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.995427:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407296:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.995452:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.995459:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 12 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:1.0:1746147187.995466:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407424:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.995488:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147187.995495:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 674 lvb_type: 1 00000100:00100000:1.0:1746147187.995501:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407552:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147187.995519:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147187.995525:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147187.995532:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407680:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147187.995545:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.000172:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463751936:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15304us (17589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.000185:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4482 00002000:00100000:2.0:1746147188.000195:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f76a300 x1830967463751936/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.000203:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463751936 ext(3145728->4194303) 00002000:00010000:2.0:1746147188.000208:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:0.0:1746147188.002168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.002254:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463752704 00000100:00100000:2.0:1746147188.002263:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463752704 00000100:00100000:2.0:1746147188.002315:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10517 00000100:00100000:2.0:1746147188.002322:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28929:x1830967463752704:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147188.002339:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.002356:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6b23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a4b expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.002429:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.002441:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.002447:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.002452:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.002479:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.002492:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 32 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147188.002502:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466407808:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.002582:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.002589:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 16 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147188.002604:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466407936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.002630:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.007156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.008735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.008799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.008814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.008833:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753472 00000100:00100000:0.0:1746147188.008840:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753472 00010000:00010000:0.0:1746147188.008870:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 16 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:0.0:1746147188.008896:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753600 00000100:00100000:0.0:1746147188.008898:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753600 00010000:00010000:0.0:1746147188.008906:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 13 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:2.0:1746147188.009916:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463752960 00000100:00100000:2.0:1746147188.009922:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463752960 00002000:00100000:2.0:1746147188.009972:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880093d37800 x1830967463752960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.009980:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37800 with x1830967463752960 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.009984:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37800 00000100:00100000:2.0:1746147188.009995:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753088 00000100:00100000:2.0:1746147188.009997:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753088 00002000:00100000:2.0:1746147188.010006:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d35c00 x1830967463753088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.010012:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35c00 with x1830967463753088 ext(3145728->4194303) 00002000:00010000:2.0:1746147188.010014:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d35c00 00000100:00100000:2.0:1746147188.010024:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4484 00000100:00100000:2.0:1746147188.010031:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463752960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.010195:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5771 00000100:00100000:0.0:1746147188.010205:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463753472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.010217:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.010234:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 16 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147188.010249:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 16 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:0.0:1746147188.010267:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.010302:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463753472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.010410:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5772 00000100:00100000:3.0:1746147188.010418:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463753600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.010425:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.010434:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 13 pid: 6881 timeout: 674 lvb_type: 1 00010000:00010000:3.0:1746147188.010442:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 13 pid: 6881 timeout: 674 lvb_type: 1 00010000:00010000:3.0:1746147188.010452:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.010466:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463753600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.010472:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5772 00000100:00100000:3.0:1746147188.010504:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4485 00000100:00100000:3.0:1746147188.010509:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463753088:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.010878:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407168:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.010889:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0xb4b2209fbdac6867 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68a0 expref: 16 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147188.010905:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407296:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.010929:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0400/0xb4b2209fbdac6a3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69c6 expref: 12 pid: 6881 timeout: 674 lvb_type: 1 00000100:00100000:1.0:1746147188.010948:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407424:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.010957:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407552:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.010964:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466407680:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.010997:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.011006:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65e00, rc 0) 00000100:00100000:1.0:1746147188.011022:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28920:x1830967463752448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 15829us (15969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.011027:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11700 00000100:00100000:1.0:1746147188.011080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:2.0:1746147188.011096:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147188.011132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.011154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.011164:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753344 00000100:00100000:1.0:1746147188.011168:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753344 00010000:00010000:1.0:1746147188.011193:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 19 pid: 6881 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147188.011205:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753728 00000100:00100000:1.0:1746147188.011207:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753728 00010000:00010000:1.0:1746147188.011214:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 674 lvb_type: 1 00000100:00100000:1.0:1746147188.011226:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5773 00000100:00100000:1.0:1746147188.011230:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463753344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1746147188.011232:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746147188.011237:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.011246:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 19 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011253:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 19 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011264:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e17c400/0xb4b2209fbdac688a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e68ae expref: 19 pid: 6881 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011271:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.011284:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463753344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.011289:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5773 00000100:00100000:1.0:1746147188.011298:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5774 00000100:00100000:1.0:1746147188.011302:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463753728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.011307:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.011314:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 674 lvb_type: 1 00010000:00010000:1.0:1746147188.011321:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 674 lvb_type: 1 00010000:00010000:1.0:1746147188.011329:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee9d000/0xb4b2209fbdac6add lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a1a expref: 15 pid: 8481 timeout: 674 lvb_type: 1 00010000:00010000:1.0:1746147188.011336:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.011347:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463753728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.011351:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5774 00000100:00100000:1.0:1746147188.011385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.011434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.011441:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753856 00000100:00100000:1.0:1746147188.011443:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753856 00000100:00100000:2.0:1746147188.011445:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466407808:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.011451:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 674 lvb_type: 0 00000100:00100000:2.0:1746147188.011454:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466407936:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.011461:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463753984 00000100:00100000:1.0:1746147188.011463:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463753984 00010000:00010000:2.0:1746147188.011469:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147188.011478:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 33 pid: 14049 timeout: 674 lvb_type: 0 00000100:00080000:2.0:1746147188.011481:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147188.011486:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5775 00000100:00100000:1.0:1746147188.011490:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463753856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.011495:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.011501:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011507:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011516:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f569e00/0xb4b2209fbdac69e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69a3 expref: 18 pid: 8481 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011523:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.011525:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.011530:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.011538:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.011539:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463751808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25575us (26871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147188.011545:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4483 00002000:00100000:3.0:1746147188.011551:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f768a80 x1830967463751808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.011558:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768a80 with x1830967463751808 ext(2097152->3145727) 00010000:00010000:1.0:1746147188.011559:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147188.011561:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f768a80 00000100:00100000:1.0:1746147188.011569:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466408064:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.011577:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5776 00000100:00100000:3.0:1746147188.011581:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463753984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.011587:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.011603:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 33 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147188.011611:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 33 pid: 14049 timeout: 674 lvb_type: 0 00000100:00100000:1.0:1746147188.011612:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147188.011622:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f540000/0xb4b2209fbdac6aba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a0c expref: 33 pid: 14049 timeout: 674 lvb_type: 0 00010000:00010000:3.0:1746147188.011634:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.011637:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147188.011641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147188.011644:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147188.011648:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.011651:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463754112 00000100:00100000:1.0:1746147188.011653:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463754112 00000100:00100000:3.0:1746147188.011660:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463753984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147188.011663:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 17 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147188.011668:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5776 00000100:00100000:1.0:1746147188.011673:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5777 00000100:00100000:1.0:1746147188.011677:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463754112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.011683:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147188.011685:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463754368 00010000:00010000:1.0:1746147188.011686:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 17 pid: 14048 timeout: 674 lvb_type: 0 00000100:00100000:3.0:1746147188.011687:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463754368 00010000:00010000:1.0:1746147188.011694:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 17 pid: 14048 timeout: 674 lvb_type: 0 00010000:00010000:1.0:1746147188.011704:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f600/0xb4b2209fbdac6a7b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69e9 expref: 17 pid: 14048 timeout: 674 lvb_type: 0 00000100:00080000:2.0:1746147188.011706:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147188.011711:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:3.0:1746147188.011714:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10518 00010000:00010000:1.0:1746147188.011714:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147188.011718:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+318:28932:x1830967463754368:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147188.011720:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147188.011725:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147188.011729:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.011738:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a52 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.011742:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.011754:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463754112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.011759:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5777 00010000:00010000:2.0:1746147188.011772:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.011779:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147188.011805:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.011813:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.011819:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147188.011825:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147188.011904:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 321 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.011913:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.011918:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.011920:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147188.011922:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1600, rc 0) 00000100:00100000:3.0:1746147188.011956:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:28932:x1830967463754368:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 219us (804us total) trans 8589944266 rc 0/0 00000100:00100000:3.0:1746147188.011962:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10518 00000004:00200000:2.0:1746147188.012047:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147188.012117:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fa00/0xb4b2209fbdac6b23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a4b expref: 17 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.012146:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a4b expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.012152:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147188.012155:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147188.012157:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013673f000, rc 0) 00000100:00100000:2.0:1746147188.012175:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28929:x1830967463752704:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 9854us (10011us total) trans 8589944267 rc 0/0 00000100:00100000:2.0:1746147188.012181:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10517 00000100:00100000:0.0:1746147188.012293:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5771 00000100:00100000:0.0:1746147188.021183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.021327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.021357:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463754752 00000100:00100000:0.0:1746147188.021364:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463754752 00000100:00100000:0.0:1746147188.021403:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11701 00000100:00100000:0.0:1746147188.021410:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463754752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.021425:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.021437:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac6b4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a59 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.021463:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac6b4d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a59 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.021472:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f540600/0xb4b2209fbdac6b4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a59 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.021480:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540600, rc 0) 00000100:00100000:3.0:1746147188.021501:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463754624 00000100:00100000:3.0:1746147188.021505:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463754624 00000100:00100000:0.0:1746147188.021514:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463754752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 106us (189us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.021521:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11701 00002000:00100000:3.0:1746147188.021527:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2416640->2420735) req@ffff8800a47a9c00 x1830967463754624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.021535:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47a9c00 with x1830967463754624 ext(2416640->2420735) 00002000:00010000:3.0:1746147188.021538:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47a9c00 00000100:00100000:3.0:1746147188.021550:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4486 00000100:00100000:3.0:1746147188.021555:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463754624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147188.021684:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463754624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 128us (508us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.021690:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4486 00002000:00100000:3.0:1746147188.021700:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2416640->2420735) req@ffff8800a47a9c00 x1830967463754624/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.021706:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47a9c00 with x1830967463754624 ext(2416640->2420735) 00002000:00010000:3.0:1746147188.021708:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47a9c00 00000100:00100000:2.0:1746147188.022095:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463752960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12063us (14946us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.022101:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4484 00002000:00100000:2.0:1746147188.022107:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880093d37800 x1830967463752960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.022114:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37800 with x1830967463752960 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.022117:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d37800 00000100:00100000:1.0:1746147188.022367:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466408064:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.022386:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.022404:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463753856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10913us (11019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.022411:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5775 00000100:00100000:3.0:1746147188.023871:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463753088:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13357us (15135us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147188.023878:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4485 00002000:00100000:3.0:1746147188.023885:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880093d35c00 x1830967463753088/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.023892:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35c00 with x1830967463753088 ext(3145728->4194303) 00002000:00010000:3.0:1746147188.023896:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d35c00 00000100:00100000:1.0:1746147188.026847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.026881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.029200:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755136 00000100:00100000:0.0:1746147188.029211:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755136 00000100:00100000:2.0:1746147188.029231:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755008 00000100:00100000:2.0:1746147188.029235:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755008 00000100:00100000:2.0:1746147188.029260:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10519 00000100:00100000:2.0:1746147188.029266:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28929:x1830967463755008:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147188.029269:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11702 00000100:00100000:0.0:1746147188.029275:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28925:x1830967463755136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.029286:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.029286:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.029289:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147188.029300:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a67 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.029307:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673f000/0xb4b2209fbdac6b2a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a4b expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.029320:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.029321:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147188.029321:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.029324:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147188.029328:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.029332:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac6b5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a60 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.029341:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.029349:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541c00, rc 0) 00000100:00100000:0.0:1746147188.029389:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28925:x1830967463755136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 114us (2507us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147188.029394:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147188.029394:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11702 00010000:00010000:2.0:1746147188.029404:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.029410:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.029440:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.029449:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 319 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.029459:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466408192:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.029499:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.032425:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466408192:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.032446:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147188.033293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.033325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.033397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.033448:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755648 00000100:00100000:3.0:1746147188.033455:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755648 00002000:00100000:3.0:1746147188.033488:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a47ab800 x1830967463755648/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.033496:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47ab800 with x1830967463755648 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.033500:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47ab800 00000100:00100000:3.0:1746147188.033522:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4487 00000100:00100000:3.0:1746147188.033528:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463755648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.034480:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755264 00000100:00100000:0.0:1746147188.034486:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755264 00010000:00010000:0.0:1746147188.034506:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 320 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.034526:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5778 00000100:00100000:0.0:1746147188.034531:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1958:x1830967463755264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.034540:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.034545:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 320 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.034555:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 320 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.034572:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1600/0xb4b2209fbdac6b38 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a52 expref: 320 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.034583:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147188.034587:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147188.034607:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147188.034612:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147188.034629:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.034653:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:1958:x1830967463755264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 121us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.034658:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5778 00010000:00010000:2.0:1746147188.034732:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034740:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034755:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034760:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034765:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034770:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a8200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147188.034774:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034783:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034790:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147188.034792:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147188.034794:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034799:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8200/0xb4b2209fbdac6b62 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.034828:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac6b5b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a60 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.034834:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac6b5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a60 expref: 16 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.034840:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9400, rc 0) 00000100:00100000:2.0:1746147188.034857:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28929:x1830967463755008:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 5592us (8018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.034863:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10519 00000100:00100000:1.0:1746147188.035153:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755392 00000100:00100000:1.0:1746147188.035158:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755392 00000100:00100000:1.0:1746147188.035187:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11703 00000100:00100000:1.0:1746147188.035192:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a47a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463755392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.035202:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.035212:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6b69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a6e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.035230:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6b69 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a6e expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.035238:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6b69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a6e expref: 18 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.035252:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199a00, rc 0) 00000100:00100000:1.0:1746147188.035274:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463755392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 81us (1983us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.035279:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11703 00000100:00100000:0.0:1746147188.037004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.037132:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463755776 00000100:00100000:2.0:1746147188.037139:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463755776 00000100:00100000:2.0:1746147188.037183:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11704 00000100:00100000:2.0:1746147188.037190:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28932:x1830967463755776:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.037205:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.037218:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a75 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.037245:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.037252:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.037258:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.037263:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.037265:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.037268:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3837952->4194303] (req 3837952->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.037292:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.037301:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.037311:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408320:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.037380:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.037387:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 10 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.037395:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.037419:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.037426:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 12 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.037432:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.037445:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.038465:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a47ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463755648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 4933us (5135us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147188.038474:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4487 00002000:00100000:3.0:1746147188.038482:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a47ab800 x1830967463755648/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.038490:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a47ab800 with x1830967463755648 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.038494:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a47ab800 00000100:00100000:0.0:1746147188.038871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.038958:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756032 00000100:00100000:2.0:1746147188.038965:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756032 00000100:00100000:2.0:1746147188.039179:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4169 00000100:00100000:2.0:1746147188.039187:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:28929:x1830967463756032:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147188.039497:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+16:28929:x1830967463756032:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 310us (625us total) trans 8589944268 rc 0/0 00000100:00100000:2.0:1746147188.039503:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4169 00000100:00100000:0.0:1746147188.043132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.043178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.043294:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756160 00000100:00100000:1.0:1746147188.043303:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756160 00000100:00100000:1.0:1746147188.043349:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756288 00000100:00100000:1.0:1746147188.043351:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756288 00000100:00100000:1.0:1746147188.043368:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11705 00000100:00100000:1.0:1746147188.043374:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28920:x1830967463756160:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147188.043390:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.043403:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a7c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.043427:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.043429:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.043432:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.043441:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.043450:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f198a00, rc 0) 00000100:00100000:1.0:1746147188.043486:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28920:x1830967463756160:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.043490:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11706 00000100:00100000:2.0:1746147188.043498:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:28930:x1830967463756288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.043510:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.043520:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a83 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.043532:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.043534:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.043540:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.043551:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.043558:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8400, rc 0) 00000100:00100000:2.0:1746147188.043575:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28930:x1830967463756288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 78us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.043687:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11705 00000100:00100000:2.0:1746147188.043693:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11706 00000100:00100000:2.0:1746147188.044241:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408320:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.044249:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.044256:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466408576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.044275:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3837952->4194303] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 29 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.044284:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8800, rc 0) 00000100:00100000:2.0:1746147188.044315:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28932:x1830967463755776:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7125us (7316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.044320:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11704 00000100:00100000:0.0:1746147188.044724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.044772:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756416 00000100:00100000:2.0:1746147188.044777:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756416 00010000:00010000:2.0:1746147188.044792:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.044813:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5779 00000100:00100000:2.0:1746147188.044817:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463756416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.044825:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.044839:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.044847:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.044862:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d64c00/0xb4b2209fbdac6b15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a3d expref: 11 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.044881:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.045127:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463756416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 308us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.045134:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5779 00000100:00100000:2.0:1746147188.048527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.048555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.048570:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756672 00000100:00100000:2.0:1746147188.048577:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756672 00010000:00010000:2.0:1746147188.048615:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.048647:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5780 00000100:00100000:2.0:1746147188.048653:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463756672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.048665:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.048680:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.048689:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.048705:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6b0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a36 expref: 29 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.048717:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.048745:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463756672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.048751:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5780 00000100:00100000:0.0:1746147188.049168:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756544 00000100:00100000:0.0:1746147188.049172:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756544 00000100:00100000:0.0:1746147188.049199:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11707 00000100:00100000:0.0:1746147188.049204:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463756544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.049214:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.049223:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f540200/0xb4b2209fbdac6b85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a8a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.049238:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f540200/0xb4b2209fbdac6b85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a8a expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.049246:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f540200/0xb4b2209fbdac6b85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a8a expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.049252:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540200, rc 0) 00000100:00100000:0.0:1746147188.049269:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463756544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 65us (749us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.049273:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11707 00000100:00100000:0.0:1746147188.049299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.049336:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463756800 00000100:00100000:0.0:1746147188.049339:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463756800 00000100:00100000:0.0:1746147188.049355:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11708 00000100:00100000:0.0:1746147188.049359:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463756800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.049365:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.049372:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f540000/0xb4b2209fbdac6b8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a91 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.049383:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.049388:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f540000/0xb4b2209fbdac6b8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a91 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.049396:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f540000/0xb4b2209fbdac6b8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a91 expref: 15 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.049403:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f540000, rc 0) 00000100:00100000:0.0:1746147188.049420:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463756800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 60us (120us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.049424:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11708 00000100:00100000:0.0:1746147188.050245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.050563:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757056 00000100:00100000:1.0:1746147188.050567:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757056 00010000:00010000:1.0:1746147188.050582:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.050611:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5781 00000100:00100000:1.0:1746147188.050616:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463757056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.050624:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.050636:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.050645:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.050656:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6aeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a28 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.050677:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.050679:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.050684:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.050690:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.050697:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.050698:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.050700:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.050706:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.050728:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.050736:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466408704:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.050796:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.050804:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466408832:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147188.050821:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.057516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.057616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.057669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.057681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.057901:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466408704:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147188.057910:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466408832:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147188.057935:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.057985:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463757056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7368us (7741us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.057993:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5781 00000100:00100000:2.0:1746147188.058106:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757696 00000100:00100000:2.0:1746147188.058112:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757696 00000100:00100000:2.0:1746147188.058143:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11709 00000100:00100000:2.0:1746147188.058149:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463757696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.058167:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.058180:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac6b93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a98 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.058203:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac6b93 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a98 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.058212:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8a00/0xb4b2209fbdac6b93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a98 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.058223:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8a00, rc 0) 00000100:00100000:3.0:1746147188.058438:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757184 00000100:00100000:3.0:1746147188.058443:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757184 00000100:00100000:3.0:1746147188.058452:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757440 00000100:00100000:3.0:1746147188.058453:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757440 00002000:00100000:3.0:1746147188.058475:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2138112->2142207) req@ffff88009b208e00 x1830967463757440/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.058483:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208e00 with x1830967463757440 ext(2138112->2142207) 00002000:00010000:3.0:1746147188.058486:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208e00 00000100:00100000:3.0:1746147188.058496:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757952 00000100:00100000:3.0:1746147188.058498:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757952 00002000:00100000:3.0:1746147188.058509:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3837952->3842047) req@ffff88009b20a300 x1830967463757952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.058515:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a300 with x1830967463757952 ext(3837952->3842047) 00002000:00010000:3.0:1746147188.058518:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a300 00000100:00100000:3.0:1746147188.058535:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4488 00000100:00100000:3.0:1746147188.058540:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463757440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.058689:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463757696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 540us (1019us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.058694:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11709 00000100:00100000:2.0:1746147188.058712:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4489 00000100:00100000:2.0:1746147188.058717:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463757952:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.059034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.059102:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463757824 00000100:00100000:0.0:1746147188.059106:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463757824 00000100:00100000:0.0:1746147188.059133:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11710 00000100:00100000:0.0:1746147188.059138:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463757824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.059145:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.059153:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xb4b2209fbdac6b9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6a9f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.059186:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466408960:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147188.059232:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.059466:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463757440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 925us (1849us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.059471:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4488 00002000:00100000:3.0:1746147188.059476:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2138112->2142207) req@ffff88009b208e00 x1830967463757440/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.059482:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208e00 with x1830967463757440 ext(2138112->2142207) 00002000:00010000:3.0:1746147188.059485:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208e00 00002000:00100000:3.0:1746147188.059509:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800998e6450 x1830967463757184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.059515:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e6450 with x1830967463757184 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.059518:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800998e6450 00000100:00100000:3.0:1746147188.059532:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4490 00000100:00100000:3.0:1746147188.059541:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463757184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.059565:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463757952:12345-192.168.203.36@tcp:3:cat.0 Request processed in 846us (1880us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147188.059571:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4489 00002000:00100000:2.0:1746147188.059576:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3837952->3842047) req@ffff88009b20a300 x1830967463757952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.059583:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a300 with x1830967463757952 ext(3837952->3842047) 00002000:00010000:2.0:1746147188.059586:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a300 00000100:00100000:0.0:1746147188.064268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.064408:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466408960:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.064434:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xb4b2209fbdac6b9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a9f expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.064446:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xb4b2209fbdac6b9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a9f expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.064455:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541800, rc 0) 00000100:00100000:2.0:1746147188.064496:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463757824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5357us (5462us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.064506:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11710 00000100:00100000:3.0:1746147188.064879:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758208 00000100:00100000:3.0:1746147188.064885:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758208 00000100:00100000:3.0:1746147188.065329:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4170 00000100:00100000:3.0:1746147188.065336:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+32:28920:x1830967463758208:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147188.065470:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28920:x1830967463758208:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 133us (1207us total) trans 8589944269 rc 0/0 00000100:00100000:3.0:1746147188.065476:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4170 00000100:00100000:3.0:1746147188.066862:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463757184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7315us (9347us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147188.066871:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4490 00002000:00100000:3.0:1746147188.066880:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800998e6450 x1830967463757184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.066889:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e6450 with x1830967463757184 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.066893:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800998e6450 00000100:00100000:0.0:1746147188.074858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.074895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.074990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.075208:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758464 00000100:00100000:2.0:1746147188.075218:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758464 00000100:00100000:2.0:1746147188.075266:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758336 00000100:00100000:2.0:1746147188.075268:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758336 00000100:00100000:2.0:1746147188.075280:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758592 00000100:00100000:2.0:1746147188.075281:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758592 00000100:00100000:2.0:1746147188.075294:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11711 00000100:00100000:2.0:1746147188.075301:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463758464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.075317:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.075331:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6ba1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6aad expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.075374:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466409088:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.075431:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.075446:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11712 00000100:00100000:2.0:1746147188.075451:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463758336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.075458:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.075467:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6ba8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6aa6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075483:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6ba8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aa6 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.075493:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6ba8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aa6 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.075508:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9800, rc 0) 00000100:00100000:2.0:1746147188.075528:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463758336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.075534:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11712 00000100:00100000:2.0:1746147188.075547:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11713 00000100:00100000:2.0:1746147188.075551:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28932:x1830967463758592:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.075556:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.075561:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ab4 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075575:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075582:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075587:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147188.075588:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147188.075604:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4202495] (req 4194304->4202495) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075620:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075630:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.075638:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409216:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.075663:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 13 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.075670:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 13 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.075677:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409344:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.075692:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.078820:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466409088:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.078848:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6ba1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aad expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.078860:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6ba1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aad expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.078870:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9e00, rc 0) 00000100:00100000:2.0:1746147188.078909:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463758464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3608us (4059us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.078916:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11711 00000100:00100000:3.0:1746147188.079021:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409216:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.079030:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409344:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.079046:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4202495] (req 4194304->4202495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.079055:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9200, rc 0) 00000100:00100000:3.0:1746147188.079072:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28932:x1830967463758592:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3521us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.079077:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11713 00000100:00100000:1.0:1746147188.082727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.082760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.082837:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758720 00000100:00100000:3.0:1746147188.082846:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758720 00010000:00010000:3.0:1746147188.082879:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.082953:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758848 00000100:00100000:3.0:1746147188.082956:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758848 00010000:00010000:3.0:1746147188.082967:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.083116:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5782 00000100:00100000:1.0:1746147188.083121:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5783 00000100:00100000:0.0:1746147188.083125:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463758720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147188.083127:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463758848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.083136:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.083136:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.083152:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.083152:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.083162:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.083281:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.083299:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6b7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a83 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.083302:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xb4b2209fbdac6b54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4927487) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a67 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.083321:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.083323:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.083328:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.083338:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.083610:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147188.083627:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.083638:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466409472:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147188.083653:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463758720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 530us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.083659:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5782 00000100:00100000:1.0:1746147188.083680:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.086807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.086905:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463758976 00000100:00100000:0.0:1746147188.086914:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463758976 00000100:00100000:0.0:1746147188.086983:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11714 00000100:00100000:0.0:1746147188.086991:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:28930:x1830967463758976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.087007:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.087020:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6abb expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.087044:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.087051:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.087052:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.087055:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4923392->5242879] (req 4923392->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.087346:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.087356:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.087366:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409600:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.088140:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.090669:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466409472:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.090693:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.090829:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463758848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7699us (8065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.090838:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5783 00000100:00100000:1.0:1746147188.091235:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466409600:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.091253:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4923392->5242879] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.091267:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1000, rc 0) 00000100:00100000:1.0:1746147188.091453:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28930:x1830967463758976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4461us (4652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.091459:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11714 00000100:00100000:0.0:1746147188.092683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.092930:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463759232 00000100:00100000:3.0:1746147188.092959:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463759232 00002000:00100000:3.0:1746147188.092993:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4198400->4202495) req@ffff88009a80ea00 x1830967463759232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.093001:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ea00 with x1830967463759232 ext(4198400->4202495) 00010000:00010000:3.0:1746147188.093008:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.093019:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.093025:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a80ea00 00000100:00100000:3.0:1746147188.093042:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1534 00000100:00100000:3.0:1746147188.093053:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463759232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.093196:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463759232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 147us (516us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.093202:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1534 00002000:00100000:3.0:1746147188.093207:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4198400->4202495) req@ffff88009a80ea00 x1830967463759232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.093214:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ea00 with x1830967463759232 ext(4198400->4202495) 00010000:00010000:3.0:1746147188.093218:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.093230:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.093235:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a80ea00 00000100:00100000:0.0:1746147188.096211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.096260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.096286:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463759488 00000100:00100000:0.0:1746147188.096293:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463759488 00002000:00100000:0.0:1746147188.096326:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4202495) req@ffff88009a80ca80 x1830967463759488/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 8680/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.096334:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ca80 with x1830967463759488 ext(4194304->4202495) 00010000:00010000:0.0:1746147188.096342:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.096353:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:0.0:1746147188.096363:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a80ca80 00000100:00100000:0.0:1746147188.096394:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1535 00000100:00100000:0.0:1746147188.096401:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463759488:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.096694:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463759488:12345-192.168.203.36@tcp:4:cat.0 Request processed in 293us (432us total) trans 21474840635 rc 0/0 00000100:00100000:0.0:1746147188.096700:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1535 00002000:00100000:0.0:1746147188.096706:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4202495) req@ffff88009a80ca80 x1830967463759488/t21474840635(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 8680/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.096712:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ca80 with x1830967463759488 ext(4194304->4202495) 00010000:00010000:0.0:1746147188.096716:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.096724:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:0.0:1746147188.096729:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a80ca80 00000100:00100000:1.0:1746147188.096908:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463759744 00000100:00100000:1.0:1746147188.096913:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463759744 00000100:00100000:1.0:1746147188.096959:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4171 00000100:00100000:1.0:1746147188.096965:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:28932:x1830967463759744:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147188.097079:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:28932:x1830967463759744:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 115us (875us total) trans 8589944270 rc 0/0 00000100:00100000:1.0:1746147188.097084:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4171 00000100:00100000:0.0:1746147188.100482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.100822:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463759872 00000100:00100000:1.0:1746147188.100831:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463759872 00010000:00010000:1.0:1746147188.100859:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.100895:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5784 00000100:00100000:1.0:1746147188.100903:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463759872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.100915:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.100932:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.100958:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.100976:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac6baf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4202495) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ab4 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.103096:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.103100:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.103110:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.103119:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.103158:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.103169:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466409728:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147188.103251:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.106798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.106878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.106968:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466409728:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.106990:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.107028:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463759872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6125us (6553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.107037:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5784 00000100:00100000:2.0:1746147188.107970:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760000 00000100:00100000:2.0:1746147188.107976:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760000 00000100:00100000:2.0:1746147188.108010:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760128 00000100:00100000:2.0:1746147188.108013:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760128 00000100:00100000:2.0:1746147188.108562:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11715 00000100:00100000:2.0:1746147188.108569:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463760000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.108584:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.108606:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6bbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ac2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.108631:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6bbd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ac2 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.108640:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac6bbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ac2 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.108651:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9e00, rc 0) 00000100:00100000:1.0:1746147188.108735:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11716 00000100:00100000:1.0:1746147188.108741:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463760128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.108748:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.108755:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac6bc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ac9 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.108783:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466409856:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.108968:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463760000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 398us (2177us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.108972:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11715 00000100:00100000:1.0:1746147188.109268:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.110919:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466409856:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.110971:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac6bc4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ac9 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.110982:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f199000/0xb4b2209fbdac6bc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ac9 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.111002:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199000, rc 0) 00000100:00100000:1.0:1746147188.111037:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463760128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2295us (4159us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.111043:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11716 00000100:00100000:2.0:1746147188.112383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.112812:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760384 00000100:00100000:3.0:1746147188.112819:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760384 00002000:00100000:3.0:1746147188.112850:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4923392->4927487) req@ffff88009f76b100 x1830967463760384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.112858:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b100 with x1830967463760384 ext(4923392->4927487) 00002000:00010000:3.0:1746147188.112861:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b100 00000100:00100000:3.0:1746147188.112886:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4491 00000100:00100000:3.0:1746147188.112894:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463760384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.113046:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463760384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 153us (664us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.113052:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4491 00002000:00100000:3.0:1746147188.113057:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4923392->4927487) req@ffff88009f76b100 x1830967463760384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.113062:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b100 with x1830967463760384 ext(4923392->4927487) 00002000:00010000:3.0:1746147188.113065:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b100 00000100:00100000:0.0:1746147188.197006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.197169:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760640 00000100:00100000:2.0:1746147188.197179:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760640 00000100:00100000:2.0:1746147188.197414:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10520 00000100:00100000:2.0:1746147188.197423:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:28939:x1830967463760640:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.197552:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.197566:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6bcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ad0 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.197651:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.197666:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147188.197676:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147188.197685:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147188.197779:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac6bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 36 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.197806:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 35 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.197813:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147188.197815:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147188.197818:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9800, rc 0) 00000100:00100000:2.0:1746147188.198091:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:28939:x1830967463760640:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 668us (1092us total) trans 8589944271 rc 0/0 00000100:00100000:2.0:1746147188.198098:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10520 00000100:00100000:0.0:1746147188.213261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.213537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.213626:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760768 00000100:00100000:3.0:1746147188.213635:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760768 00000100:00100000:3.0:1746147188.213723:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463760896 00000100:00100000:3.0:1746147188.213726:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463760896 00000100:00100000:1.0:1746147188.213728:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11717 00000100:00100000:1.0:1746147188.213737:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463760768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.213752:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.213766:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6be0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ad7 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.213792:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6be0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad7 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.213802:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f199a00/0xb4b2209fbdac6be0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad7 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147188.213811:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11718 00000100:00100000:3.0:1746147188.213817:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463760896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.213823:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.213829:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199a00, rc 0) 00010000:00010000:3.0:1746147188.213831:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14da00/0xb4b2209fbdac6be7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ade expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.213862:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466409984:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.213863:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463760768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 129us (612us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.213869:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11717 00000100:00100000:3.0:1746147188.214409:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.214767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.215495:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761024 00000100:00100000:0.0:1746147188.215503:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761024 00000100:00100000:0.0:1746147188.215541:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11719 00000100:00100000:0.0:1746147188.215548:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28939:x1830967463761024:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147188.215559:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.215569:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ae5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.215599:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.215606:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.215613:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.215618:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.215620:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.215623:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1970176->2097151] (req 1970176->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.215643:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 16 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.215652:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 16 pid: 21080 timeout: 675 lvb_type: 1 00000100:00100000:0.0:1746147188.215662:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410112:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147188.215732:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.215740:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 9 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:0.0:1746147188.215752:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410240:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147188.215777:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.215790:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 27 pid: 21080 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.215797:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410368:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.215813:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.221448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.221466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.221666:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466409984:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.221691:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f14da00/0xb4b2209fbdac6be7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ade expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.221703:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f14da00/0xb4b2209fbdac6be7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ade expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147188.222172:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761280 00000100:00100000:1.0:1746147188.222179:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761280 00000100:00100000:0.0:1746147188.222202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147188.222215:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 17 pid: 21080 timeout: 675 lvb_type: 1 00000100:00100000:0.0:1746147188.222218:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761152 00000100:00100000:0.0:1746147188.222221:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761152 00010000:00010000:0.0:1746147188.222235:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:1.0:1746147188.222237:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761408 00000100:00100000:1.0:1746147188.222239:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761408 00010000:00010000:1.0:1746147188.222248:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 28 pid: 21080 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.222252:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5785 00000100:00100000:0.0:1746147188.222258:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463761280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147188.222262:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5786 00000100:00100000:1.0:1746147188.222267:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463761152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.222269:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.222273:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147188.222278:0:8494:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746147188.222282:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 17 pid: 21080 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.222283:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:0.0:1746147188.222290:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 17 pid: 21080 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.222298:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.222447:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5787 00000100:00100000:2.0:1746147188.222455:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463761408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.222462:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.222485:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14da00, rc 0) 00000100:00100000:3.0:1746147188.222523:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463760896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8706us (8987us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.222530:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11718 00000100:00100000:3.0:1746147188.222672:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.222680:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410240:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.222687:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410368:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147188.222726:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea18400/0xb4b2209fbdac6637 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6765 expref: 15 pid: 21080 timeout: 675 lvb_type: 1 00010000:00010000:0.0:1746147188.222741:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.222759:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463761280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 501us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.222764:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5785 00010000:00010000:1.0:1746147188.223068:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092910a00/0xb4b2209fbdac66a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67ab expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.223081:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.223099:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463761152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 832us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.223107:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5786 00010000:00010000:3.0:1746147188.223805:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1970176->2097151] (req 1970176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.223820:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1400, rc 0) 00000100:00100000:3.0:1746147188.223841:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28939:x1830967463761024:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8294us (9075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.223847:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11719 00010000:00010000:2.0:1746147188.224303:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 28 pid: 21080 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.224314:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 28 pid: 21080 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.224328:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e9dcc00/0xb4b2209fbdac65c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6742 expref: 28 pid: 21080 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.224345:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.224347:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.224352:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.224359:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.224385:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.224395:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466410496:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.224452:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.229687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.229755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.229858:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466410496:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.229881:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.229921:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463761408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7467us (7719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.229934:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5787 00000100:00100000:1.0:1746147188.230097:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761792 00000100:00100000:1.0:1746147188.230104:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761792 00002000:00100000:1.0:1746147188.230135:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1970176->1974271) req@ffff88009e585c00 x1830967463761792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.230143:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585c00 with x1830967463761792 ext(1970176->1974271) 00002000:00010000:1.0:1746147188.230146:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585c00 00000100:00100000:1.0:1746147188.230162:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4492 00000100:00100000:1.0:1746147188.230168:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463761792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.230444:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463761792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 275us (687us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147188.230449:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4492 00002000:00100000:1.0:1746147188.230453:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1970176->1974271) req@ffff88009e585c00 x1830967463761792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.230459:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585c00 with x1830967463761792 ext(1970176->1974271) 00002000:00010000:1.0:1746147188.230461:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e585c00 00000100:00100000:3.0:1746147188.230929:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463761536 00000100:00100000:3.0:1746147188.230933:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463761536 00000100:00100000:3.0:1746147188.230994:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11720 00000100:00100000:3.0:1746147188.230999:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28942:x1830967463761536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.231007:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.231019:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6aec expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.231038:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.231083:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.231085:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.231088:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.231109:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.231119:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 14 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.231132:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410624:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.232988:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.238613:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466410624:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.238639:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.238655:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14d000, rc 0) 00000100:00100000:3.0:1746147188.238703:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28942:x1830967463761536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7702us (9023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.238711:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11720 00000100:00100000:0.0:1746147188.239474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.239721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.240484:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762048 00000100:00100000:3.0:1746147188.240491:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762048 00000100:00100000:2.0:1746147188.240748:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762176 00000100:00100000:2.0:1746147188.240752:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762176 00002000:00100000:2.0:1746147188.240778:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1970176->2097151) req@ffff88009e585880 x1830967463762176/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.240793:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585880 with x1830967463762176 ext(1970176->2097151) 00010000:00010000:2.0:1746147188.240800:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 14 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.240812:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 14 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.240819:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e585880 00000100:00100000:3.0:1746147188.240845:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11721 00000100:00100000:3.0:1746147188.240853:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28939:x1830967463762048:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147188.240864:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.240876:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6af3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.240896:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.240904:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.240915:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.240921:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.240922:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.240925:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.240960:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 19 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.240969:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 19 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.240980:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466410752:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.241034:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.241042:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 11 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.241050:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466410880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.241067:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.241079:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.241086:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411008:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.241097:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.243539:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1536 00000100:00100000:2.0:1746147188.243553:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463762176:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147188.249197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.251246:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466410880:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.252416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.253669:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463762176:12345-192.168.203.36@tcp:4:cat.0 Request processed in 10120us (13946us total) trans 17179873229 rc 0/0 00000100:00100000:2.0:1746147188.253679:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1536 00002000:00100000:2.0:1746147188.253690:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1970176->2097151) req@ffff88009e585880 x1830967463762176/t17179873229(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.253698:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e585880 with x1830967463762176 ext(1970176->2097151) 00010000:00010000:2.0:1746147188.253706:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.253717:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.253723:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e585880 00000100:00100000:3.0:1746147188.253793:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762688 00000100:00100000:3.0:1746147188.253799:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762688 00000100:00100000:3.0:1746147188.253830:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10521 00000100:00100000:3.0:1746147188.253836:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:28944:x1830967463762688:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147188.253850:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.253862:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14d200/0xb4b2209fbdac6c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6afa expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.253929:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147188.253956:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147188.253964:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147188.253972:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147188.254032:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14d200/0xb4b2209fbdac6c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 323 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.254062:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 322 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.254070:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.254072:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147188.254074:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14c400, rc 0) 00000100:00100000:3.0:1746147188.254094:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+322:28944:x1830967463762688:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 258us (1680us total) trans 8589944272 rc 0/0 00000100:00100000:3.0:1746147188.254099:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10521 00000100:00100000:1.0:1746147188.254696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.254724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.254742:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762304 00000100:00100000:1.0:1746147188.254745:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762304 00010000:00010000:1.0:1746147188.254762:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 12 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:1.0:1746147188.254776:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762432 00000100:00100000:1.0:1746147188.254778:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762432 00010000:00010000:1.0:1746147188.254787:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.254798:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463762816 00000100:00100000:1.0:1746147188.254799:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463762816 00010000:00010000:1.0:1746147188.254806:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 20 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:1.0:1746147188.254817:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5788 00000100:00100000:1.0:1746147188.254822:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463762304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.254830:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147188.254842:0:8494:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:1.0:1746147188.254846:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 12 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.254854:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 12 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.254867:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0xb4b2209fbdac66ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e67b2 expref: 12 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.254879:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.254895:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463762304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 73us (5705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.254901:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5788 00000100:00100000:1.0:1746147188.254914:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5789 00000100:00100000:1.0:1746147188.254918:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463762432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.254924:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.254931:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.254955:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.254965:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.254978:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463762432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.254982:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5789 00000100:00100000:1.0:1746147188.254991:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5790 00000100:00100000:1.0:1746147188.254995:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463762816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.255000:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.255006:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 20 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.255014:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 20 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.255023:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.255025:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.255030:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.255036:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.255060:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.255070:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466411136:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147188.255116:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147188.255178:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac6653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6788 expref: 20 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:1.0:1746147188.255186:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466410752:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.255194:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092911200/0xb4b2209fbdac6645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e677a expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.255200:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411008:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.255220:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.255227:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14ce00, rc 0) 00000100:00100000:1.0:1746147188.255243:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28939:x1830967463762048:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 14392us (15772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.255248:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11721 00000100:00100000:1.0:1746147188.258774:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466411136:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.258796:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.258845:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463762816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3848us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.258854:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5790 00000100:00100000:0.0:1746147188.259370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.259415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.259420:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763072 00000100:00100000:2.0:1746147188.259427:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763072 00002000:00100000:2.0:1746147188.259462:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1146880->1150975) req@ffff88009e587100 x1830967463763072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.259471:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967463763072 ext(1146880->1150975) 00000100:00100000:1.0:1746147188.259471:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763200 00000100:00100000:1.0:1746147188.259474:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763200 00002000:00010000:2.0:1746147188.259475:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00010000:00010000:1.0:1746147188.259487:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.259488:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4493 00000100:00100000:2.0:1746147188.259494:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463763072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.259501:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5791 00000100:00100000:1.0:1746147188.259504:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463763200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.259510:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147188.259523:0:8494:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147185 -> 1746147188 00002000:00010000:1.0:1746147188.259525:0:8494:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147185 -> 1746147188 00010000:00010000:1.0:1746147188.259530:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.259539:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.259557:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6bee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1970176->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ae5 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.259568:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.259570:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.259575:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.259582:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.259619:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.259629:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466411264:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.259632:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463763072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 138us (266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147188.259637:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4493 00002000:00100000:2.0:1746147188.259641:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1146880->1150975) req@ffff88009e587100 x1830967463763072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.259647:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587100 with x1830967463763072 ext(1146880->1150975) 00002000:00010000:2.0:1746147188.259650:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587100 00000100:00100000:1.0:1746147188.259672:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.265819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.265857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.265958:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466411264:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.265980:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.266015:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463763200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6508us (6598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.266024:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5791 00000100:00100000:2.0:1746147188.266344:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763456 00000100:00100000:2.0:1746147188.266350:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763456 00002000:00100000:2.0:1746147188.266381:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009e584700 x1830967463763456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.266389:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967463763456 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.266393:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584700 00000100:00100000:2.0:1746147188.266405:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763712 00000100:00100000:2.0:1746147188.266407:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763712 00002000:00100000:2.0:1746147188.266417:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1150976->2097151) req@ffff88009e584e00 x1830967463763712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.266424:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967463763712 ext(1150976->2097151) 00002000:00010000:2.0:1746147188.266427:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:2.0:1746147188.266436:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4494 00000100:00100000:2.0:1746147188.266442:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463763456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.267143:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4495 00000100:00100000:3.0:1746147188.267150:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463763712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.293018:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463763712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25859us (27150us total) trans 0 rc 946176/946176 00000100:00100000:3.0:1746147188.293030:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4495 00002000:00100000:3.0:1746147188.293042:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1150976->2097151) req@ffff88009e584e00 x1830967463763712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.293931:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584e00 with x1830967463763712 ext(1150976->2097151) 00002000:00010000:3.0:1746147188.293954:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e584e00 00000100:00100000:2.0:1746147188.295304:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463763456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 28853us (29483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.295315:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4494 00002000:00100000:2.0:1746147188.295326:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009e584700 x1830967463763456/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.295334:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584700 with x1830967463763456 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.295338:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e584700 00000100:00100000:0.0:1746147188.312664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.312732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.312886:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763840 00000100:00100000:1.0:1746147188.312897:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763840 00000100:00100000:1.0:1746147188.312964:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463763968 00000100:00100000:1.0:1746147188.312967:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463763968 00000100:00100000:1.0:1746147188.313010:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11722 00000100:00100000:1.0:1746147188.313020:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463763840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.313043:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.313058:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6c18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b01 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.313087:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6c18 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b01 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.313098:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6c18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b01 expref: 14 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.313117:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85aca00, rc 0) 00000100:00100000:1.0:1746147188.313178:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463763840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 159us (522us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.313184:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11722 00000100:00100000:1.0:1746147188.313201:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11723 00000100:00100000:1.0:1746147188.313207:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463763968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.313215:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.313224:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6c1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b08 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.313261:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466411392:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.313330:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.316625:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466411392:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147188.316668:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6c1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b08 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.316685:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6c1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b08 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.316718:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85acc00, rc 0) 00000100:00100000:0.0:1746147188.316768:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463763968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3560us (4035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.316775:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11723 00000100:00100000:0.0:1746147188.320889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.321088:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764096 00000100:00100000:2.0:1746147188.321097:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764096 00000100:00100000:2.0:1746147188.321509:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11724 00000100:00100000:2.0:1746147188.321518:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:28942:x1830967463764096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.321532:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.321547:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b0f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.321570:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.321576:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.321577:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.321580:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.321624:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 14 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.321634:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.321645:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411520:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.322123:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.323904:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.323925:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.323957:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a8600, rc 0) 00000100:00100000:2.0:1746147188.323992:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28942:x1830967463764096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2475us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.323999:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11724 00000100:00100000:0.0:1746147188.327096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.327185:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764224 00000100:00100000:2.0:1746147188.327194:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764224 00002000:00100000:2.0:1746147188.327230:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2416640->3145727) req@ffff88009e587b80 x1830967463764224/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.327238:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967463764224 ext(2416640->3145727) 00010000:00010000:2.0:1746147188.327246:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.327261:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 14 pid: 8478 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.327266:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e587b80 00000100:00100000:2.0:1746147188.327295:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1537 00000100:00100000:2.0:1746147188.327302:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463764224:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.330925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.331108:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764352 00000100:00100000:2.0:1746147188.331117:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764352 00000100:00100000:2.0:1746147188.331221:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11725 00000100:00100000:2.0:1746147188.331228:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28944:x1830967463764352:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.331243:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.331257:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b16 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.331281:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.331288:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.331293:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.331298:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.331300:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.331304:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [901120->1048575] (req 901120->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.331327:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.331336:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.331347:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411648:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.332480:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.332492:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 15 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.332501:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411776:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.332536:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.332544:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.332551:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.332563:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.340743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.340778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.340818:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411648:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.340827:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411776:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.340833:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466411904:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.340857:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [901120->1048575] (req 901120->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.340871:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344200, rc 0) 00000100:00100000:2.0:1746147188.340905:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28944:x1830967463764352:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9677us (9988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.340911:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11725 00000100:00100000:2.0:1746147188.341021:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764608 00000100:00100000:2.0:1746147188.341027:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764608 00010000:00010000:2.0:1746147188.341048:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.341066:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764480 00000100:00100000:2.0:1746147188.341068:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764480 00010000:00010000:2.0:1746147188.341080:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 16 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.341094:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5792 00000100:00100000:2.0:1746147188.341101:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463764608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.341112:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.341130:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.341142:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.341160:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f20a00/0xb4b2209fbdac63dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6607 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.341179:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.341196:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463764608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.341200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.341201:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5792 00000100:00100000:2.0:1746147188.341210:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764736 00000100:00100000:2.0:1746147188.341212:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764736 00010000:00010000:2.0:1746147188.341220:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.341233:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5793 00000100:00100000:2.0:1746147188.341237:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463764480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.341243:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147188.341366:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5794 00000100:00100000:1.0:1746147188.341372:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967463764736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.341378:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.341386:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.341393:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.341402:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e17c600/0xb4b2209fbdac64b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6654 expref: 20 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.341430:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.341448:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463764736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.341452:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5794 00010000:00010000:2.0:1746147188.343795:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 16 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.343808:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 16 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.343825:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e17d000/0xb4b2209fbdac64e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6685 expref: 16 pid: 6881 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.343844:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.343912:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.343918:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.343925:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.343971:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.343983:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466412032:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.344050:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.346670:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466412032:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.346693:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.347866:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5843050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463764480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6623us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.347876:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5793 00000100:00100000:3.0:1746147188.347897:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463764224:12345-192.168.203.36@tcp:4:cat.0 Request processed in 20595us (20807us total) trans 21474840636 rc 0/0 00000100:00100000:3.0:1746147188.347904:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1537 00002000:00100000:3.0:1746147188.347914:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2416640->3145727) req@ffff88009e587b80 x1830967463764224/t21474840636(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.347928:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587b80 with x1830967463764224 ext(2416640->3145727) 00010000:00010000:3.0:1746147188.347951:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 16 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.347963:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 16 pid: 8478 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.347969:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e587b80 00000100:00100000:0.0:1746147188.348994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.349054:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463764992 00000100:00100000:3.0:1746147188.349061:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463764992 00002000:00100000:3.0:1746147188.349088:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (901120->905215) req@ffff88009e587800 x1830967463764992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.349096:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587800 with x1830967463764992 ext(901120->905215) 00002000:00010000:3.0:1746147188.349099:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587800 00000100:00100000:3.0:1746147188.349111:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4496 00000100:00100000:3.0:1746147188.349116:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463764992:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147188.349421:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463764992:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 302us (428us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.349427:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4496 00002000:00100000:3.0:1746147188.349431:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (901120->905215) req@ffff88009e587800 x1830967463764992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.349437:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e587800 with x1830967463764992 ext(901120->905215) 00002000:00010000:3.0:1746147188.349440:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e587800 00000100:00100000:0.0:1746147188.352323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.352348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.352368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.352379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.352395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.352414:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765248 00000100:00100000:0.0:1746147188.352422:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765248 00000100:00100000:0.0:1746147188.352455:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765504 00000100:00100000:0.0:1746147188.352457:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765504 00000100:00100000:0.0:1746147188.352466:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765760 00000100:00100000:0.0:1746147188.352467:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765760 00000100:00100000:0.0:1746147188.352474:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765376 00000100:00100000:0.0:1746147188.352475:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765376 00000100:00100000:0.0:1746147188.352481:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765632 00000100:00100000:0.0:1746147188.352482:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765632 00000100:00100000:0.0:1746147188.352493:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11726 00000100:00100000:0.0:1746147188.352500:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463765248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.352514:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.352528:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b1d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352544:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.352546:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.352552:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352564:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 30 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352573:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0c00, rc 0) 00000100:00100000:0.0:1746147188.352611:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463765248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.352616:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11726 00000100:00100000:0.0:1746147188.352627:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11727 00000100:00100000:0.0:1746147188.352631:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463765504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.352637:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.352643:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6c3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b2b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352656:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6c3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b2b expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352667:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d0e00/0xb4b2209fbdac6c3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b2b expref: 21 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352676:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0e00, rc 0) 00000100:00100000:0.0:1746147188.352686:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463765504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (338us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.352690:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11727 00000100:00100000:0.0:1746147188.352697:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11728 00000100:00100000:0.0:1746147188.352700:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28944:x1830967463765760:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147188.352705:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.352709:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b39 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352720:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352727:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352733:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352737:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.352738:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.352740:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352761:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352770:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 30 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.352779:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412160:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147188.352826:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 8 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.352832:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 8 pid: 8481 timeout: 675 lvb_type: 1 00000100:00100000:0.0:1746147188.352838:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412288:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147188.352854:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.352860:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 14 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.352866:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412416:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.352876:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.352891:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11729 00000100:00100000:0.0:1746147188.352895:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463765376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.352901:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.352906:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5647000/0xb4b2209fbdac6c49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b24 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.352924:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466412544:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147188.352971:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.353004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.353022:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463765120 00000100:00100000:0.0:1746147188.353025:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463765120 00010000:00010000:0.0:1746147188.353037:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.353053:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5795 00000100:00100000:0.0:1746147188.353057:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463765120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.353064:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147188.353079:0:7121:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147187 -> 1746147188 00010000:00010000:0.0:1746147188.353084:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.353091:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.353103:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac6b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2416640->3145727] (req 2416640->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a44 expref: 15 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.353110:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.353112:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.353116:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.353121:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.353137:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.353144:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466412672:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147188.353164:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.353288:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11730 00000100:00100000:2.0:1746147188.353294:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463765632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.353301:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.353307:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136966800/0xb4b2209fbdac6c50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b32 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.353327:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466412800:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.353349:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00002000:00010000:2.0:1746147188.358391:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147187 -> 1746147188 00002000:00010000:2.0:1746147188.358398:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147187 -> 1746147188 00000100:00100000:2.0:1746147188.358419:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466412800:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.358445:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136966800/0xb4b2209fbdac6c50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b32 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.358456:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136966800/0xb4b2209fbdac6c50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b32 expref: 31 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147188.358505:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412160:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.358512:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412288:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.358519:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466412416:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.358536:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 30 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.358546:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1400, rc 0) 00000100:00100000:1.0:1746147188.358586:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28944:x1830967463765760:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5883us (6215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.358603:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11728 00000100:00100000:1.0:1746147188.358658:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466412672:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147188.358666:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.358680:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463765120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5623us (5676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.358686:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5795 00000100:00100000:1.0:1746147188.358748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147188.358786:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147186 -> 1746147188 00002000:00010000:0.0:1746147188.358789:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147185 -> 1746147188 00002000:00010000:0.0:1746147188.358790:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147186 -> 1746147188 00000100:00100000:0.0:1746147188.358801:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466412544:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147188.358814:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5647000/0xb4b2209fbdac6c49 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b24 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.358821:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5647000/0xb4b2209fbdac6c49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b24 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.358827:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5647000, rc 0) 00000100:00100000:0.0:1746147188.358843:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463765376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5947us (6463us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.358848:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11729 00000100:00100000:3.0:1746147188.359257:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766144 00000100:00100000:3.0:1746147188.359264:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766144 00002000:00100000:3.0:1746147188.359292:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b209c00 x1830967463766144/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.359300:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209c00 with x1830967463766144 ext(2097152->3145727) 00002000:00010000:3.0:1746147188.359303:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209c00 00000100:00100000:3.0:1746147188.359316:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4497 00000100:00100000:3.0:1746147188.359321:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463766144:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147188.360561:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966800, rc 0) 00000100:00100000:2.0:1746147188.360607:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463765632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7312us (8209us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.360613:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11730 00000100:00100000:0.0:1746147188.360916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.360932:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766272 00000100:00100000:0.0:1746147188.360950:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766272 00010000:00010000:0.0:1746147188.360971:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 9 pid: 8481 timeout: 675 lvb_type: 1 00000100:00100000:0.0:1746147188.360998:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5796 00000100:00100000:0.0:1746147188.361003:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463766272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.361013:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.361027:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 9 pid: 8481 timeout: 675 lvb_type: 1 00010000:00010000:0.0:1746147188.361036:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 9 pid: 8481 timeout: 675 lvb_type: 1 00010000:00010000:0.0:1746147188.361055:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013673e000/0xb4b2209fbdac6a2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e69bf expref: 9 pid: 8481 timeout: 675 lvb_type: 1 00010000:00010000:0.0:1746147188.361065:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.361083:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463766272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.361087:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5796 00000100:00100000:0.0:1746147188.361124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.361135:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766016 00000100:00100000:0.0:1746147188.361138:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766016 00010000:00010000:0.0:1746147188.361301:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 29 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.361338:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5797 00000100:00100000:0.0:1746147188.361343:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463766016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.361349:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.361355:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 29 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.361362:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 29 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.361371:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b385a00/0xb4b2209fbdac698d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e694f expref: 29 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.361377:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.361389:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463766016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.361393:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5797 00000100:00100000:0.0:1746147188.362617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.362701:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766400 00000100:00100000:2.0:1746147188.362706:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766400 00010000:00010000:2.0:1746147188.362722:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 15 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.362738:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5798 00000100:00100000:2.0:1746147188.362743:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463766400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.362924:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.362947:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 15 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.362957:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 15 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.362971:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f31de00/0xb4b2209fbdac6971 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6933 expref: 15 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.362981:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.362982:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.362988:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.362995:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.363019:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 27 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.363027:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466412928:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.363803:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.371268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.371339:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466412928:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.371355:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.371402:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463766400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8658us (8786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.371410:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5798 00000100:00100000:2.0:1746147188.372209:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766656 00000100:00100000:2.0:1746147188.372215:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766656 00002000:00100000:2.0:1746147188.372247:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x416:0x0] (0->901119) req@ffff88008fc97b80 x1830967463766656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.372260:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97b80 with x1830967463766656 ext(0->901119) 00002000:00010000:2.0:1746147188.372264:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc97b80 00000100:00100000:2.0:1746147188.372374:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4498 00000100:00100000:2.0:1746147188.372381:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463766656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.372700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.372743:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463766912 00000100:00100000:0.0:1746147188.372746:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463766912 00002000:00100000:0.0:1746147188.372762:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1519616->1523711) req@ffff88009b209500 x1830967463766912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.372769:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463766912 ext(1519616->1523711) 00002000:00010000:0.0:1746147188.372772:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209500 00000100:00100000:0.0:1746147188.372791:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4499 00000100:00100000:0.0:1746147188.372796:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463766912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.372890:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463766912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 93us (193us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147188.372898:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4499 00002000:00100000:0.0:1746147188.372903:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1519616->1523711) req@ffff88009b209500 x1830967463766912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.372909:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463766912 ext(1519616->1523711) 00002000:00010000:0.0:1746147188.372912:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b209500 00000100:00100000:3.0:1746147188.373013:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463766144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13690us (14265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147188.373019:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4497 00002000:00100000:3.0:1746147188.373024:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b209c00 x1830967463766144/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.373031:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209c00 with x1830967463766144 ext(2097152->3145727) 00002000:00010000:3.0:1746147188.373035:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209c00 00000100:00100000:0.0:1746147188.382009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.382069:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767040 00000100:00100000:2.0:1746147188.382078:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767040 00000100:00100000:2.0:1746147188.382116:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11731 00000100:00100000:2.0:1746147188.382123:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:28942:x1830967463767040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.382138:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.382152:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b40 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382175:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382181:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382186:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147188.382187:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147188.382190:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382214:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382230:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 27 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.382241:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413056:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.382316:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.382324:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 15 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.382332:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413184:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.382350:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.385821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.385880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.385970:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413056:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.385979:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413184:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.385992:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463766656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13610us (14731us total) trans 0 rc 901120/901120 00010000:00010000:3.0:1746147188.386001:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.386002:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4498 00002000:00100000:2.0:1746147188.386011:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x416:0x0] (0->901119) req@ffff88008fc97b80 x1830967463766656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147188.386014:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966200, rc 0) 00002000:00100000:2.0:1746147188.386019:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97b80 with x1830967463766656 ext(0->901119) 00002000:00010000:2.0:1746147188.386023:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc97b80 00000100:00100000:3.0:1746147188.386028:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28942:x1830967463767040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3907us (4028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.386033:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11731 00000100:00100000:2.0:1746147188.386040:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767296 00000100:00100000:2.0:1746147188.386045:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767296 00002000:00100000:2.0:1746147188.386066:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2142207) req@ffff88009b20b480 x1830967463767296/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.386079:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463767296 ext(2097152->2142207) 00010000:00010000:2.0:1746147188.386083:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 15 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.386091:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 15 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.386096:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b480 00000100:00100000:2.0:1746147188.386106:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767168 00000100:00100000:2.0:1746147188.386108:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767168 00002000:00100000:2.0:1746147188.386116:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3837952->4194303) req@ffff88009b20bb80 x1830967463767168/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.386121:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967463767168 ext(3837952->4194303) 00010000:00010000:2.0:1746147188.386124:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 28 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.386131:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 28 pid: 8478 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.386135:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20bb80 00000100:00100000:2.0:1746147188.386150:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1538 00000100:00100000:3.0:1746147188.386154:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1539 00000100:00100000:2.0:1746147188.386155:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463767296:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147188.386158:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463767168:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147188.389005:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463767296:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2841us (3182us total) trans 17179873230 rc 0/0 00000100:00100000:2.0:1746147188.389014:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1538 00002000:00100000:2.0:1746147188.389024:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2142207) req@ffff88009b20b480 x1830967463767296/t17179873230(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.389032:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463767296 ext(2097152->2142207) 00010000:00010000:2.0:1746147188.389040:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.389050:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.389056:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b480 00000100:00100000:0.0:1746147188.392992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.392993:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463767168:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6824us (7102us total) trans 17179873231 rc 0/0 00000100:00100000:2.0:1746147188.393002:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1539 00002000:00100000:2.0:1746147188.393014:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3837952->4194303) req@ffff88009b20bb80 x1830967463767168/t17179873231(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.393022:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967463767168 ext(3837952->4194303) 00010000:00010000:2.0:1746147188.393030:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 30 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.393041:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 30 pid: 8478 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.393046:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20bb80 00000100:00100000:3.0:1746147188.393125:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767680 00000100:00100000:3.0:1746147188.393133:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767680 00010000:00010000:3.0:1746147188.393155:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.393182:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5799 00000100:00100000:3.0:1746147188.393189:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463767680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.393201:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.393215:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.393223:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.393241:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f198a00/0xb4b2209fbdac6b77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a7c expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.393255:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.393275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.393454:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767552 00000100:00100000:2.0:1746147188.393457:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767552 00002000:00100000:2.0:1746147188.393476:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1523712->2097151) req@ffff88008fc94000 x1830967463767552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.393484:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94000 with x1830967463767552 ext(1523712->2097151) 00002000:00010000:2.0:1746147188.393487:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc94000 00000100:00100000:2.0:1746147188.393503:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4500 00000100:00100000:2.0:1746147188.393508:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463767552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.393823:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463767680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 633us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.393828:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5799 00000100:00100000:0.0:1746147188.396065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.396430:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463767808 00000100:00100000:3.0:1746147188.396438:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463767808 00010000:00010000:3.0:1746147188.396463:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 32 pid: 8478 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.396495:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5800 00000100:00100000:3.0:1746147188.396501:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463767808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.396514:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.396529:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 32 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.396539:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 32 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.396556:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a8800/0xb4b2209fbdac6b70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2142208->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a75 expref: 32 pid: 8478 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.396566:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.396568:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.396574:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.396581:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.396621:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.396631:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466413312:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.396678:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.396813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.396904:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768064 00000100:00100000:2.0:1746147188.396908:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768064 00002000:00100000:2.0:1746147188.396929:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009b208a80 x1830967463768064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.396954:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967463768064 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.396958:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:2.0:1746147188.396970:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4501 00000100:00100000:2.0:1746147188.396975:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463768064:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.405644:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466413312:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.405664:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.405700:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463767808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9197us (9637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.405709:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5800 00000100:00100000:2.0:1746147188.406210:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463767552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12700us (12934us total) trans 0 rc 573440/573440 00000100:00100000:2.0:1746147188.406217:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4500 00002000:00100000:2.0:1746147188.406227:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1523712->2097151) req@ffff88008fc94000 x1830967463767552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 573440/573440 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.406236:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94000 with x1830967463767552 ext(1523712->2097151) 00002000:00010000:2.0:1746147188.406241:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc94000 00000100:00100000:0.0:1746147188.411009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.411418:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463768064:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14440us (14603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.411428:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4501 00002000:00100000:2.0:1746147188.411441:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009b208a80 x1830967463768064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.411450:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208a80 with x1830967463768064 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.411455:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208a80 00000100:00100000:2.0:1746147188.411475:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768320 00000100:00100000:2.0:1746147188.411482:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768320 00002000:00100000:2.0:1746147188.411509:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008fc95880 x1830967463768320/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.411515:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95880 with x1830967463768320 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.411518:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95880 00000100:00100000:2.0:1746147188.411532:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4502 00000100:00100000:2.0:1746147188.411539:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463768320:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.411641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.411691:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768448 00000100:00100000:0.0:1746147188.411694:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768448 00002000:00100000:0.0:1746147188.411709:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b20b100 x1830967463768448/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.411715:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967463768448 ext(3145728->4194303) 00002000:00010000:0.0:1746147188.411717:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:0.0:1746147188.411735:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4503 00000100:00100000:0.0:1746147188.411740:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463768448:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.427212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.427778:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463768320:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16236us (16774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147188.427788:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4502 00002000:00100000:0.0:1746147188.427800:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008fc95880 x1830967463768320/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.427813:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95880 with x1830967463768320 ext(2097152->3145727) 00002000:00010000:0.0:1746147188.427817:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc95880 00000100:00100000:2.0:1746147188.428238:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463768448:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16496us (16596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.428245:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4503 00002000:00100000:2.0:1746147188.428251:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b20b100 x1830967463768448/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.428257:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967463768448 ext(3145728->4194303) 00002000:00010000:2.0:1746147188.428260:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20b100 00000100:00100000:3.0:1746147188.428537:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768704 00000100:00100000:3.0:1746147188.428546:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768704 00000100:00100000:3.0:1746147188.428623:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11732 00000100:00100000:3.0:1746147188.428630:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:28948:x1830967463768704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.428642:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.428657:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b47 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.428720:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.428727:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.428729:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.428732:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.428757:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.428768:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 13 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.428778:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466413440:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.429846:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.433191:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466413440:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.433219:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.433234:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88800, rc 0) 00000100:00100000:3.0:1746147188.433271:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28948:x1830967463768704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4641us (6065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.433279:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11732 00000100:00100000:0.0:1746147188.433840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.433915:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768832 00000100:00100000:2.0:1746147188.433921:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768832 00002000:00100000:2.0:1746147188.433973:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1150975) req@ffff88008fc97800 x1830967463768832/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.433980:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463768832 ext(1048576->1150975) 00010000:00010000:2.0:1746147188.433987:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.433997:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 14 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.434003:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc97800 00000100:00100000:2.0:1746147188.434016:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1540 00000100:00100000:2.0:1746147188.434022:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463768832:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.437047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.437062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.437084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.437159:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769088 00000100:00100000:2.0:1746147188.437167:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769088 00000100:00100000:2.0:1746147188.437199:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463768960 00000100:00100000:2.0:1746147188.437201:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463768960 00000100:00100000:2.0:1746147188.437210:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769216 00000100:00100000:2.0:1746147188.437211:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769216 00000100:00100000:2.0:1746147188.437222:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11733 00000100:00100000:2.0:1746147188.437228:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463769088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.437243:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.437256:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094df6c00/0xb4b2209fbdac6c65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b55 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.437296:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413568:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.437354:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.437370:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11734 00000100:00100000:2.0:1746147188.437375:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463768960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.437381:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.437391:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013132b800/0xb4b2209fbdac6c6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b4e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.437410:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466413696:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.437426:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.437443:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11735 00000100:00100000:2.0:1746147188.437448:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463769216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.437453:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.437459:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4c00/0xb4b2209fbdac6c73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b5c expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.437476:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466413824:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.437491:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.439068:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463768832:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5042us (5225us total) trans 21474840637 rc 0/0 00000100:00100000:3.0:1746147188.439077:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1540 00002000:00100000:3.0:1746147188.439085:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1150975) req@ffff88008fc97800 x1830967463768832/t21474840637(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.439093:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97800 with x1830967463768832 ext(1048576->1150975) 00010000:00010000:3.0:1746147188.439099:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 20 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.439109:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 20 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.439114:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc97800 00000100:00100000:2.0:1746147188.440402:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466413824:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.440427:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4c00/0xb4b2209fbdac6c73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b5c expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.440438:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e9c4c00/0xb4b2209fbdac6c73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b5c expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.440449:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e9c4c00, rc 0) 00000100:00100000:2.0:1746147188.440487:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463769216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3038us (3402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.440493:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11735 00002000:00010000:2.0:1746147188.440522:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147187 -> 1746147188 00002000:00010000:2.0:1746147188.440524:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147187 -> 1746147188 00002000:00010000:2.0:1746147188.440527:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147187 -> 1746147188 00000100:00100000:2.0:1746147188.440536:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466413568:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.440549:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094df6c00/0xb4b2209fbdac6c65 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b55 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.440557:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094df6c00/0xb4b2209fbdac6c65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b55 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.440564:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094df6c00, rc 0) 00000100:00100000:2.0:1746147188.440577:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463769088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3350us (3538us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.440582:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11733 00002000:00010000:3.0:1746147188.441120:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147185 -> 1746147188 00002000:00010000:3.0:1746147188.441123:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147185 -> 1746147188 00002000:00010000:3.0:1746147188.441124:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147185 -> 1746147188 00000100:00100000:3.0:1746147188.441133:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466413696:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.441145:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013132b800/0xb4b2209fbdac6c6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b4e expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.441153:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013132b800/0xb4b2209fbdac6c6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b4e expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.441862:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013132b800, rc 0) 00000100:00100000:3.0:1746147188.442228:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463768960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4850us (5162us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.442234:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11734 00000100:00100000:0.0:1746147188.446363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.446576:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769344 00000100:00100000:3.0:1746147188.446584:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769344 00010000:00010000:3.0:1746147188.446626:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.446660:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5801 00000100:00100000:3.0:1746147188.446667:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463769344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.446680:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.446696:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.446706:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.446723:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f14ce00/0xb4b2209fbdac6bfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6af3 expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.446736:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.446739:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.446745:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.446753:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.446781:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.446791:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466413952:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.446864:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.451320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.451739:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466413952:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.451756:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.451802:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463769344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5135us (5446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.451811:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5801 00000100:00100000:3.0:1746147188.451887:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769600 00000100:00100000:3.0:1746147188.451893:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769600 00002000:00100000:3.0:1746147188.451923:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008fc94e00 x1830967463769600/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.451931:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94e00 with x1830967463769600 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.451955:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc94e00 00000100:00100000:3.0:1746147188.451984:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4504 00000100:00100000:3.0:1746147188.451991:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463769600:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.457190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.457775:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769856 00000100:00100000:1.0:1746147188.457785:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769856 00002000:00100000:1.0:1746147188.457820:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008fc96a00 x1830967463769856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.457828:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96a00 with x1830967463769856 ext(1048576->2097151) 00002000:00010000:1.0:1746147188.457832:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96a00 00000100:00100000:1.0:1746147188.457850:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4505 00000100:00100000:1.0:1746147188.457855:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463769856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.457889:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463769600:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5897us (6574us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147188.457896:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4504 00002000:00100000:3.0:1746147188.457903:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008fc94e00 x1830967463769600/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.457910:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc94e00 with x1830967463769600 ext(4194304->4927487) 00002000:00010000:3.0:1746147188.457913:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc94e00 00000100:00100000:0.0:1746147188.462317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.462352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.462383:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.464405:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463769984 00000100:00100000:3.0:1746147188.464448:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463769984 00000100:00100000:3.0:1746147188.464730:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770240 00000100:00100000:2.0:1746147188.464772:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770112 00000100:00100000:2.0:1746147188.464775:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770112 00000100:00100000:3.0:1746147188.464889:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770240 00000100:00100000:2.0:1746147188.464924:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11736 00000100:00100000:2.0:1746147188.464947:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463769984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.464962:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147188.464993:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11737 00000100:00100000:1.0:1746147188.465000:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463770112:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.465007:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.465017:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4773200/0xb4b2209fbdac6c7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b6a expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.465066:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466414080:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.465133:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.465188:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11738 00000100:00100000:3.0:1746147188.465195:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463770240:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.465201:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.465208:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b71 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.465219:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.465221:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.465228:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.465241:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.465250:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ec600, rc 0) 00000100:00100000:3.0:1746147188.465274:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463770240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.465280:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11738 00010000:00010000:2.0:1746147188.465472:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6c88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b63 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.465499:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414208:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.465526:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.468189:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466414080:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.468217:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4773200/0xb4b2209fbdac6c7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b6a expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.468229:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4773200/0xb4b2209fbdac6c7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b6a expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.468258:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773200, rc 0) 00000100:00100000:1.0:1746147188.468305:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463770112:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3304us (5920us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.468312:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11737 00000100:00100000:2.0:1746147188.471122:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414208:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147188.471625:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463769856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13767us (14440us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147188.471636:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4505 00002000:00100000:0.0:1746147188.471646:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008fc96a00 x1830967463769856/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.471655:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96a00 with x1830967463769856 ext(1048576->2097151) 00002000:00010000:0.0:1746147188.471659:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96a00 00010000:00010000:2.0:1746147188.471701:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6c88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b63 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.471715:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6c88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b63 expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.471736:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72fc00, rc 0) 00000100:00100000:2.0:1746147188.471767:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463769984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6836us (9457us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.471773:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11736 00000100:00100000:0.0:1746147188.475832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.475887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.475962:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770368 00000100:00100000:2.0:1746147188.475971:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770368 00000100:00100000:2.0:1746147188.476489:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770496 00000100:00100000:2.0:1746147188.476493:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770496 00000100:00100000:1.0:1746147188.476497:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11739 00000100:00100000:1.0:1746147188.476507:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463770368:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147188.476513:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11740 00000100:00100000:2.0:1746147188.476517:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463770496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.476523:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.476525:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.476536:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac6c96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b7f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.476536:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac6c8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b78 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.476578:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466414336:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.476579:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466414464:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.476652:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.477518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.478156:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.478742:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770624 00000100:00100000:3.0:1746147188.478750:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770624 00000100:00100000:3.0:1746147188.478786:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11741 00000100:00100000:3.0:1746147188.478792:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+20:28948:x1830967463770624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.478806:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.478819:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b86 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.478838:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.478839:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.478845:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.478855:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.478863:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309edc00, rc 0) 00000100:00100000:3.0:1746147188.478918:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28948:x1830967463770624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.478924:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11741 00000100:00100000:0.0:1746147188.479834:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466414464:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147188.479860:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac6c8f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b78 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.479870:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4773400/0xb4b2209fbdac6c8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b78 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.479891:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4773400, rc 0) 00000100:00100000:0.0:1746147188.479915:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463770368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3410us (4091us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.479921:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11739 00000100:00100000:2.0:1746147188.480622:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466414336:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.480638:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac6c96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b7f expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.480648:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e200/0xb4b2209fbdac6c96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b7f expref: 17 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.480656:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72e200, rc 0) 00000100:00100000:2.0:1746147188.480688:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463770496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4170us (4802us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.480694:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11740 00000100:00100000:2.0:1746147188.484467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.484921:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463770880 00000100:00100000:0.0:1746147188.484931:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463770880 00002000:00100000:0.0:1746147188.484992:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f76aa00 x1830967463770880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.485001:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76aa00 with x1830967463770880 ext(2097152->3145727) 00002000:00010000:0.0:1746147188.485005:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76aa00 00000100:00100000:0.0:1746147188.485024:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4506 00000100:00100000:0.0:1746147188.485031:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463770880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.500218:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463770880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15175us (15746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.500230:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4506 00002000:00100000:2.0:1746147188.500242:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f76aa00 x1830967463770880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.500251:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76aa00 with x1830967463770880 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.500255:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76aa00 00000100:00100000:0.0:1746147188.504761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.505432:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771008 00000100:00100000:2.0:1746147188.505441:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771008 00000100:00100000:2.0:1746147188.505486:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11742 00000100:00100000:2.0:1746147188.505493:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28951:x1830967463771008:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.505508:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.505522:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b8d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.505545:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.505552:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.505554:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.505557:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [245760->491519] (req 245760->491519) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.505583:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.505602:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 20 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.505614:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414592:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.505702:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.511688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.511992:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414592:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.512021:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [245760->491519] (req 245760->491519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.512041:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72fc00, rc 0) 00000100:00100000:3.0:1746147188.512093:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28951:x1830967463771008:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6599us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.512100:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11742 00000100:00100000:3.0:1746147188.512125:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771136 00000100:00100000:3.0:1746147188.512131:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771136 00000100:00100000:3.0:1746147188.512173:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11743 00000100:00100000:3.0:1746147188.512471:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+29:28948:x1830967463771136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.512487:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.512501:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b94 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.512520:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.512521:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.512527:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.512537:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.512544:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ece00, rc 0) 00000100:00100000:3.0:1746147188.512697:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28948:x1830967463771136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 516us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.512702:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11743 00000100:00100000:0.0:1746147188.513612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.513667:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771264 00000100:00100000:2.0:1746147188.513675:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771264 00002000:00100000:2.0:1746147188.513702:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (901120->1048575) req@ffff8800a4673b80 x1830967463771264/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.513711:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463771264 ext(901120->1048575) 00010000:00010000:2.0:1746147188.513718:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.513733:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 21 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.513739:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673b80 00000100:00100000:2.0:1746147188.513895:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1541 00000100:00100000:2.0:1746147188.513902:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463771264:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147188.530406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.530446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.530733:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771520 00000100:00100000:3.0:1746147188.530742:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771520 00002000:00100000:3.0:1746147188.530778:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f76b800 x1830967463771520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.530787:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b800 with x1830967463771520 ext(2097152->3145727) 00002000:00010000:3.0:1746147188.530791:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76b800 00000100:00100000:3.0:1746147188.530805:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771648 00000100:00100000:3.0:1746147188.530808:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771648 00002000:00100000:3.0:1746147188.530817:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f768380 x1830967463771648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.530824:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768380 with x1830967463771648 ext(3145728->4194303) 00002000:00010000:3.0:1746147188.530826:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f768380 00000100:00100000:3.0:1746147188.530837:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4507 00000100:00100000:3.0:1746147188.530849:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463771520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.530852:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4508 00000100:00100000:2.0:1746147188.530859:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463771648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.533121:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463771264:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19214us (19506us total) trans 21474840638 rc 0/0 00000100:00100000:0.0:1746147188.533130:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1541 00002000:00100000:0.0:1746147188.533139:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (901120->1048575) req@ffff8800a4673b80 x1830967463771264/t21474840638(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.533152:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673b80 with x1830967463771264 ext(901120->1048575) 00010000:00010000:0.0:1746147188.533161:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.533173:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00002000:00010000:0.0:1746147188.533179:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4673b80 00000100:00100000:0.0:1746147188.540584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.542262:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463771904 00000100:00100000:2.0:1746147188.542271:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463771904 00010000:00010000:2.0:1746147188.542301:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.542325:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5802 00000100:00100000:2.0:1746147188.542330:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463771904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.542341:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.542356:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.542365:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.542381:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac6c2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 901120->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b16 expref: 23 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.542395:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.542397:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.542402:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.542409:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.542434:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.542444:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466414720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.542515:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.543045:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463771520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12200us (12644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147188.543053:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4507 00002000:00100000:3.0:1746147188.543061:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f76b800 x1830967463771520/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.543068:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b800 with x1830967463771520 ext(2097152->3145727) 00002000:00010000:3.0:1746147188.543072:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76b800 00000100:00100000:3.0:1746147188.565582:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466414720:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.565614:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.565663:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463771648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 34798us (35209us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.565674:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4508 00002000:00100000:2.0:1746147188.565685:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f768380 x1830967463771648/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.565694:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768380 with x1830967463771648 ext(3145728->4194303) 00002000:00010000:2.0:1746147188.565699:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f768380 00000100:00100000:3.0:1746147188.565767:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463771904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 23434us (25186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.565776:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5802 00000100:00100000:0.0:1746147188.573159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.573216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.573411:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463772160 00000100:00100000:2.0:1746147188.573419:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463772160 00002000:00100000:2.0:1746147188.573461:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (245760->249855) req@ffff8800a4671f80 x1830967463772160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.573471:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671f80 with x1830967463772160 ext(245760->249855) 00002000:00010000:2.0:1746147188.573476:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671f80 00000100:00100000:2.0:1746147188.573494:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4509 00000100:00100000:2.0:1746147188.573500:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463772160:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147188.573688:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463772160:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 187us (538us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147188.573694:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4509 00002000:00100000:2.0:1746147188.573699:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (245760->249855) req@ffff8800a4671f80 x1830967463772160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.573705:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671f80 with x1830967463772160 ext(245760->249855) 00002000:00010000:2.0:1746147188.573708:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4671f80 00000100:00100000:3.0:1746147188.573824:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463772288 00000100:00100000:3.0:1746147188.573828:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463772288 00000100:00100000:3.0:1746147188.573851:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11744 00000100:00100000:3.0:1746147188.573855:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463772288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.573864:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.573880:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136966a00/0xb4b2209fbdac6cb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6b9b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.573931:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414848:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147188.574033:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.576350:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466414848:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.576388:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136966a00/0xb4b2209fbdac6cb2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b9b expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.576402:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136966a00/0xb4b2209fbdac6cb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b9b expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.577206:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136966a00, rc 0) 00000100:00100000:3.0:1746147188.577262:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463772288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3404us (4044us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.577271:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11744 00000100:00100000:0.0:1746147188.578159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.578335:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463772544 00000100:00100000:2.0:1746147188.578341:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463772544 00002000:00100000:2.0:1746147188.578374:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (487424->491519) req@ffff8800a4673800 x1830967463772544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.578382:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967463772544 ext(487424->491519) 00002000:00010000:2.0:1746147188.578386:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673800 00000100:00100000:2.0:1746147188.578400:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4510 00000100:00100000:2.0:1746147188.578406:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463772544:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147188.578558:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463772544:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 151us (401us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147188.578564:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4510 00002000:00100000:2.0:1746147188.578568:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (487424->491519) req@ffff8800a4673800 x1830967463772544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.578575:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4673800 with x1830967463772544 ext(487424->491519) 00002000:00010000:2.0:1746147188.578578:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4673800 00000100:00100000:0.0:1746147188.583083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.583403:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463772800 00000100:00100000:2.0:1746147188.583412:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463772800 00002000:00100000:2.0:1746147188.583453:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4923391) req@ffff8800a4672a00 x1830967463772800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.583463:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672a00 with x1830967463772800 ext(4194304->4923391) 00002000:00010000:2.0:1746147188.583468:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4672a00 00000100:00100000:2.0:1746147188.583487:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4511 00000100:00100000:2.0:1746147188.583493:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463772800:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.586736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.588188:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463772928 00000100:00100000:3.0:1746147188.588197:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463772928 00000100:00100000:3.0:1746147188.588252:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10522 00000100:00100000:3.0:1746147188.588260:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:28955:x1830967463772928:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147188.588284:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.588304:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5e00/0xb4b2209fbdac6cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ba2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.588362:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588374:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588385:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588397:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588403:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588409:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588521:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588532:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.588540:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 321 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.588545:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.588575:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 321 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.588585:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 321 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.588608:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466414976:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.588711:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 34 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.588719:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 34 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.588727:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466415104:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.588747:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.591743:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463772800:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8241us (8660us total) trans 0 rc 729088/729088 00000100:00100000:2.0:1746147188.591757:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4511 00002000:00100000:2.0:1746147188.591766:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4923391) req@ffff8800a4672a00 x1830967463772800/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.591776:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672a00 with x1830967463772800 ext(4194304->4923391) 00002000:00010000:2.0:1746147188.591781:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4672a00 00000100:00100000:0.0:1746147188.591806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.591825:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773184 00000100:00100000:2.0:1746147188.591831:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773184 00000100:00100000:2.0:1746147188.591860:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4172 00000100:00100000:2.0:1746147188.591865:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:14478:x1830967463773184:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147188.591874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.591988:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773312 00000100:00100000:1.0:1746147188.591992:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773312 00010000:00010000:1.0:1746147188.592012:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 322 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.592041:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5803 00000100:00100000:1.0:1746147188.592047:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+322:1956:x1830967463773312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.592058:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.592065:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 322 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.592074:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 322 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.592144:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.592150:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.592159:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.592164:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.592169:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.592189:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+322:1956:x1830967463773312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.592194:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5803 00000100:00100000:2.0:1746147188.592395:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+36:14478:x1830967463773184:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 528us (589us total) trans 8589944273 rc 0/0 00000100:00100000:2.0:1746147188.592400:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4172 00010000:00010000:3.0:1746147188.593597:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14c400/0xb4b2209fbdac6c0a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6afa expref: 321 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.593617:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466414976:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.593629:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466415104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.593660:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147188.594019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.594239:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773440 00000100:00100000:1.0:1746147188.594244:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773440 00010000:00010000:1.0:1746147188.594263:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 36 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.594291:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5804 00000100:00100000:1.0:1746147188.594297:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463773440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.594307:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.594312:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 36 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.594321:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 36 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.594341:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9800/0xb4b2209fbdac6bd2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ad0 expref: 36 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.594365:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.594370:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594379:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594386:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594406:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.594433:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1957:x1830967463773440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.594439:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5804 00010000:00010000:1.0:1746147188.594476:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594482:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147188.594514:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:1.0:1746147188.594518:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147188.594533:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594542:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594554:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594560:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594566:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594571:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b17b4800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147188.594574:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594581:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594601:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147188.594604:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147188.594607:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594611:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594618:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594623:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594627:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594631:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b17b4600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147188.594634:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594638:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594643:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13700) 00010000:00010000:1.0:1746147188.594645:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147188.594647:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594651:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6cc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.594680:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5e00/0xb4b2209fbdac6cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.594692:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 17 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.594699:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.594701:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147188.594703:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b5000, rc 0) 00000100:00100000:1.0:1746147188.594727:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:28955:x1830967463772928:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6468us (8000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.594733:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10522 00000100:00100000:0.0:1746147188.594843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.594919:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773568 00000100:00100000:2.0:1746147188.594924:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773568 00000100:00100000:2.0:1746147188.594985:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11745 00000100:00100000:2.0:1746147188.594991:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463773568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.595003:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.595017:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6cd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ba9 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.595056:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466415232:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.595109:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.597644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.597768:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466415232:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.597799:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6cd5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba9 expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.597811:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6cd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba9 expref: 23 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.597835:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ec00, rc 0) 00000100:00100000:2.0:1746147188.597876:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463773568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2885us (3033us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.597883:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11745 00000100:00100000:2.0:1746147188.597904:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773824 00000100:00100000:2.0:1746147188.597908:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773824 00000100:00100000:2.0:1746147188.597969:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11746 00000100:00100000:2.0:1746147188.597975:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:28954:x1830967463773824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.597989:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.598001:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bb7 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.598024:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.598032:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.598039:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.598041:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.598044:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.598068:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.598079:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.598091:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466415360:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.598142:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.598150:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 15 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.598158:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466415488:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.598174:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.600928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.601341:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773696 00000100:00100000:1.0:1746147188.601349:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773696 00000100:00100000:1.0:1746147188.601467:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11747 00000100:00100000:1.0:1746147188.601475:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463773696:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147188.601494:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.601510:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6ce3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bb0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.601558:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466415616:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.601787:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.602025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.602160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.602475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.602502:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463773952 00000100:00100000:3.0:1746147188.602505:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774208 00000100:00100000:3.0:1746147188.602507:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774208 00000100:00100000:2.0:1746147188.602507:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463773952 00000100:00100000:3.0:1746147188.602525:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774080 00000100:00100000:3.0:1746147188.602526:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774080 00000100:00100000:2.0:1746147188.602535:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11748 00000100:00100000:3.0:1746147188.602539:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11749 00000100:00100000:2.0:1746147188.602540:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463774208:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147188.602543:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463773952:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147188.602547:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.602548:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.602556:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bcc expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.602558:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6cf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bbe expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.602569:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.602571:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.602580:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147188.602583:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466415744:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.602605:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.602615:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72f000, rc 0) 00000100:00100000:0.0:1746147188.602692:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11750 00000100:00100000:0.0:1746147188.602700:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463774080:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147188.602706:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147188.602706:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.602712:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0xb4b2209fbdac6cf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bc5 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.602722:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.602730:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0xb4b2209fbdac6cf8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bc5 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.602737:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0xb4b2209fbdac6cf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bc5 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.602757:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4600, rc 0) 00000100:00100000:2.0:1746147188.602811:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463774208:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 270us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.602817:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11748 00000100:00100000:3.0:1746147188.602839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.602853:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774464 00000100:00100000:2.0:1746147188.602855:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774464 00000100:00100000:3.0:1746147188.602867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.602870:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774336 00000100:00100000:2.0:1746147188.602872:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774336 00000100:00100000:2.0:1746147188.602890:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11751 00000100:00100000:1.0:1746147188.602980:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466415360:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.602986:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463774080:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 288us (512us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.603022:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466415488:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.603041:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.603050:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72fe00, rc 0) 00000100:00100000:1.0:1746147188.603149:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28954:x1830967463773824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5092us (5431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.603170:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11752 00000100:00100000:2.0:1746147188.603172:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463774464:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147188.603175:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463774336:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147188.603178:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.603179:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.603184:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bda expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.603187:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bd3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.603196:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.603197:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.603199:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.603200:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.603202:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.603204:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.603210:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 14 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.603212:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.603217:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e59e00, rc 0) 00010000:00010000:2.0:1746147188.603218:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72f400, rc 0) 00000100:00100000:3.0:1746147188.603229:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463774336:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.603229:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463774464:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 59us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.603234:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11752 00000100:00100000:2.0:1746147188.603236:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11751 00000100:00100000:0.0:1746147188.603341:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11750 00000100:00100000:1.0:1746147188.603348:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11746 00000100:00100000:0.0:1746147188.604144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.604239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.604314:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774720 00000100:00100000:2.0:1746147188.604318:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774720 00010000:00010000:2.0:1746147188.604336:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.604408:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774592 00000100:00100000:3.0:1746147188.604411:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774592 00000100:00100000:2.0:1746147188.604430:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5805 00000100:00100000:3.0:1746147188.604433:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11753 00000100:00100000:2.0:1746147188.604437:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463774720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147188.604438:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463774592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.604447:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.604448:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.604456:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdac6d0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6be1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.604469:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.604479:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.604489:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466415872:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.604499:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0c00/0xb4b2209fbdac6c34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b1d expref: 31 pid: 17530 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.604510:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.604527:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463774720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.604533:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5805 00000100:00100000:3.0:1746147188.604539:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.604663:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466415616:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.604682:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6ce3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb0 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.604688:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6ce3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb0 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.604693:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6200, rc 0) 00000100:00100000:1.0:1746147188.604715:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463773696:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3242us (3798us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.604724:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11747 00000100:00100000:2.0:1746147188.606340:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466415872:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.606360:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdac6d0d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6be1 expref: 23 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.606370:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487400/0xb4b2209fbdac6d0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6be1 expref: 23 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.606378:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487400, rc 0) 00000100:00100000:2.0:1746147188.606405:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463774592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1967us (2262us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.606411:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11753 00000100:00100000:3.0:1746147188.606579:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466415744:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.606608:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6cf1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bbe expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.606616:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6cf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bbe expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.606637:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4200, rc 0) 00000100:00100000:3.0:1746147188.606670:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463773952:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4126us (4644us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.606675:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11749 00000100:00100000:0.0:1746147188.607487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.607605:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463774848 00000100:00100000:2.0:1746147188.607611:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463774848 00010000:00010000:2.0:1746147188.607631:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.607660:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5806 00000100:00100000:2.0:1746147188.607666:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463774848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.607678:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.607690:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.607700:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.607716:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f14d000/0xb4b2209fbdac6bf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6aec expref: 16 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.607727:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.607729:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.607737:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.607745:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.607771:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.607783:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466416000:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147188.607848:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.612360:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466416000:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.612380:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.612416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.612430:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463774848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4762us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.612440:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5806 00000100:00100000:3.0:1746147188.612994:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775104 00000100:00100000:3.0:1746147188.613000:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775104 00002000:00100000:3.0:1746147188.613038:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (2088960->2093055) req@ffff8800b52e1880 x1830967463775104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.613048:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967463775104 ext(2088960->2093055) 00002000:00010000:3.0:1746147188.613053:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:3.0:1746147188.613070:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4512 00000100:00100000:3.0:1746147188.613076:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463775104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.613240:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463775104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 163us (824us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147188.613245:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4512 00002000:00100000:3.0:1746147188.613250:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (2088960->2093055) req@ffff8800b52e1880 x1830967463775104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.613261:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967463775104 ext(2088960->2093055) 00002000:00010000:3.0:1746147188.613264:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:1.0:1746147188.615048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.615070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.615096:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775360 00000100:00100000:1.0:1746147188.615106:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775360 00000100:00100000:1.0:1746147188.615149:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10523 00000100:00100000:1.0:1746147188.615155:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:28955:x1830967463775360:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147188.615170:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147188.615186:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775488 00010000:00010000:1.0:1746147188.615188:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdac6d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6be8 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.615190:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775488 00000100:00100000:3.0:1746147188.615228:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11754 00000100:00100000:3.0:1746147188.615233:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:28954:x1830967463775488:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147188.615242:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.615254:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bef expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.615275:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.615276:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.615284:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.615289:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.615292:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.615296:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.615298:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.615301:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.615304:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.615322:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 16 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.615323:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.615332:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 18 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.615333:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 16 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.615343:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416256:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.615343:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466416128:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.615882:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147188.615896:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.615905:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 11 pid: 8480 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.615913:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.615958:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.615965:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.615973:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416512:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.615994:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.618536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.618564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.618929:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416256:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.618959:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.618967:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416512:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.618997:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 23 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.619012:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486000, rc 0) 00000100:00100000:3.0:1746147188.619050:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28954:x1830967463775488:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3817us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.619058:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11754 00000100:00100000:2.0:1746147188.619067:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775744 00000100:00100000:2.0:1746147188.619073:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775744 00010000:00010000:2.0:1746147188.619099:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.619119:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775616 00000100:00100000:2.0:1746147188.619121:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775616 00010000:00010000:2.0:1746147188.619132:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 19 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.619137:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466416128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.619149:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5807 00000100:00100000:2.0:1746147188.619155:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463775744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.619155:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.619166:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147188.619176:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5808 00000100:00100000:1.0:1746147188.619181:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1958:x1830967463775616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.619188:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.619189:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.619194:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 19 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.619197:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.619202:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 19 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.619215:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6cce lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ba2 expref: 19 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.619216:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ec600/0xb4b2209fbdac6c81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b71 expref: 17 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:2.0:1746147188.619225:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147188.619228:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.619232:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.619241:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.619248:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147188.619256:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463775744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.619262:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5807 00010000:00010000:1.0:1746147188.619264:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.619280:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+18:1958:x1830967463775616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.619286:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5808 00010000:00010000:1.0:1746147188.619301:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.619307:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147188.619322:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147188.619449:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdac6d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6be8 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.619461:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6be8 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.619466:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.619468:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147188.619470:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6a00, rc 0) 00000100:00100000:1.0:1746147188.619502:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:28955:x1830967463775360:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4346us (4432us total) trans 8589944274 rc 0/0 00000100:00100000:1.0:1746147188.619508:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10523 00000100:00100000:0.0:1746147188.621708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.621740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.621765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.621822:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463776256 00000100:00100000:1.0:1746147188.621829:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463776256 00000100:00100000:1.0:1746147188.621860:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10524 00000100:00100000:1.0:1746147188.621865:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:28955:x1830967463776256:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147188.621887:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.621890:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147188.621911:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6d22 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6be8 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.621925:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.621928:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147188.621961:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d30 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bf6 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.622039:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622050:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622057:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622067:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622073:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622078:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622084:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b3b6c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147188.622087:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622093:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622099:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.622101:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147188.622104:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622108:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6d37 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.622130:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d30 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bf6 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.622137:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d30 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bf6 expref: 18 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.622149:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6800, rc 0) 00000100:00100000:1.0:1746147188.622199:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:28955:x1830967463776256:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 333us (497us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.622204:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10524 00000100:00100000:3.0:1746147188.622222:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463775872 00000100:00100000:3.0:1746147188.622226:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463775872 00010000:00010000:3.0:1746147188.622273:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 12 pid: 8480 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.622297:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463776000 00000100:00100000:3.0:1746147188.622300:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463776000 00010000:00010000:3.0:1746147188.622309:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.622322:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5809 00000100:00100000:3.0:1746147188.622327:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463775872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147188.622336:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5810 00000100:00100000:2.0:1746147188.622344:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463776000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.622353:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.622370:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.622378:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.622393:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88800/0xb4b2209fbdac6c5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b47 expref: 23 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.622398:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147188.622403:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147188.622408:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 12 pid: 8480 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.622421:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 12 pid: 8480 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.622433:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6cea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bcc expref: 12 pid: 8480 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.622436:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463776000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.622441:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5810 00010000:00010000:3.0:1746147188.622446:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.622448:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.622454:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.622461:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.622510:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 21 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.622523:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466416640:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.622684:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.624508:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466416640:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.624524:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.624558:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463775872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2229us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.624566:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5809 00000100:00100000:2.0:1746147188.625793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.625867:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463776512 00000100:00100000:0.0:1746147188.625873:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463776512 00000100:00100000:0.0:1746147188.625921:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4173 00000100:00100000:0.0:1746147188.625927:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:28955:x1830967463776512:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147188.626687:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:28955:x1830967463776512:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 758us (894us total) trans 8589944275 rc 0/0 00000100:00100000:0.0:1746147188.626695:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4173 00000100:00100000:2.0:1746147188.628465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.628538:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463776768 00000100:00100000:0.0:1746147188.628546:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463776768 00002000:00100000:0.0:1746147188.628583:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1671168->1675263) req@ffff88009f76a300 x1830967463776768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.628606:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463776768 ext(1671168->1675263) 00002000:00010000:0.0:1746147188.628611:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:0.0:1746147188.628728:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4513 00000100:00100000:0.0:1746147188.628735:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463776768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.629200:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463776768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 463us (738us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147188.629207:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4513 00002000:00100000:0.0:1746147188.629212:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1671168->1675263) req@ffff88009f76a300 x1830967463776768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.629219:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76a300 with x1830967463776768 ext(1671168->1675263) 00002000:00010000:0.0:1746147188.629222:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76a300 00000100:00100000:0.0:1746147188.631296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.631371:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777024 00000100:00100000:2.0:1746147188.631379:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777024 00000100:00100000:2.0:1746147188.631424:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4174 00000100:00100000:2.0:1746147188.631431:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+321:28954:x1830967463777024:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147188.631867:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+322:28954:x1830967463777024:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 435us (576us total) trans 8589944276 rc 0/0 00000100:00100000:2.0:1746147188.631874:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4174 00000100:00100000:0.0:1746147188.705458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.705866:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777280 00000100:00100000:1.0:1746147188.705875:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777280 00000100:00100000:1.0:1746147188.705919:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10525 00000100:00100000:1.0:1746147188.705927:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+35:28961:x1830967463777280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147188.705968:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.705982:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7400/0xb4b2209fbdac6d3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6bfd expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.706058:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.706069:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.706078:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147188.706087:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147188.706177:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b7400/0xb4b2209fbdac6d3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 38 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.706209:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 37 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.706216:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.706218:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147188.706221:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6400, rc 0) 00000100:00100000:1.0:1746147188.706259:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+37:28961:x1830967463777280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 332us (828us total) trans 8589944277 rc 0/0 00000100:00100000:1.0:1746147188.706264:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10525 00000100:00100000:0.0:1746147188.714722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.714753:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777408 00000100:00100000:2.0:1746147188.714765:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777408 00000100:00100000:2.0:1746147188.714868:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11755 00000100:00100000:2.0:1746147188.714877:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28961:x1830967463777408:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.714894:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.714908:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c04 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.714966:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.714975:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.714981:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.714987:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.714988:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.714991:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2142208->2265087] (req 2142208->2265087) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.715018:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 21 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.715029:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 21 pid: 4445 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.715039:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416768:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.715136:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.715144:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 10 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:2.0:1746147188.715151:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416896:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.715174:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.715181:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 17 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.715188:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466417024:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.715203:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.719914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.720065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.720104:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777536 00000100:00100000:0.0:1746147188.720111:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777536 00010000:00010000:0.0:1746147188.720144:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 22 pid: 4445 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.720561:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416768:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.720572:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466416896:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.720580:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466417024:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.720618:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [2142208->2265087] (req 2142208->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.720634:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72f200, rc 0) 00000100:00100000:2.0:1746147188.720685:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28961:x1830967463777408:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5808us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.720696:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11755 00000100:00100000:0.0:1746147188.721024:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777664 00000100:00100000:0.0:1746147188.721029:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777664 00010000:00010000:0.0:1746147188.721043:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.721139:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5811 00000100:00100000:3.0:1746147188.721148:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463777536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.721160:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.721184:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 22 pid: 4445 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.721194:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 22 pid: 4445 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.721215:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6c9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b86 expref: 22 pid: 4445 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.721239:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.721260:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463777536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 114us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.721266:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5811 00000100:00100000:3.0:1746147188.721279:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5812 00000100:00100000:3.0:1746147188.721283:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463777664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.723530:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.723561:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.723573:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.723598:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e59e00/0xb4b2209fbdac6d06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bd3 expref: 11 pid: 8478 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.723615:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.723658:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463777664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2374us (3593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.723665:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5812 00000100:00100000:0.0:1746147188.723892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.723917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.723949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.725235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.725264:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777792 00000100:00100000:1.0:1746147188.725273:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777792 00000100:00100000:1.0:1746147188.725319:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463777920 00000100:00100000:1.0:1746147188.725321:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463777920 00000100:00100000:1.0:1746147188.725333:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778048 00000100:00100000:1.0:1746147188.725335:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778048 00000100:00100000:1.0:1746147188.725349:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11756 00000100:00100000:1.0:1746147188.725355:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463777792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.725371:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.725386:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c0b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.725430:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466417152:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147188.725485:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.725812:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11757 00000100:00100000:2.0:1746147188.725821:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463777920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.725828:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.725837:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6d61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c12 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.725859:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466417280:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.725883:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.725898:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11758 00000100:00100000:2.0:1746147188.725903:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463778048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.725910:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.725918:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6d68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c19 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.725955:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417408:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147188.725975:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.726383:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778176 00000100:00100000:0.0:1746147188.726387:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778176 00000100:00100000:0.0:1746147188.726452:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11759 00000100:00100000:0.0:1746147188.726458:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463778176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.726466:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.726474:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c20 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.726486:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.726493:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c20 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.726502:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c20 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.726513:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5400, rc 0) 00000100:00100000:0.0:1746147188.726534:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463778176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 75us (1301us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.726539:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11759 00000100:00100000:0.0:1746147188.729652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.729701:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778304 00000100:00100000:3.0:1746147188.729708:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778304 00010000:00010000:3.0:1746147188.729738:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.729778:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5813 00000100:00100000:3.0:1746147188.729785:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463778304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.729799:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.729822:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.729834:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.729855:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a8600/0xb4b2209fbdac6c26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b0f expref: 19 pid: 6881 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.729873:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.729875:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.729882:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.729894:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.729925:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.729960:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466417536:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.730034:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.730162:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466417152:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.730191:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c0b expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.730205:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c0b expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.730218:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6800, rc 0) 00000100:00100000:1.0:1746147188.730255:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463777792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4899us (6364us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.730261:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11756 00000100:00100000:2.0:1746147188.732171:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417408:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.732198:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6d68 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c19 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.732208:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f000/0xb4b2209fbdac6d68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c19 expref: 18 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.732235:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72f000, rc 0) 00000100:00100000:2.0:1746147188.732268:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463778048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6364us (8331us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.732275:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11758 00002000:00010000:2.0:1746147188.732838:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147185 -> 1746147188 00000100:00100000:2.0:1746147188.732853:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466417280:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147188.732869:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6d61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c12 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.732878:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6d61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c12 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.732886:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ea00, rc 0) 00000100:00100000:2.0:1746147188.732920:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463777920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7100us (9001us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147188.732925:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11757 00000100:00100000:3.0:1746147188.733198:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466417536:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.733209:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.733243:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463778304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3458us (3600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.733250:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5813 00000100:00100000:0.0:1746147188.733633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.733807:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778560 00000100:00100000:2.0:1746147188.733813:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778560 00002000:00100000:2.0:1746147188.733843:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2142208->2146303) req@ffff88012e2bb800 x1830967463778560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.733852:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967463778560 ext(2142208->2146303) 00002000:00010000:2.0:1746147188.733856:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:2.0:1746147188.733882:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4514 00000100:00100000:2.0:1746147188.733889:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463778560:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147188.734060:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463778560:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 170us (427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147188.734066:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4514 00002000:00100000:2.0:1746147188.734071:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2142208->2146303) req@ffff88012e2bb800 x1830967463778560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.734078:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967463778560 ext(2142208->2146303) 00002000:00010000:2.0:1746147188.734081:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:0.0:1746147188.738837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.738973:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778816 00000100:00100000:3.0:1746147188.738982:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778816 00000100:00100000:0.0:1746147188.738994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.739020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147188.739022:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2260992->2265087) req@ffff88012e2ba300 x1830967463778816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.739033:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967463778816 ext(2260992->2265087) 00002000:00010000:3.0:1746147188.739037:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:3.0:1746147188.739056:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4515 00000100:00100000:3.0:1746147188.739062:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463778816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.739246:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463778816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 182us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147188.739250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.739256:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4515 00002000:00100000:3.0:1746147188.739261:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2260992->2265087) req@ffff88012e2ba300 x1830967463778816/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.739267:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967463778816 ext(2260992->2265087) 00002000:00010000:3.0:1746147188.739270:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:3.0:1746147188.739280:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779328 00000100:00100000:3.0:1746147188.739282:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779328 00002000:00100000:3.0:1746147188.739292:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012e2b9180 x1830967463779328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 504/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.739298:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9180 with x1830967463779328 ext(0->1048575) 00002000:00010000:3.0:1746147188.739301:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b9180 00000100:00100000:3.0:1746147188.739317:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4516 00000100:00100000:3.0:1746147188.739321:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463779328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.739410:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463778944 00000100:00100000:1.0:1746147188.739413:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463778944 00000100:00100000:1.0:1746147188.739431:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779072 00000100:00100000:1.0:1746147188.739432:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779072 00000100:00100000:1.0:1746147188.739444:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11760 00000100:00100000:1.0:1746147188.739448:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463778944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.739458:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.739475:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c27 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.739524:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417664:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147188.739557:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11761 00000100:00100000:0.0:1746147188.739564:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463779072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147188.739570:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.739576:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0xb4b2209fbdac6d7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c2e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.739583:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147188.739605:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0xb4b2209fbdac6d7d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c2e expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.739614:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0xb4b2209fbdac6d7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c2e expref: 24 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.739631:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4000, rc 0) 00000100:00100000:0.0:1746147188.739646:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463779072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (625us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.739652:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11761 00000100:00100000:1.0:1746147188.740544:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417664:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.740564:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c27 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.740572:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6d76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c27 expref: 22 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.741271:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6800, rc 0) 00000100:00100000:1.0:1746147188.741296:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463778944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1847us (2301us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.741303:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11760 00000100:00100000:0.0:1746147188.748974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.749023:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779456 00000100:00100000:1.0:1746147188.749033:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779456 00000100:00100000:1.0:1746147188.749088:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11762 00000100:00100000:1.0:1746147188.749095:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+21:28967:x1830967463779456:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.749111:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.749126:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c35 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.749154:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.749161:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147188.749162:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147188.749165:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.749191:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.749202:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 17 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.749217:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417792:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.749300:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.750131:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463779328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10807us (10878us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746147188.750141:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4516 00002000:00100000:3.0:1746147188.750149:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012e2b9180 x1830967463779328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 504/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.750158:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b9180 with x1830967463779328 ext(0->1048575) 00010000:00010000:3.0:1746147188.750165:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.750176:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.750183:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2b9180 00000100:00100000:1.0:1746147188.754128:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466417792:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.754161:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.754176:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360c00, rc 0) 00000100:00100000:1.0:1746147188.754224:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:28967:x1830967463779456:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5128us (5288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.754232:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11762 00000100:00100000:0.0:1746147188.755566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.755654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.755686:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779712 00000100:00100000:0.0:1746147188.755692:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779712 00000100:00100000:3.0:1746147188.755738:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779840 00000100:00100000:3.0:1746147188.755748:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779840 00000100:00100000:0.0:1746147188.755759:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10526 00000100:00100000:0.0:1746147188.755766:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+322:28969:x1830967463779712:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147188.755782:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746147188.755794:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (245760->491519) req@ffff88012e2bbb80 x1830967463779840/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147188.755795:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4000/0xb4b2209fbdac6d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c3c expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147188.755805:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967463779840 ext(245760->491519) 00010000:00010000:3.0:1746147188.755815:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.755829:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 16 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.755837:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2bbb80 00000100:00100000:3.0:1746147188.755859:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1542 00000100:00100000:3.0:1746147188.755867:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463779840:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147188.755869:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147188.755879:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147188.755887:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147188.755896:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147188.756017:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4000/0xb4b2209fbdac6d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 325 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756034:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 324 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756040:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147188.756042:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147188.756043:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5400, rc 0) 00000100:00100000:0.0:1746147188.756070:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28969:x1830967463779712:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 304us (508us total) trans 8589944278 rc 0/0 00000100:00100000:0.0:1746147188.756076:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10526 00000100:00100000:0.0:1746147188.759290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.759428:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463779968 00000100:00100000:1.0:1746147188.759435:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463779968 00000100:00100000:1.0:1746147188.760641:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11763 00000100:00100000:1.0:1746147188.760654:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:28964:x1830967463779968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.760674:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.760692:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c43 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.760720:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.760726:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147188.760728:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147188.760731:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.760767:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 29 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.760777:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 29 pid: 17530 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.760788:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466417920:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147188.762137:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.765482:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463779840:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9605us (9816us total) trans 21474840639 rc 0/0 00000100:00100000:3.0:1746147188.765494:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1542 00002000:00100000:3.0:1746147188.765505:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (245760->491519) req@ffff88012e2bbb80 x1830967463779840/t21474840639(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.765514:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bbb80 with x1830967463779840 ext(245760->491519) 00010000:00010000:3.0:1746147188.765524:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.765542:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.765549:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2bbb80 00000100:00100000:1.0:1746147188.766363:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466417920:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147188.766396:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 16 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.766411:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f360600, rc 0) 00000100:00100000:1.0:1746147188.766433:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28964:x1830967463779968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5783us (7153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.766441:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11763 00000100:00100000:0.0:1746147188.766521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.767218:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780096 00000100:00100000:2.0:1746147188.767225:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780096 00002000:00100000:2.0:1746147188.767256:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1523711) req@ffff88012e2baa00 x1830967463780096/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.767264:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967463780096 ext(1048576->1523711) 00010000:00010000:2.0:1746147188.767270:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 30 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.767279:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 30 pid: 17530 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.767285:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2baa00 00000100:00100000:2.0:1746147188.767312:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1543 00000100:00100000:2.0:1746147188.767319:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463780096:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.768759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.769428:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780224 00000100:00100000:3.0:1746147188.769437:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780224 00010000:00010000:3.0:1746147188.769474:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.769530:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5814 00000100:00100000:3.0:1746147188.769539:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463780224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.769555:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.769725:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.769738:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.769764:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fc00/0xb4b2209fbdac6ca4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->491519) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b8d expref: 18 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.769789:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.769791:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.769799:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.769815:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.769850:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 21 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.769862:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466418048:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.770009:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.778781:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463780096:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11450us (12248us total) trans 17179873232 rc 0/0 00000100:00100000:1.0:1746147188.778793:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1543 00002000:00100000:1.0:1746147188.778804:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1523711) req@ffff88012e2baa00 x1830967463780096/t17179873232(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.778813:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967463780096 ext(1048576->1523711) 00010000:00010000:1.0:1746147188.778824:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.778839:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00002000:00010000:1.0:1746147188.778846:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e2baa00 00000100:00100000:3.0:1746147188.781136:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466418048:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.781160:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.781755:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463780224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12215us (12999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.781765:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5814 00000100:00100000:0.0:1746147188.782354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.782593:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780480 00000100:00100000:1.0:1746147188.782600:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780480 00002000:00100000:1.0:1746147188.782636:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012e2b8a80 x1830967463780480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.782646:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967463780480 ext(0->1048575) 00002000:00010000:1.0:1746147188.782651:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:1.0:1746147188.782691:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4517 00000100:00100000:1.0:1746147188.782698:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463780480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.789457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.792061:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780608 00000100:00100000:3.0:1746147188.792076:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780608 00010000:00010000:3.0:1746147188.792123:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.793014:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5815 00000100:00100000:3.0:1746147188.793026:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463780608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.793043:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.793073:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.793090:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.793116:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1400/0xb4b2209fbdac6c42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b39 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.794034:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.794037:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.794045:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.794053:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.794087:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.794099:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466418176:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147188.794900:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967463780480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12198us (12543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147188.794909:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4517 00002000:00100000:1.0:1746147188.794920:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012e2b8a80 x1830967463780480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.794928:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8a80 with x1830967463780480 ext(0->1048575) 00002000:00010000:1.0:1746147188.794933:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8a80 00000100:00100000:3.0:1746147188.795115:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.802232:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466418176:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.802259:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.802314:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967463780608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9290us (12867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.802325:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5815 00000100:00100000:0.0:1746147188.808907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.809029:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780864 00000100:00100000:1.0:1746147188.809038:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780864 00002000:00100000:1.0:1746147188.809084:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012c9f3100 x1830967463780864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.809100:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967463780864 ext(1048576->2097151) 00002000:00010000:1.0:1746147188.809105:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:1.0:1746147188.809137:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4518 00000100:00100000:1.0:1746147188.809144:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463780864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.810462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.810546:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463780992 00000100:00100000:2.0:1746147188.810553:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463780992 00000100:00100000:2.0:1746147188.810612:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11764 00000100:00100000:2.0:1746147188.810621:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:28967:x1830967463780992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.810636:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.810656:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c4a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.810681:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.810683:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.810693:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.810709:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.810720:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72e600, rc 0) 00000100:00100000:2.0:1746147188.810777:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:28967:x1830967463780992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 158us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.810783:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11764 00000100:00100000:0.0:1746147188.816841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.816900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.816967:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463781248 00000100:00100000:1.0:1746147188.816968:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463781504 00000100:00100000:3.0:1746147188.816976:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463781248 00000100:00100000:1.0:1746147188.816976:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463781504 00000100:00100000:0.0:1746147188.816988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147188.817014:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012c9f1880 x1830967463781248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.817014:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2088959) req@ffff88012c9f1f80 x1830967463781504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147188.817015:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463781760 00000100:00100000:0.0:1746147188.817020:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463781760 00002000:00100000:3.0:1746147188.817024:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967463781248 ext(1048576->2097151) 00002000:00100000:1.0:1746147188.817024:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967463781504 ext(1048576->2088959) 00002000:00010000:3.0:1746147188.817030:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1880 00002000:00010000:1.0:1746147188.817030:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1f80 00002000:00100000:0.0:1746147188.817044:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1675264->2097151) req@ffff88012c9f3800 x1830967463781760/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147188.817049:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4519 00002000:00100000:0.0:1746147188.817052:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967463781760 ext(1675264->2097151) 00002000:00010000:0.0:1746147188.817056:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:3.0:1746147188.817065:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4520 00000100:00100000:3.0:1746147188.817071:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463781248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147188.817075:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4521 00000100:00100000:0.0:1746147188.817081:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463781760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.819381:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463781504:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.826130:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463780864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16975us (17221us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.826142:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4518 00002000:00100000:2.0:1746147188.826152:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012c9f3100 x1830967463780864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.826161:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3100 with x1830967463780864 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.826166:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f3100 00000100:00100000:2.0:1746147188.833924:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463781760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16831us (16925us total) trans 0 rc 421888/421888 00000100:00100000:2.0:1746147188.833953:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4521 00002000:00100000:2.0:1746147188.833966:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1675264->2097151) req@ffff88012c9f3800 x1830967463781760/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 421888/421888 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.833976:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3800 with x1830967463781760 ext(1675264->2097151) 00000100:00100000:3.0:1746147188.833979:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463781248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16906us (17151us total) trans 0 rc 1048576/1048576 00002000:00010000:2.0:1746147188.833982:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f3800 00000100:00100000:3.0:1746147188.833986:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4520 00002000:00100000:3.0:1746147188.833992:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012c9f1880 x1830967463781248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.834000:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1880 with x1830967463781248 ext(1048576->2097151) 00002000:00010000:3.0:1746147188.834004:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1880 00010000:00010000:2.0:1746147188.835240:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147188.837032:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463781504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17659us (20125us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746147188.837043:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4519 00002000:00100000:1.0:1746147188.837052:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2088959) req@ffff88012c9f1f80 x1830967463781504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.837060:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967463781504 ext(1048576->2088959) 00002000:00010000:1.0:1746147188.837066:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f1f80 00000100:00100000:0.0:1746147188.837996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.838079:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463781888 00000100:00100000:3.0:1746147188.838086:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463781888 00000100:00100000:3.0:1746147188.838127:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11765 00000100:00100000:3.0:1746147188.838134:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28964:x1830967463781888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.838149:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.838170:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c51 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.838197:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.838210:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.838211:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.838215:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.838243:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.838254:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 31 pid: 17530 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.838266:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418304:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.838346:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.843982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.844083:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782016 00000100:00100000:3.0:1746147188.844091:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782016 00000100:00100000:3.0:1746147188.844137:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11766 00000100:00100000:3.0:1746147188.844146:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:28967:x1830967463782016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.844165:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.844182:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c58 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.844209:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.844215:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.844218:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.844222:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.844249:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.844259:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 16 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.844271:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466418432:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.844655:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.844793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.844856:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782144 00000100:00100000:0.0:1746147188.844860:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782144 00002000:00100000:0.0:1746147188.844888:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (2088960->2097151) req@ffff88009f769f80 x1830967463782144/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 8680/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.844898:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769f80 with x1830967463782144 ext(2088960->2097151) 00010000:00010000:0.0:1746147188.844905:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.844914:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 32 pid: 17530 timeout: 675 lvb_type: 0 00002000:00010000:0.0:1746147188.844922:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f769f80 00000100:00100000:2.0:1746147188.845062:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418304:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.845082:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.845092:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486c00, rc 0) 00000100:00100000:2.0:1746147188.845114:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28964:x1830967463781888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6981us (7120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.845120:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11765 00000100:00100000:0.0:1746147188.845178:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1544 00000100:00100000:0.0:1746147188.845184:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463782144:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.845506:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463782144:12345-192.168.203.36@tcp:4:cat.0 Request processed in 321us (712us total) trans 17179873233 rc 0/0 00000100:00100000:0.0:1746147188.845512:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1544 00002000:00100000:0.0:1746147188.845516:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (2088960->2097151) req@ffff88009f769f80 x1830967463782144/t17179873233(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 8680/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.845523:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769f80 with x1830967463782144 ext(2088960->2097151) 00010000:00010000:0.0:1746147188.845528:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 34 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.845536:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 34 pid: 17530 timeout: 675 lvb_type: 0 00002000:00010000:0.0:1746147188.845541:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f769f80 00000100:00100000:0.0:1746147188.847285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.847335:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782272 00000100:00100000:2.0:1746147188.847340:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782272 00000100:00100000:2.0:1746147188.847625:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11767 00000100:00100000:2.0:1746147188.847632:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28969:x1830967463782272:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.847645:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147188.847653:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466418432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.847660:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c5f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.847678:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.847683:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.847687:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3000, rc 0) 00010000:00010000:2.0:1746147188.847690:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.847697:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.847703:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.847704:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.847707:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.847728:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.847743:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.847753:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418560:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.847773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.847851:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28967:x1830967463782016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3706us (3879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.847857:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11766 00010000:00010000:2.0:1746147188.847866:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 8 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.847874:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 8 pid: 11147 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.847877:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782400 00000100:00100000:3.0:1746147188.847880:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782400 00000100:00100000:2.0:1746147188.847881:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418688:192.168.203.36@tcp:104: 00002000:00100000:3.0:1746147188.847900:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2142208->2265087) req@ffff88012c9f3480 x1830967463782400/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147188.847904:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147188.847907:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3480 with x1830967463782400 ext(2142208->2265087) 00010000:00010000:3.0:1746147188.847912:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 17 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.847916:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 16 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.847924:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418816:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.847970:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147188.848162:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 17 pid: 8481 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.848170:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f3480 00000100:00100000:3.0:1746147188.848193:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1545 00000100:00100000:3.0:1746147188.848199:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463782400:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147188.849343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.850417:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782528 00000100:00100000:3.0:1746147188.850423:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782528 00010000:00010000:3.0:1746147188.850451:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 36 pid: 17530 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.850486:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5816 00000100:00100000:3.0:1746147188.850493:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463782528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.850505:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.850524:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 36 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.850534:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 36 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.850554:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bb7 expref: 36 pid: 17530 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.850624:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.850627:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.850635:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.850642:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.850672:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.850750:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466418944:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.850829:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.851713:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418560:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.852671:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463782400:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4470us (4896us total) trans 21474840640 rc 0/0 00000100:00100000:3.0:1746147188.852682:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1545 00002000:00100000:3.0:1746147188.852692:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2142208->2265087) req@ffff88012c9f3480 x1830967463782400/t21474840640(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.852701:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f3480 with x1830967463782400 ext(2142208->2265087) 00010000:00010000:3.0:1746147188.852711:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.852722:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.852728:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f3480 00000100:00100000:0.0:1746147188.854193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.854208:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418688:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.854217:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466418816:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147188.854223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147188.854245:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.854261:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72e000, rc 0) 00000100:00100000:0.0:1746147188.854270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.854344:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782656 00000100:00100000:3.0:1746147188.854350:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782656 00010000:00010000:3.0:1746147188.854373:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 9 pid: 11147 timeout: 675 lvb_type: 1 00000100:00100000:3.0:1746147188.854391:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782784 00000100:00100000:3.0:1746147188.854393:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782784 00010000:00010000:3.0:1746147188.854401:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 17 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.854414:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463782912 00000100:00100000:3.0:1746147188.854415:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463782912 00010000:00010000:3.0:1746147188.854425:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.854434:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5817 00000100:00100000:3.0:1746147188.854440:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463782656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.854450:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.854484:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 9 pid: 11147 timeout: 675 lvb_type: 1 00010000:00010000:3.0:1746147188.854493:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 9 pid: 11147 timeout: 675 lvb_type: 1 00000100:00100000:1.0:1746147188.854534:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5818 00000100:00100000:1.0:1746147188.854542:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463782784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.854548:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147188.854646:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:28969:x1830967463782272:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7014us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.854652:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11767 00000100:00100000:2.0:1746147188.854683:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5819 00000100:00100000:2.0:1746147188.854688:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463782912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147188.854695:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.855051:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72f400/0xb4b2209fbdac6cff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bda expref: 9 pid: 11147 timeout: 675 lvb_type: 1 00010000:00010000:1.0:1746147188.855211:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 17 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.855220:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 17 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.855233:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136966200/0xb4b2209fbdac6c57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b40 expref: 17 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.855245:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147188.855420:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.855429:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.855442:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6cab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6b94 expref: 35 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.855455:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.855456:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.855463:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.855475:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.855504:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147188.855516:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466419072:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147188.855540:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463782784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 999us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.855546:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5818 00010000:00010000:3.0:1746147188.855572:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.856092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.856103:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463782656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1662us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.856112:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5817 00000100:00100000:3.0:1746147188.856122:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463783040 00000100:00100000:3.0:1746147188.856126:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463783040 00000100:00100000:2.0:1746147188.856201:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147188.856275:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.856292:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5820 00000100:00100000:3.0:1746147188.856297:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463783040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.856306:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147188.856416:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466418944:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147188.856432:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.856461:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463782528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5968us (7119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.856466:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5816 00002000:00010000:3.0:1746147188.856647:0:7121:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147187 -> 1746147188 00010000:00010000:3.0:1746147188.856655:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.856664:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.856681:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72f200/0xb4b2209fbdac6d53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2142208->3145727] (req 2142208->2265087) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c04 expref: 19 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.856690:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.856691:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.856695:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.856702:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.856726:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.856734:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419200:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147188.856753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.856813:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463783296 00000100:00100000:2.0:1746147188.856816:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463783296 00002000:00100000:2.0:1746147188.856841:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012c9f0e00 x1830967463783296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.856854:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967463783296 ext(1048576->2097151) 00002000:00010000:2.0:1746147188.856858:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:2.0:1746147188.856878:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4522 00000100:00100000:2.0:1746147188.856884:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463783296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.857373:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.858500:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466419072:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.858515:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.858539:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463782912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3850us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.858546:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5819 00000100:00100000:0.0:1746147188.861619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.861834:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463783424 00000100:00100000:2.0:1746147188.861843:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463783424 00000100:00100000:3.0:1746147188.861863:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419200:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.861879:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147188.861886:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11768 00000100:00100000:2.0:1746147188.861893:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:28969:x1830967463783424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147188.861910:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.861928:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c66 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.861931:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463783040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5632us (5837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.861963:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5820 00010000:00010000:2.0:1746147188.862260:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.862268:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.862270:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.862273:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.862301:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.862311:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 24 pid: 8480 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.862329:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466419328:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.862568:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.867334:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.867431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.867570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.867929:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463783808 00000100:00100000:2.0:1746147188.867961:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463783808 00002000:00100000:2.0:1746147188.868004:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012c9f1c00 x1830967463783808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.868014:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1c00 with x1830967463783808 ext(2097152->3145727) 00010000:00010000:2.0:1746147188.868023:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 25 pid: 8480 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.868038:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 25 pid: 8480 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.868045:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1c00 00000100:00100000:2.0:1746147188.868064:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784064 00000100:00100000:2.0:1746147188.868066:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784064 00002000:00100000:2.0:1746147188.868078:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3858431) req@ffff8800a0449f80 x1830967463784064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.868085:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463784064 ext(3145728->3858431) 00002000:00010000:2.0:1746147188.868089:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449f80 00000100:00100000:2.0:1746147188.868098:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463783936 00000100:00100000:2.0:1746147188.868100:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463783936 00002000:00100000:2.0:1746147188.868110:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a0449180 x1830967463783936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.868120:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967463783936 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.868122:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449180 00000100:00100000:2.0:1746147188.868132:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1546 00000100:00100000:2.0:1746147188.868139:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463783808:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147188.868670:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4523 00000100:00100000:0.0:1746147188.868678:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463784064:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147188.868729:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4524 00000100:00100000:0.0:1746147188.868734:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463783936:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147188.868866:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466419328:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.868889:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.868902:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ec00, rc 0) 00000100:00100000:3.0:1746147188.868962:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28969:x1830967463783424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7070us (7353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.868968:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11768 00000100:00100000:1.0:1746147188.870767:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463783296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13875us (14007us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147188.870779:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4522 00002000:00100000:1.0:1746147188.870788:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012c9f0e00 x1830967463783296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.870796:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0e00 with x1830967463783296 ext(1048576->2097151) 00002000:00010000:1.0:1746147188.870802:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c9f0e00 00000100:00100000:1.0:1746147188.876901:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463784064:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 8213us (9459us total) trans 0 rc 712704/712704 00000100:00100000:1.0:1746147188.876913:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4523 00002000:00100000:1.0:1746147188.876924:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3858431) req@ffff8800a0449f80 x1830967463784064/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 712704/712704 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.876963:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463784064 ext(3145728->3858431) 00002000:00010000:1.0:1746147188.876969:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449f80 00000100:00100000:0.0:1746147188.877552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.877701:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784320 00000100:00100000:3.0:1746147188.877709:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784320 00000100:00100000:3.0:1746147188.877867:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11769 00000100:00100000:3.0:1746147188.877873:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28964:x1830967463784320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.877889:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.877907:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c6d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.877958:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.877966:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.877968:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.877972:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.878002:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.878014:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 25 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.878026:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466419456:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.878207:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.880996:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463783808:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12845us (13663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.881010:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1546 00002000:00100000:2.0:1746147188.881020:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012c9f1c00 x1830967463783808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.881030:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1c00 with x1830967463783808 ext(2097152->3145727) 00010000:00010000:2.0:1746147188.881041:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 24 pid: 8480 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.881054:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 24 pid: 8480 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.881060:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1c00 00000100:00100000:3.0:1746147188.881912:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466419456:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.881958:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.881977:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b1c00, rc 0) 00000100:00100000:3.0:1746147188.881999:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:28964:x1830967463784320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4126us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.882005:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11769 00000100:00100000:0.0:1746147188.882490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.882557:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784448 00000100:00100000:2.0:1746147188.882563:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784448 00002000:00100000:2.0:1746147188.882608:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1675263) req@ffff8800a044aa00 x1830967463784448/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.882616:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967463784448 ext(1048576->1675263) 00010000:00010000:2.0:1746147188.882622:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 24 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.882633:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 24 pid: 8481 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.882638:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044aa00 00000100:00100000:2.0:1746147188.884002:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1547 00000100:00100000:2.0:1746147188.884014:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463784448:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147188.885122:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463783936:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16381us (17547us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147188.885131:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4524 00002000:00100000:0.0:1746147188.885141:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a0449180 x1830967463783936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.885150:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449180 with x1830967463783936 ext(2097152->3145727) 00002000:00010000:0.0:1746147188.885156:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449180 00000100:00100000:0.0:1746147188.886437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.886763:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784576 00000100:00100000:3.0:1746147188.886770:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784576 00010000:00010000:3.0:1746147188.886800:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 26 pid: 8480 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.886835:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5821 00000100:00100000:3.0:1746147188.886842:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463784576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.886854:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.886874:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 26 pid: 8480 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.886884:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 26 pid: 8480 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.886907:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac6db5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c58 expref: 26 pid: 8480 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.886933:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.886952:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.886960:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.886972:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.887006:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.888298:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419584:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.888397:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.890323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.890419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.890452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.890600:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784704 00000100:00100000:3.0:1746147188.890608:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784704 00000100:00100000:3.0:1746147188.890648:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784832 00000100:00100000:3.0:1746147188.890650:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784832 00000100:00100000:3.0:1746147188.890672:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463784960 00000100:00100000:3.0:1746147188.890674:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463784960 00000100:00100000:3.0:1746147188.890689:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11770 00000100:00100000:3.0:1746147188.890696:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463784704:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147188.890696:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11771 00000100:00100000:2.0:1746147188.890703:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463784832:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.890713:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.890713:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.890729:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c74 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.890729:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6dd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c7b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.890748:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.890750:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.890757:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.890771:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147188.890773:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466419712:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.890784:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0a00, rc 0) 00000100:00100000:2.0:1746147188.890834:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147188.890846:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463784704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 150us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.890852:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11770 00000100:00100000:3.0:1746147188.890867:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11772 00000100:00100000:3.0:1746147188.890871:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463784960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.890880:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.890887:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdac6ddf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c82 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.890904:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdac6ddf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c82 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.890912:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1a00/0xb4b2209fbdac6ddf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c82 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.890921:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b1a00, rc 0) 00000100:00100000:3.0:1746147188.891040:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463784960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (484us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.891046:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11772 00000100:00100000:3.0:1746147188.894261:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466419712:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147188.894293:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6dd8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c7b expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.894310:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72fe00/0xb4b2209fbdac6dd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c7b expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.894320:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72fe00, rc 0) 00000100:00100000:3.0:1746147188.894372:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463784832:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3667us (3950us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147188.894380:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11771 00000100:00100000:3.0:1746147188.894617:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419584:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.894626:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.894658:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463784576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7816us (8226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.894666:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5821 00000100:00100000:0.0:1746147188.895170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.895227:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785216 00000100:00100000:1.0:1746147188.895236:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785216 00002000:00100000:1.0:1746147188.895273:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4501504->4505599) req@ffff8800a044a300 x1830967463785216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.895283:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a300 with x1830967463785216 ext(4501504->4505599) 00002000:00010000:1.0:1746147188.895287:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044a300 00000100:00100000:1.0:1746147188.895304:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4525 00000100:00100000:1.0:1746147188.895310:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463785216:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147188.895464:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463785216:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 154us (295us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147188.895471:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4525 00002000:00100000:1.0:1746147188.895476:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4501504->4505599) req@ffff8800a044a300 x1830967463785216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.895483:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a300 with x1830967463785216 ext(4501504->4505599) 00002000:00010000:1.0:1746147188.895485:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044a300 00000100:00100000:3.0:1746147188.897600:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463784448:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13572us (15093us total) trans 21474840641 rc 0/0 00000100:00100000:3.0:1746147188.897610:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1547 00002000:00100000:3.0:1746147188.897620:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1675263) req@ffff8800a044aa00 x1830967463784448/t21474840641(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147188.897628:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044aa00 with x1830967463784448 ext(1048576->1675263) 00010000:00010000:3.0:1746147188.897636:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 25 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.897647:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 25 pid: 8481 timeout: 675 lvb_type: 0 00002000:00010000:3.0:1746147188.897656:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044aa00 00000100:00100000:0.0:1746147188.898424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.898508:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785344 00000100:00100000:3.0:1746147188.898517:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785344 00000100:00100000:3.0:1746147188.898575:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11773 00000100:00100000:3.0:1746147188.898583:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28967:x1830967463785344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.898607:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.898623:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c89 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.898645:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.898651:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.898653:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147188.898656:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4505600->4927487] (req 4505600->4927487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.898684:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.898693:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 26 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.898703:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466419840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.898785:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.902435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.902702:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785472 00000100:00100000:3.0:1746147188.902712:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785472 00010000:00010000:3.0:1746147188.902747:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 27 pid: 8481 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.902784:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5822 00000100:00100000:3.0:1746147188.902792:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463785472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.902803:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.902821:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 27 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.902832:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 27 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.902850:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0xb4b2209fbdac6d1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bef expref: 27 pid: 8481 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.902863:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.902865:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.902871:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.902878:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.902908:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.902919:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419968:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.903008:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.903572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.903647:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785600 00000100:00100000:2.0:1746147188.903651:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785600 00002000:00100000:2.0:1746147188.903675:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4505599) req@ffff8800a044b100 x1830967463785600/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.903684:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b100 with x1830967463785600 ext(4194304->4505599) 00010000:00010000:2.0:1746147188.903690:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.903700:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.903710:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044b100 00000100:00100000:3.0:1746147188.903799:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466419840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.903815:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4505600->4927487] (req 4505600->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.903823:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ea00, rc 0) 00000100:00100000:3.0:1746147188.903858:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28967:x1830967463785344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5276us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.903864:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11773 00000100:00100000:2.0:1746147188.904975:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1548 00000100:00100000:2.0:1746147188.904985:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463785600:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147188.905617:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466419968:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.905638:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.905667:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967463785472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2875us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.905674:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5822 00000100:00100000:2.0:1746147188.907498:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.907814:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785856 00000100:00100000:1.0:1746147188.907823:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785856 00002000:00100000:1.0:1746147188.907861:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f769180 x1830967463785856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.907881:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769180 with x1830967463785856 ext(1048576->2097151) 00002000:00010000:1.0:1746147188.907885:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769180 00000100:00100000:1.0:1746147188.907913:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4526 00000100:00100000:1.0:1746147188.907920:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463785856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.908737:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463785600:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3753us (5164us total) trans 21474840642 rc 0/0 00000100:00100000:2.0:1746147188.908744:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1548 00002000:00100000:2.0:1746147188.908750:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4505599) req@ffff8800a044b100 x1830967463785600/t21474840642(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.908756:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b100 with x1830967463785600 ext(4194304->4505599) 00010000:00010000:2.0:1746147188.908762:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.908774:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:2.0:1746147188.908780:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044b100 00000100:00100000:0.0:1746147188.913269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.913767:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463785984 00000100:00100000:3.0:1746147188.913777:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463785984 00010000:00010000:3.0:1746147188.913810:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.913848:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5823 00000100:00100000:3.0:1746147188.913855:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463785984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.913868:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.913886:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.913901:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.913919:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6dc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->4915199] (req 4194304->4505599) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c66 expref: 27 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.913956:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.913958:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.913965:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.913972:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.914004:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.914014:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466420096:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.914095:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.916776:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463785856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8844us (9271us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147188.916787:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4526 00002000:00100000:1.0:1746147188.916798:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f769180 x1830967463785856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.916807:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769180 with x1830967463785856 ext(1048576->2097151) 00002000:00010000:1.0:1746147188.916814:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769180 00000100:00100000:3.0:1746147188.917166:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466420096:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.917191:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.917228:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463785984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3373us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.917236:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5823 00000100:00100000:0.0:1746147188.920268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.920417:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463786240 00000100:00100000:1.0:1746147188.920425:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463786240 00002000:00100000:1.0:1746147188.920464:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4505600->4923391) req@ffff8800a0448380 x1830967463786240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.920474:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463786240 ext(4505600->4923391) 00002000:00010000:1.0:1746147188.920653:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448380 00000100:00100000:1.0:1746147188.920809:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4527 00000100:00100000:1.0:1746147188.920817:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463786240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.928730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.928803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.928829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.928904:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463786496 00000100:00100000:2.0:1746147188.928916:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463786496 00000100:00100000:2.0:1746147188.928982:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463786368 00000100:00100000:2.0:1746147188.928985:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463786368 00000100:00100000:2.0:1746147188.929006:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463786624 00000100:00100000:2.0:1746147188.929008:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463786624 00000100:00100000:3.0:1746147188.929021:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11774 00000100:00100000:3.0:1746147188.929034:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463786496:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147188.929037:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11775 00000100:00100000:2.0:1746147188.929045:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463786368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147188.929057:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.929061:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147188.929073:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11776 00010000:00010000:3.0:1746147188.929075:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c97 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.929075:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c90 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147188.929081:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463786624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.929088:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.929096:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.929097:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.929098:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.929098:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbee00/0xb4b2209fbdac6dfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6c9e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.929099:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.929105:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 22 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.929107:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.929119:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 22 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.929121:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147188.929128:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094069800, rc 0) 00010000:00010000:2.0:1746147188.929130:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55800, rc 0) 00000100:00100000:1.0:1746147188.929135:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466420224:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147188.929173:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463786496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 144us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.929178:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11774 00000100:00100000:2.0:1746147188.929192:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463786368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 147us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.929198:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11775 00000100:00100000:1.0:1746147188.929214:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.929446:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463786240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8631us (9187us total) trans 0 rc 417792/417792 00000100:00100000:1.0:1746147188.929452:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4527 00002000:00100000:1.0:1746147188.929458:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4505600->4923391) req@ffff8800a0448380 x1830967463786240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 417792/417792 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.929464:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463786240 ext(4505600->4923391) 00002000:00010000:1.0:1746147188.929467:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448380 00002000:00010000:1.0:1746147188.932646:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147187 -> 1746147188 00000100:00100000:1.0:1746147188.932670:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466420224:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147188.932699:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbee00/0xb4b2209fbdac6dfb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c9e expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.932712:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbee00/0xb4b2209fbdac6dfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c9e expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.932733:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbee00, rc 0) 00000100:00100000:1.0:1746147188.932771:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463786624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3690us (3940us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147188.932781:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11776 00000100:00100000:0.0:1746147188.934417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.934711:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463786752 00000100:00100000:1.0:1746147188.934718:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463786752 00000100:00100000:1.0:1746147188.934753:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11777 00000100:00100000:1.0:1746147188.934760:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463786752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147188.934773:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.934787:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ca5 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.934804:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.934806:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147188.934812:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.934822:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147188.934877:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbf000, rc 0) 00000100:00100000:1.0:1746147188.934919:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463786752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 158us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.934925:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11777 00000100:00100000:0.0:1746147188.940186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.940225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.940266:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787008 00000100:00100000:1.0:1746147188.940275:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787008 00002000:00100000:1.0:1746147188.940315:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a5ba1880 x1830967463787008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.940323:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1880 with x1830967463787008 ext(2097152->3145727) 00002000:00010000:1.0:1746147188.940329:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba1880 00000100:00100000:1.0:1746147188.940347:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4528 00000100:00100000:1.0:1746147188.940354:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463787008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147188.940462:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787136 00000100:00100000:2.0:1746147188.940466:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787136 00000100:00100000:2.0:1746147188.940485:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10527 00000100:00100000:2.0:1746147188.940488:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:28973:x1830967463787136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147188.940502:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.940514:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6e09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cac expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.940550:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940558:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940564:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940572:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940575:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940578:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940672:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940682:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 36 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.940688:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 323 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.940694:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.940805:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 323 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.940814:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 323 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.940835:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420352:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.940925:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 36 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.940931:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 36 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.940961:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420480:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.940987:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.943792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.943890:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420352:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.943899:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420480:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.943917:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147188.944184:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787392 00000100:00100000:3.0:1746147188.944191:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787392 00000100:00100000:3.0:1746147188.944239:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4175 00000100:00100000:3.0:1746147188.944246:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+324:7641:x1830967463787392:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147188.944439:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:7641:x1830967463787392:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 192us (652us total) trans 8589944279 rc 0/0 00000100:00100000:3.0:1746147188.945642:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4175 00000100:00100000:0.0:1746147188.946665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.946897:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787648 00000100:00100000:3.0:1746147188.946905:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787648 00000100:00100000:3.0:1746147188.946964:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4176 00000100:00100000:3.0:1746147188.946971:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+37:14478:x1830967463787648:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147188.947138:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+38:14478:x1830967463787648:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 166us (475us total) trans 8589944280 rc 0/0 00000100:00100000:3.0:1746147188.947143:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4176 00000100:00100000:1.0:1746147188.947448:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463787008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7093us (7265us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147188.947455:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4528 00002000:00100000:1.0:1746147188.947463:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a5ba1880 x1830967463787008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.947470:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1880 with x1830967463787008 ext(2097152->3145727) 00002000:00010000:1.0:1746147188.947474:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba1880 00000100:00100000:0.0:1746147188.950503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.950565:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787776 00000100:00100000:3.0:1746147188.950574:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787776 00000100:00100000:0.0:1746147188.950574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147188.950618:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 325 pid: 14048 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.950653:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463787904 00000100:00100000:3.0:1746147188.950655:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463787904 00010000:00010000:3.0:1746147188.950665:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 38 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.950678:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5824 00000100:00100000:3.0:1746147188.950685:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1957:x1830967463787776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.950696:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.950701:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 325 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950710:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 325 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950726:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0xb4b2209fbdac6d92 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c3c expref: 325 pid: 14048 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950736:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.950740:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950747:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950751:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950755:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.950792:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1957:x1830967463787776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.950798:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5824 00000100:00100000:3.0:1746147188.950810:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5825 00000100:00100000:3.0:1746147188.950814:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1958:x1830967463787904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.950820:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.950824:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 38 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950831:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 38 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950902:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6d45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6bfd expref: 38 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.950911:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.950914:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950919:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950928:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.950970:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.951038:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1958:x1830967463787904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 222us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.951043:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5825 00010000:00010000:2.0:1746147188.951181:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.951190:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147188.952257:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:2.0:1746147188.952261:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147188.952275:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952286:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952295:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952301:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952307:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952312:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d55200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147188.952316:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952322:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952332:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147188.952334:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147188.952337:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952341:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55200/0xb4b2209fbdac6e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952373:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952378:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952383:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952387:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d55c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147188.952389:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952393:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952402:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d8b9200) 00010000:00010000:2.0:1746147188.952403:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147188.952406:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952410:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55c00/0xb4b2209fbdac6e17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.952443:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6e09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.952454:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.952460:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147188.952462:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147188.952464:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55000, rc 0) 00000100:00100000:2.0:1746147188.952498:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+19:28973:x1830967463787136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 12007us (12270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.952505:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10527 00000100:00100000:0.0:1746147188.954028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.954098:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788032 00000100:00100000:2.0:1746147188.954106:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788032 00000100:00100000:2.0:1746147188.954146:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11778 00000100:00100000:2.0:1746147188.954152:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:28964:x1830967463788032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147188.954164:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.954177:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cb3 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.954207:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.954213:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.954214:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147188.954217:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.954240:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.954249:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 33 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.954258:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466420608:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.954313:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147188.955774:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466420608:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.955793:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.955804:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d0200, rc 0) 00000100:00100000:2.0:1746147188.955832:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28964:x1830967463788032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1679us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.955839:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11778 00000100:00100000:0.0:1746147188.957696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.957725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.957744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.957754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.957769:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788288 00000100:00100000:0.0:1746147188.957775:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788288 00000100:00100000:0.0:1746147188.957806:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788416 00000100:00100000:0.0:1746147188.957808:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788416 00000100:00100000:0.0:1746147188.957817:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788544 00000100:00100000:0.0:1746147188.957818:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788544 00000100:00100000:0.0:1746147188.957826:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11779 00000100:00100000:0.0:1746147188.957832:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463788288:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147188.957843:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.957854:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cba expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.957868:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.957870:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.957876:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.957886:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.957895:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491fe00, rc 0) 00000100:00100000:0.0:1746147188.957921:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463788288:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.957926:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11779 00000100:00100000:0.0:1746147188.957953:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11780 00000100:00100000:0.0:1746147188.957958:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463788416:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147188.957965:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.957972:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cc1 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.957982:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.957983:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.957986:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.957994:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.957999:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491fa00, rc 0) 00000100:00100000:0.0:1746147188.958012:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463788416:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.958017:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11780 00000100:00100000:0.0:1746147188.958025:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11781 00000100:00100000:0.0:1746147188.958029:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463788544:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147188.958037:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.958042:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cc8 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.958050:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958051:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958055:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958063:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958069:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f600, rc 0) 00000100:00100000:0.0:1746147188.958084:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463788544:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.958089:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11781 00000100:00100000:0.0:1746147188.958111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.958123:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788672 00000100:00100000:0.0:1746147188.958126:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788672 00000100:00100000:0.0:1746147188.958138:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11782 00000100:00100000:0.0:1746147188.958142:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463788672:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147188.958148:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.958154:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ccf expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.958165:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958166:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958170:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958178:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958185:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ec00, rc 0) 00000100:00100000:0.0:1746147188.958198:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463788672:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.958203:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11782 00000100:00100000:0.0:1746147188.958237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.958247:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788800 00000100:00100000:0.0:1746147188.958249:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788800 00000100:00100000:0.0:1746147188.958262:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11783 00000100:00100000:0.0:1746147188.958276:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463788800:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147188.958282:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.958288:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cd6 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.958298:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958299:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.958303:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958312:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.958318:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ea00, rc 0) 00000100:00100000:0.0:1746147188.958332:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463788800:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.958334:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788160 00000100:00100000:0.0:1746147188.958337:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11783 00000100:00100000:1.0:1746147188.958338:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788160 00002000:00100000:1.0:1746147188.958359:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3858432->4194303) req@ffff8800a5ba3100 x1830967463788160/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.958367:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3100 with x1830967463788160 ext(3858432->4194303) 00000100:00100000:0.0:1746147188.958370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147188.958373:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 34 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.958380:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463788928 00000100:00100000:0.0:1746147188.958382:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463788928 00010000:00010000:1.0:1746147188.958383:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 34 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:1.0:1746147188.958388:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ba3100 00000100:00100000:0.0:1746147188.958401:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11784 00000100:00100000:0.0:1746147188.958406:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463788928:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147188.958412:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1549 00010000:00010000:0.0:1746147188.958412:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147188.958416:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463788160:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147188.958417:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491ee00/0xb4b2209fbdac6e4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cdd expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.958447:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466420736:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147188.958490:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.962212:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ba0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466420736:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147188.962239:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491ee00/0xb4b2209fbdac6e4f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cdd expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.962252:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491ee00/0xb4b2209fbdac6e4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cdd expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.962887:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ee00, rc 0) 00000100:00100000:0.0:1746147188.962928:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463788928:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4520us (4556us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.962950:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11784 00000100:00100000:1.0:1746147188.963857:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463788160:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5438us (6163us total) trans 17179873234 rc 0/0 00000100:00100000:1.0:1746147188.963865:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1549 00002000:00100000:1.0:1746147188.963872:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3858432->4194303) req@ffff8800a5ba3100 x1830967463788160/t17179873234(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.963880:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3100 with x1830967463788160 ext(3858432->4194303) 00010000:00010000:1.0:1746147188.963888:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.963899:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00002000:00010000:1.0:1746147188.963905:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ba3100 00000100:00100000:2.0:1746147188.967834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.967917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.968395:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463789312 00000100:00100000:2.0:1746147188.968395:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463789184 00000100:00100000:3.0:1746147188.968403:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463789312 00000100:00100000:2.0:1746147188.968403:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463789184 00010000:00010000:3.0:1746147188.968430:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.968450:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10528 00000100:00100000:2.0:1746147188.968457:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+19:28973:x1830967463789184:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147188.968471:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147188.968480:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5826 00010000:00010000:2.0:1746147188.968483:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6e56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ce4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.968486:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463789312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.968497:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.968512:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.968522:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.968537:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e000/0xb4b2209fbdac6dbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c5f expref: 36 pid: 17548 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147188.968550:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.968558:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147188.968560:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.968561:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.968565:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.968567:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.968572:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.968604:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.968614:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147188.968624:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147188.968695:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147188.968730:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147188.968739:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466420992:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147188.968803:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.969916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.970061:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466420864:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147188.970077:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147188.970693:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466420992:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147188.970708:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.970735:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463789312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2249us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.970741:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5826 00000100:00100000:3.0:1746147188.970759:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463789440 00000100:00100000:3.0:1746147188.970763:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463789440 00010000:00010000:3.0:1746147188.970779:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 21 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.970793:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5827 00000100:00100000:3.0:1746147188.970798:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+21:1957:x1830967463789440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147188.970806:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147188.970810:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 21 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.970817:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 21 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.970831:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d55000/0xb4b2209fbdac6e1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cac expref: 21 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.970839:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147188.970843:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.970850:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.970854:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.970877:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147188.970892:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+20:1957:x1830967463789440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.970897:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5827 00010000:00010000:2.0:1746147188.970966:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147188.970972:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147188.970985:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147188.971287:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d0800/0xb4b2209fbdac6e56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.971972:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.971979:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147188.971981:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147188.971983:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1e00, rc 0) 00000100:00100000:2.0:1746147188.972023:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463789184:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3566us (4107us total) trans 8589944281 rc 0/0 00000100:00100000:2.0:1746147188.972030:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10528 00000100:00100000:2.0:1746147188.974650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.974954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147188.975120:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463789824 00000100:00100000:3.0:1746147188.975129:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463789824 00000100:00100000:3.0:1746147188.975170:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463789696 00000100:00100000:3.0:1746147188.975172:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463789696 00000100:00100000:3.0:1746147188.975191:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10529 00000100:00100000:3.0:1746147188.975198:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463789824:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147188.975216:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147188.975230:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094068c00/0xb4b2209fbdac6e6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cf2 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.975291:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.975306:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.975312:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.975334:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.975342:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 21 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147188.975352:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466421120:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147188.975411:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147188.975459:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10530 00000100:00100000:1.0:1746147188.975465:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+37:28976:x1830967463789696:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147188.975477:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147188.975484:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbea00/0xb4b2209fbdac6e79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ceb expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.975529:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.975535:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.975540:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.975548:0:16361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147188.975556:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147188.976756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.976785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147188.976904:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790080 00000100:00100000:2.0:1746147188.976910:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790080 00002000:00100000:2.0:1746147188.976962:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a5ba2a00 x1830967463790080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.976975:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2a00 with x1830967463790080 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.976979:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba2a00 00000100:00100000:2.0:1746147188.976994:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790208 00000100:00100000:2.0:1746147188.976997:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790208 00002000:00100000:2.0:1746147188.977009:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a5ba1180 x1830967463790208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.977020:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1180 with x1830967463790208 ext(3145728->4194303) 00002000:00010000:2.0:1746147188.977022:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1180 00000100:00100000:2.0:1746147188.977034:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4529 00000100:00100000:2.0:1746147188.977040:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463790080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147188.977270:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4530 00000100:00100000:1.0:1746147188.977278:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463790208:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147188.977470:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466421120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147188.977489:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147188.977566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.977579:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790464 00000100:00100000:0.0:1746147188.977581:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790464 00010000:00010000:0.0:1746147188.977607:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 22 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:0.0:1746147188.977622:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5828 00000100:00100000:0.0:1746147188.977625:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:1957:x1830967463790464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.977632:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.977636:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 22 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.977644:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 22 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.977658:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5d1e00/0xb4b2209fbdac6e5d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ce4 expref: 22 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:0.0:1746147188.977670:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147188.977674:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147188.977680:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147188.977685:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147188.977693:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147188.977698:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147188.977708:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.977732:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+21:1957:x1830967463790464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.977737:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5828 00010000:00010000:3.0:1746147188.977930:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.977951:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147188.977982:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147188.977985:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147188.977995:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147188.978018:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094068c00/0xb4b2209fbdac6e6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 21 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147188.978031:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.978036:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:3.0:1746147188.978041:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b385a00, rc 0) 00000100:00100000:3.0:1746147188.978061:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463789824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2864us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147188.978066:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10529 00000100:00100000:0.0:1746147188.982576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147188.982628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.982686:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790720 00000100:00100000:1.0:1746147188.982695:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790720 00010000:00010000:1.0:1746147188.982723:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00000100:00100000:1.0:1746147188.982748:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5829 00000100:00100000:1.0:1746147188.982755:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+20:1957:x1830967463790720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147188.982769:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147188.982774:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.982784:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.982802:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b385a00/0xb4b2209fbdac6e72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf2 expref: 20 pid: 14049 timeout: 675 lvb_type: 0 00010000:00010000:1.0:1746147188.982817:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.982821:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.982829:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.982835:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.982854:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147188.982886:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463790720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147188.982892:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5829 00010000:00010000:1.0:1746147188.982913:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147188.982919:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147188.982932:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00100000:2.0:1746147188.983033:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790592 00000100:00100000:2.0:1746147188.983037:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790592 00000100:00100000:2.0:1746147188.983101:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11785 00000100:00100000:2.0:1746147188.983107:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463790592:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147188.983118:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147188.983129:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6cf9 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147188.983141:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.983143:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147188.983148:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.983159:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147188.983166:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1200, rc 0) 00000100:00100000:2.0:1746147188.983182:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463790592:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 76us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147188.983187:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11785 00010000:00010000:1.0:1746147188.983417:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbea00/0xb4b2209fbdac6e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 40 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.983427:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 39 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147188.983432:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147188.983434:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147188.983436:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbf200, rc 0) 00000100:00100000:1.0:1746147188.984167:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28976:x1830967463789696:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8700us (9210us total) trans 8589944282 rc 0/0 00000100:00100000:1.0:1746147188.984173:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10530 00000100:00100000:1.0:1746147188.987983:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463790208:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10699us (11189us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147188.987994:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4530 00002000:00100000:1.0:1746147188.988006:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a5ba1180 x1830967463790208/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147188.988015:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1180 with x1830967463790208 ext(3145728->4194303) 00002000:00010000:1.0:1746147188.988020:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1180 00000100:00100000:2.0:1746147188.989756:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463790080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12713us (12997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147188.989765:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4529 00002000:00100000:2.0:1746147188.989772:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a5ba2a00 x1830967463790080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:564/0 lens 488/440 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147188.989778:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2a00 with x1830967463790080 ext(2097152->3145727) 00002000:00010000:2.0:1746147188.989782:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba2a00 00000100:00100000:2.0:1746147188.998149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147188.999888:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463790848 00000100:00100000:1.0:1746147188.999922:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463790848 00000100:00100000:1.0:1746147188.999993:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10531 00000100:00100000:1.0:1746147189.000000:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:28973:x1830967463790848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147189.000025:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.000040:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6e95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d00 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.000885:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d00 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.000900:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d00 expref: 20 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.000920:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.000923:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147189.000926:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f72ec00, rc 0) 00000100:00100000:2.0:1746147189.001102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.001162:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463791104 00000100:00100000:3.0:1746147189.001169:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463791104 00002000:00100000:3.0:1746147189.001261:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76b480 x1830967463791104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.001270:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b480 with x1830967463791104 ext(4194304->4927487) 00002000:00010000:3.0:1746147189.001275:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b480 00000100:00100000:3.0:1746147189.001318:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4531 00000100:00100000:3.0:1746147189.001327:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463791104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147189.002471:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463790848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1012us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.002479:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10531 00000100:00080000:2.0:1746147189.003102:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147189.008360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.008656:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463791360 00000100:00100000:1.0:1746147189.008665:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463791360 00000100:00100000:1.0:1746147189.008731:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10532 00000100:00100000:1.0:1746147189.008739:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463791360:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147189.008755:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.008771:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6e9c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d07 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.008853:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.008869:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 38 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.008876:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.008911:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 38 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.008924:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 38 pid: 16361 timeout: 675 lvb_type: 0 00000100:00100000:3.0:1746147189.008968:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463791104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7641us (7865us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746147189.008968:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6570700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466421248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.008977:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4531 00002000:00100000:3.0:1746147189.008985:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009f76b480 x1830967463791104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.008993:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76b480 with x1830967463791104 ext(4194304->4927487) 00002000:00010000:3.0:1746147189.008997:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76b480 00000100:00080000:2.0:1746147189.009074:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147189.010012:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.021496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.021669:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6570700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466421248:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.021691:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147189.021761:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463791488 00000100:00100000:2.0:1746147189.021768:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463791488 00010000:00010000:2.0:1746147189.021796:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 39 pid: 16361 timeout: 675 lvb_type: 0 00000100:00100000:2.0:1746147189.021818:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5830 00000100:00100000:2.0:1746147189.021825:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1958:x1830967463791488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.021838:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.021843:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 39 pid: 16361 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147189.021851:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 39 pid: 16361 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147189.021869:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac6e80 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ceb expref: 39 pid: 16361 timeout: 675 lvb_type: 0 00010000:00010000:2.0:1746147189.022060:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.022066:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147189.022073:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147189.022079:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147189.022094:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.022143:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1958:x1830967463791488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 317us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.022149:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5830 00010000:00010000:1.0:1746147189.022259:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022265:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022279:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022283:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022288:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022293:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85acc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147189.022296:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022300:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022307:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.022309:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147189.022311:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022314:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85acc00/0xb4b2209fbdac6ea3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.022351:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6e9c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d07 expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.022357:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85aca00/0xb4b2209fbdac6e9c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d07 expref: 21 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.022367:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85aca00, rc 0) 00000100:00100000:1.0:1746147189.022385:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463791360:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 13648us (14032us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147189.022390:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10532 00000100:00100000:0.0:1746147189.023417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.023470:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463791744 00000100:00100000:1.0:1746147189.023475:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463791744 00000100:00100000:1.0:1746147189.023505:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10533 00000100:00100000:1.0:1746147189.023511:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+324:28978:x1830967463791744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147189.023527:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.023538:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac6eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d0e expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.023615:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.023623:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:1.0:1746147189.023630:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:1.0:1746147189.023636:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147189.023716:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ad600/0xb4b2209fbdac6eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 327 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.023726:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 326 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.023736:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.023738:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147189.023740:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85ada00, rc 0) 00000100:00100000:1.0:1746147189.023816:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28978:x1830967463791744:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 304us (401us total) trans 8589944283 rc 0/0 00000100:00100000:1.0:1746147189.023821:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10533 00000100:00100000:0.0:1746147189.025986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.027095:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792000 00000100:00100000:1.0:1746147189.027105:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792000 00000100:00100000:1.0:1746147189.027416:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4177 00000100:00100000:1.0:1746147189.027425:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+20:28973:x1830967463792000:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147189.028592:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+21:28973:x1830967463792000:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 1157us (2600us total) trans 8589944284 rc 0/0 00000100:00100000:1.0:1746147189.028600:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4177 00000100:00100000:0.0:1746147189.039324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.039767:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792128 00000100:00100000:3.0:1746147189.039776:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792128 00000100:00100000:3.0:1746147189.039844:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11786 00000100:00100000:3.0:1746147189.039852:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:28976:x1830967463792128:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147189.039868:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.039885:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d15 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.039909:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.039917:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.039924:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.039929:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.039930:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.039933:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1601536->2097151] (req 1601536->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.039986:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 34 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.039995:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 34 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.040010:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421376:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.040093:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.040100:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.040107:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421504:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.040133:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.040139:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.040146:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421632:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.040160:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00080000:2.0:1746147189.040220:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147189.043409:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421376:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.043420:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421504:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.043427:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466421632:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.043459:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1601536->2097151] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.043479:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5000, rc 0) 00000100:00100000:3.0:1746147189.043527:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:28976:x1830967463792128:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3676us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.043534:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11786 00000100:00100000:0.0:1746147189.044827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.045893:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792256 00000100:00100000:2.0:1746147189.045901:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792256 00010000:00010000:2.0:1746147189.045931:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 35 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:1.0:1746147189.046537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.047354:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792384 00000100:00100000:2.0:1746147189.047360:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792384 00010000:00010000:2.0:1746147189.047389:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 11 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.047407:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5831 00000100:00100000:2.0:1746147189.047414:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463792256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.047427:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147189.047440:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5832 00010000:00010000:2.0:1746147189.047446:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 35 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.047447:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463792384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.047455:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.047460:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 35 pid: 4445 timeout: 676 lvb_type: 1 00000100:00080000:3.0:1746147189.047558:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147189.047617:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 11 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.047627:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0a00/0xb4b2209fbdac6dd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c74 expref: 35 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.047627:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 11 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.047642:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac6e3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc8 expref: 11 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.047653:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.047686:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463792256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 272us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.047692:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5831 00000100:00100000:1.0:1746147189.047800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.047919:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792512 00000100:00100000:2.0:1746147189.047922:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792512 00010000:00010000:2.0:1746147189.047934:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.047961:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5833 00000100:00100000:2.0:1746147189.047967:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463792512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.047974:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.047981:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.047989:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.047998:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f486c00/0xb4b2209fbdac6dae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c51 expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.048006:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.048008:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.048012:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.048018:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.048044:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.048053:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466421760:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.048097:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc840 going to sleep for 11 seconds 00010000:00010000:0.0:1746147189.048144:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.048169:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463792384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 723us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.048174:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5832 00000100:00100000:1.0:1746147189.050689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.050834:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792768 00000100:00100000:3.0:1746147189.050842:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792768 00002000:00100000:3.0:1746147189.050877:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1601536->1605631) req@ffff8800a6570a80 x1830967463792768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.050886:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570a80 with x1830967463792768 ext(1601536->1605631) 00002000:00010000:3.0:1746147189.050890:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570a80 00000100:00100000:2.0:1746147189.051045:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466421760:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.051060:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.051091:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463792512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3123us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.051099:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5833 00000100:00100000:3.0:1746147189.051255:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4532 00000100:00100000:3.0:1746147189.051262:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463792768:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.052087:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463792768:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 823us (1402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147189.052093:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4532 00002000:00100000:3.0:1746147189.052099:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1601536->1605631) req@ffff8800a6570a80 x1830967463792768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.052106:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570a80 with x1830967463792768 ext(1601536->1605631) 00002000:00010000:3.0:1746147189.052109:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570a80 00000100:00100000:0.0:1746147189.064731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.064818:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463792896 00000100:00100000:3.0:1746147189.064828:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463792896 00000100:00100000:3.0:1746147189.064869:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11787 00000100:00100000:3.0:1746147189.064878:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28976:x1830967463792896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147189.064895:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.064909:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d1c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.064933:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.064983:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.064990:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.064997:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.064998:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.065001:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.065989:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.066002:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 26 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.066013:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466421888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.066096:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.066105:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.066112:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.066136:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.066144:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.066152:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.066168:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.073803:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466421888:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.073830:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.073840:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.073878:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.073894:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2e3000, rc 0) 00000100:00100000:3.0:1746147189.073972:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28976:x1830967463792896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9094us (9248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.073981:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11787 00000100:00100000:0.0:1746147189.074613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.074636:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793152 00000100:00100000:0.0:1746147189.074641:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793152 00010000:00010000:0.0:1746147189.074678:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 13 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.074696:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5834 00000100:00100000:0.0:1746147189.074701:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463793152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.074712:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.074728:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 13 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074737:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 13 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074754:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ec00/0xb4b2209fbdac6e41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ccf expref: 13 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074771:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.074786:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463793152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.074791:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5834 00000100:00100000:0.0:1746147189.074835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.074844:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793024 00000100:00100000:0.0:1746147189.074846:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793024 00010000:00010000:0.0:1746147189.074859:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.074872:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5835 00000100:00100000:0.0:1746147189.074877:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463793024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.074882:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.074888:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074896:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074905:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac6e02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ca5 expref: 27 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.074912:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.074925:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463793024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.074932:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5835 00000100:00100000:0.0:1746147189.075037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.075048:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793280 00000100:00100000:0.0:1746147189.075050:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793280 00010000:00010000:0.0:1746147189.075059:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.075070:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5836 00000100:00100000:0.0:1746147189.075073:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463793280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.075078:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.075084:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.075091:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.075100:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1c00/0xb4b2209fbdac6dca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c6d expref: 22 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.075108:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.075109:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.075114:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.075120:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.075148:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.075158:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466422272:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147189.075201:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00080000:3.0:1746147189.075613:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147189.077223:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466422272:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.077238:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.077264:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463793280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2188us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.077272:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5836 00000100:00100000:0.0:1746147189.079263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.079337:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793536 00000100:00100000:3.0:1746147189.079345:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793536 00002000:00100000:3.0:1746147189.079381:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1060864->1064959) req@ffff88009f76d180 x1830967463793536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.079390:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d180 with x1830967463793536 ext(1060864->1064959) 00002000:00010000:3.0:1746147189.079394:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76d180 00000100:00100000:3.0:1746147189.079411:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4533 00000100:00100000:3.0:1746147189.079418:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463793536:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.080089:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463793536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 669us (829us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147189.080096:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4533 00002000:00100000:3.0:1746147189.080102:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1060864->1064959) req@ffff88009f76d180 x1830967463793536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.080109:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76d180 with x1830967463793536 ext(1060864->1064959) 00002000:00010000:3.0:1746147189.080112:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76d180 00000100:00100000:0.0:1746147189.084125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.084203:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793792 00000100:00100000:1.0:1746147189.084212:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793792 00000100:00100000:1.0:1746147189.084261:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4178 00000100:00100000:1.0:1746147189.084268:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+38:28976:x1830967463793792:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147189.084459:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28976:x1830967463793792:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 191us (342us total) trans 8589944285 rc 0/0 00000100:00100000:1.0:1746147189.084465:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4178 00000100:00100000:0.0:1746147189.121984:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.122049:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463793920 00000100:00100000:3.0:1746147189.122059:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463793920 00000100:00100000:3.0:1746147189.122112:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11788 00000100:00100000:3.0:1746147189.122120:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:28978:x1830967463793920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147189.122136:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.122151:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d23 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.122175:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.122183:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.122189:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.122190:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.122193:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.122219:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.122230:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 9 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.122241:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466422400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.126311:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.126328:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 16 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.126341:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466422528:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.127079:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.129166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.129323:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794048 00000100:00100000:2.0:1746147189.129331:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794048 00010000:00010000:2.0:1746147189.129363:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.129391:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5837 00000100:00100000:2.0:1746147189.129398:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463794048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.129411:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.129429:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.129439:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.129461:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147189.129599:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6e8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cf9 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.129619:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466422400:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.130744:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463794048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1342us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.130752:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5837 00000100:00100000:3.0:1746147189.133313:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466422528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.133352:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.133367:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e18a00, rc 0) 00000100:00100000:3.0:1746147189.133423:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28978:x1830967463793920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11303us (11444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.133431:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11788 00000100:00100000:1.0:1746147189.137161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.137454:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794176 00000100:00100000:3.0:1746147189.137463:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794176 00010000:00010000:3.0:1746147189.137495:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.137605:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5838 00000100:00100000:3.0:1746147189.137614:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463794176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.138145:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.138169:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.138182:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.138201:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5d0200/0xb4b2209fbdac6e25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cb3 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.138840:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.138842:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.138850:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.138858:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.138894:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.138905:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466422656:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147189.140550:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.144348:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466422656:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147189.144371:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.144420:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463794176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6806us (7264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.144429:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5838 00000100:00100000:0.0:1746147189.144604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.144675:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794432 00000100:00100000:3.0:1746147189.144682:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794432 00002000:00100000:3.0:1746147189.144712:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3117056->3121151) req@ffff88009f76c380 x1830967463794432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.144721:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76c380 with x1830967463794432 ext(3117056->3121151) 00002000:00010000:3.0:1746147189.144725:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76c380 00000100:00100000:3.0:1746147189.145052:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4534 00000100:00100000:3.0:1746147189.145061:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463794432:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.145205:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463794432:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 145us (601us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147189.145211:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4534 00002000:00100000:3.0:1746147189.145216:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3117056->3121151) req@ffff88009f76c380 x1830967463794432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.145223:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76c380 with x1830967463794432 ext(3117056->3121151) 00002000:00010000:3.0:1746147189.145226:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f76c380 00000100:00100000:0.0:1746147189.148577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.149626:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794560 00000100:00100000:3.0:1746147189.149637:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794560 00000100:00100000:1.0:1746147189.150076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.150155:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794688 00000100:00100000:2.0:1746147189.150158:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794688 00000100:00100000:2.0:1746147189.150190:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11789 00000100:00100000:2.0:1746147189.150197:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:28978:x1830967463794688:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.150212:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.150226:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d31 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150248:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150260:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.150266:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.150272:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150279:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150284:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147189.150285:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147189.150288:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 8/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->3919871] (req 3145728->3919871) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150313:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150322:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 27 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.150332:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.150398:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150406:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.150413:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422912:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.150433:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.150440:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 20 pid: 8481 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.150446:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423040:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.150465:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.150472:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 11 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.150479:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423168:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.150498:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.150504:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.150514:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423296:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.150526:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.150594:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10534 00000100:00100000:3.0:1746147189.150600:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+21:28982:x1830967463794560:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.150612:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.150623:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac6edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d2a expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.150667:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150676:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150685:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150696:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150701:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150706:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150795:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150804:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 325 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.150808:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.150825:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 325 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.150831:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 325 pid: 16361 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.150838:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466423424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.150857:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.154648:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422784:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.154657:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466422912:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.154663:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423040:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.154668:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423168:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.154674:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466423296:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.154701:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [3145728->3919871] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 27 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.154715:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d5d1200, rc 0) 00000100:00100000:2.0:1746147189.154796:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28978:x1830967463794688:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4599us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.154804:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11789 00000100:00100000:0.0:1746147189.159367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.159394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.159418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.159439:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795072 00000100:00100000:0.0:1746147189.159447:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795072 00010000:00010000:0.0:1746147189.159477:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.159498:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795200 00000100:00100000:0.0:1746147189.159501:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795200 00010000:00010000:0.0:1746147189.159510:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 326 pid: 16361 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.159521:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795328 00000100:00100000:0.0:1746147189.159523:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795328 00010000:00010000:0.0:1746147189.159529:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.159543:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5839 00000100:00100000:0.0:1746147189.159550:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463795072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.159562:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.159580:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.159598:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.159615:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac6e48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cd6 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.159631:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.159668:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463795072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.159674:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5839 00000100:00100000:0.0:1746147189.159687:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5840 00000100:00100000:0.0:1746147189.159691:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1957:x1830967463795200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.159700:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.159703:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 326 pid: 16361 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159710:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 326 pid: 16361 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159725:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147189.159729:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147189.159737:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147189.159743:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147189.159755:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.159765:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+326:1957:x1830967463795200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.159769:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5840 00000100:00100000:0.0:1746147189.159775:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5841 00000100:00100000:0.0:1746147189.159779:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463795328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.159783:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.159789:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159795:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159804:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f72ea00/0xb4b2209fbdac6de6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4505600->4927487) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c89 expref: 27 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159810:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.159818:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463795328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.159822:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5841 00000100:00100000:0.0:1746147189.159862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.159873:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794816 00000100:00100000:0.0:1746147189.159875:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794816 00010000:00010000:0.0:1746147189.159883:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 26 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.159893:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5842 00000100:00100000:0.0:1746147189.159896:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463794816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.159900:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.159905:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 26 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159912:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 26 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159920:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0xb4b2209fbdac69be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6980 expref: 26 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.159926:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.159958:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463794816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.159962:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5842 00000100:00100000:0.0:1746147189.160012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.160019:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795456 00000100:00100000:0.0:1746147189.160022:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795456 00010000:00010000:0.0:1746147189.160029:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 21 pid: 8481 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.160038:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5843 00000100:00100000:0.0:1746147189.160042:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463795456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.160046:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.160051:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 21 pid: 8481 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.160057:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 21 pid: 8481 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.160066:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094069800/0xb4b2209fbdac6ded lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c97 expref: 21 pid: 8481 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.160072:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.160081:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463795456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 39us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.160085:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5843 00000100:00100000:0.0:1746147189.160113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.160120:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463794944 00000100:00100000:0.0:1746147189.160122:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463794944 00010000:00010000:0.0:1746147189.160129:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.160139:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5844 00000100:00100000:0.0:1746147189.160143:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463794944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.160149:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.160155:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.160163:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.160171:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308b5600/0xb4b2209fbdac69a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e696b expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.160180:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.160181:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.160186:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.160192:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.160214:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.160224:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466423552:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147189.160266:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147189.160454:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85ada00/0xb4b2209fbdac6eb1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d0e expref: 325 pid: 16361 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.160469:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466423424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.160484:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160491:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160499:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147189.160529:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147189.160533:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147189.160545:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160554:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160561:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160566:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160571:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160576:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e18000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147189.160579:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160595:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160602:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147189.160605:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147189.160607:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160611:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160624:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160628:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160632:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160636:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147189.160638:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160642:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160648:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13c00) 00010000:00010000:3.0:1746147189.160650:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147189.160652:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160656:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac6ee9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.160682:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac6edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.160691:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 22 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.160697:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.160699:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147189.160701:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2e2200, rc 0) 00000100:00100000:3.0:1746147189.160723:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:28982:x1830967463794560:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 10123us (12153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.160729:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10534 00000100:00100000:1.0:1746147189.163844:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466423552:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147189.163862:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.163910:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463794944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3765us (3795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.163918:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5844 00000100:00100000:2.0:1746147189.164353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.164556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.164696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.165867:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795584 00000100:00100000:3.0:1746147189.165877:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795584 00000100:00100000:3.0:1746147189.165914:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795712 00000100:00100000:3.0:1746147189.165915:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795712 00000100:00100000:3.0:1746147189.165926:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795840 00000100:00100000:3.0:1746147189.165927:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795840 00000100:00100000:3.0:1746147189.165954:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11790 00000100:00100000:3.0:1746147189.165962:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463795584:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.165977:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.165992:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac6ef7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d38 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.166036:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466423680:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.166105:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.166123:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11791 00000100:00100000:3.0:1746147189.166128:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463795712:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.166135:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.166143:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6efe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d3f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.166164:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466423808:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.166182:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.166197:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11792 00000100:00100000:3.0:1746147189.166202:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463795840:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.166207:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.166213:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6f05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d46 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.166226:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6f05 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d46 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.166235:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6f05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d46 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.166244:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6c00, rc 0) 00000100:00100000:3.0:1746147189.166263:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463795840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 61us (1567us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.166268:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11792 00000100:00100000:0.0:1746147189.167393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.168276:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466423808:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.168306:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6efe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d3f expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.168317:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6efe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d3f expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.168324:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6800, rc 0) 00000100:00100000:3.0:1746147189.168355:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463795712:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2226us (3798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.168365:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11791 00000100:00100000:3.0:1746147189.168385:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463795968 00000100:00100000:3.0:1746147189.168389:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463795968 00000100:00100000:3.0:1746147189.168407:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11793 00000100:00100000:3.0:1746147189.168413:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463795968:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.168422:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.168432:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdac6f0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d4d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.168459:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466423936:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.168491:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.168517:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466423680:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.168529:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac6ef7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d38 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.168537:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5c00/0xb4b2209fbdac6ef7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d38 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.168543:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b5c00, rc 0) 00000100:00100000:3.0:1746147189.168560:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463795584:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 2601us (4209us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.168565:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11790 00000100:00100000:3.0:1746147189.172455:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466423936:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.172490:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdac6f0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d4d expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.172504:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b7800/0xb4b2209fbdac6f0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d4d expref: 10 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.172514:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b7800, rc 0) 00000100:00100000:3.0:1746147189.172675:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463795968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4259us (5281us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.172682:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11793 00000100:00100000:2.0:1746147189.175333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.175405:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463796224 00000100:00100000:0.0:1746147189.175414:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463796224 00002000:00100000:0.0:1746147189.175451:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3915776->3919871) req@ffff88009f769c00 x1830967463796224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.175460:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769c00 with x1830967463796224 ext(3915776->3919871) 00002000:00010000:0.0:1746147189.175465:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769c00 00000100:00100000:0.0:1746147189.175492:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4535 00000100:00100000:0.0:1746147189.175499:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463796224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147189.175655:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463796224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 156us (328us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147189.175661:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4535 00002000:00100000:0.0:1746147189.175666:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3915776->3919871) req@ffff88009f769c00 x1830967463796224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.175673:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769c00 with x1830967463796224 ext(3915776->3919871) 00002000:00010000:0.0:1746147189.175675:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769c00 00000100:00100000:0.0:1746147189.176499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.176529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.176550:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463796352 00000100:00100000:3.0:1746147189.176555:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463796352 00000100:00100000:3.0:1746147189.176580:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463796480 00000100:00100000:3.0:1746147189.176581:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463796480 00000100:00100000:0.0:1746147189.176598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.176684:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463796608 00000100:00100000:3.0:1746147189.176687:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463796608 00000100:00100000:3.0:1746147189.176705:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11794 00000100:00100000:3.0:1746147189.176711:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463796352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.176723:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.176738:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d54 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.176781:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466424064:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.176832:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.176848:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11795 00000100:00100000:3.0:1746147189.176853:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463796480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.176859:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.176867:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdac6f1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d5b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.176890:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466424192:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.176908:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.176920:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11796 00000100:00100000:3.0:1746147189.176925:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463796608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.176931:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.176964:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b385800/0xb4b2209fbdac6f21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d62 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.176981:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b385800/0xb4b2209fbdac6f21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d62 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.176990:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b385800/0xb4b2209fbdac6f21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d62 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.176998:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b385800, rc 0) 00000100:00100000:3.0:1746147189.177016:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463796608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 90us (417us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.177021:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11796 00000100:00100000:0.0:1746147189.177799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.177879:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463796864 00000100:00100000:3.0:1746147189.177883:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463796864 00000100:00100000:3.0:1746147189.178822:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10535 00000100:00100000:3.0:1746147189.178831:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:28982:x1830967463796864:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.178847:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.178861:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6f28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d69 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.178957:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.178969:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.178976:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.179000:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.179009:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 23 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.179018:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466424320:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.179139:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.179517:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466424064:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.179543:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f13 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d54 expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.179552:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d54 expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.179560:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6400, rc 0) 00000100:00100000:2.0:1746147189.179658:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466424192:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.179675:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdac6f1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d5b expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.179688:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b7a00/0xb4b2209fbdac6f1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d5b expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147189.179716:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463796352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3003us (3218us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.179726:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11794 00010000:00010000:2.0:1746147189.179926:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b7a00, rc 0) 00000100:00100000:2.0:1746147189.180024:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463796480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3170us (3493us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.180029:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11795 00000100:00100000:0.0:1746147189.180542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.180651:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797120 00000100:00100000:3.0:1746147189.180659:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797120 00000100:00100000:3.0:1746147189.180695:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4179 00000100:00100000:3.0:1746147189.180700:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:28978:x1830967463797120:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147189.180827:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28978:x1830967463797120:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 126us (286us total) trans 8589944286 rc 0/0 00000100:00100000:3.0:1746147189.180834:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4179 00000100:00100000:0.0:1746147189.183429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.183628:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466424320:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.183648:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147189.185847:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797248 00000100:00100000:1.0:1746147189.185858:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797248 00010000:00010000:1.0:1746147189.185894:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.185934:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5845 00000100:00100000:1.0:1746147189.185977:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+24:1957:x1830967463797248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.185990:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.185994:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.186004:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.186022:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac6ef0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d2a expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.186036:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.186040:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.186047:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.186054:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.186082:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.186126:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+23:1957:x1830967463797248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 150us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.186132:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5845 00010000:00010000:3.0:1746147189.186205:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.186213:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147189.186229:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147189.186344:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac6f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d69 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.186360:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d69 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.186365:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.186367:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147189.186370:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e18e00, rc 0) 00000100:00100000:3.0:1746147189.186408:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:28982:x1830967463796864:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7578us (8610us total) trans 8589944287 rc 0/0 00000100:00100000:3.0:1746147189.186418:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10535 00000100:00100000:2.0:1746147189.191512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.191555:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797376 00000100:00100000:0.0:1746147189.191564:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797376 00000100:00100000:0.0:1746147189.191621:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11797 00000100:00100000:0.0:1746147189.191628:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:28985:x1830967463797376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147189.191643:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147189.191656:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d70 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.191684:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.191691:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147189.191692:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147189.191695:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.191721:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.191731:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 15 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.191741:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466424448:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147189.192556:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.192676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.192736:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797632 00000100:00100000:3.0:1746147189.192741:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797632 00000100:00100000:3.0:1746147189.192766:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10536 00000100:00100000:3.0:1746147189.192771:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:28982:x1830967463797632:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.192787:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.192790:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147189.192805:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e18e00/0xb4b2209fbdac6f2f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d69 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.192820:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.192823:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147189.192830:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6f44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d77 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.193435:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.193445:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.193453:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147189.193462:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147189.193551:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4600/0xb4b2209fbdac6f44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.193566:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 24 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.193572:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.193574:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147189.193575:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4800, rc 0) 00000100:00100000:3.0:1746147189.193627:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:28982:x1830967463797632:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 855us (952us total) trans 8589944288 rc 0/0 00000100:00100000:3.0:1746147189.193633:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10536 00000100:00100000:1.0:1746147189.193701:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466424448:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.193718:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.193728:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc9be00, rc 0) 00000100:00100000:1.0:1746147189.193745:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:28985:x1830967463797376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2119us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.193750:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11797 00000100:00100000:0.0:1746147189.195772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.195801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.195821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.195844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.196966:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797888 00000100:00100000:3.0:1746147189.196977:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797888 00000100:00100000:3.0:1746147189.197016:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798016 00000100:00100000:3.0:1746147189.197018:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798016 00000100:00100000:3.0:1746147189.197027:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798144 00000100:00100000:3.0:1746147189.197029:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798144 00000100:00100000:3.0:1746147189.197037:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798272 00000100:00100000:3.0:1746147189.197038:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798272 00000100:00100000:3.0:1746147189.197054:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11798 00000100:00100000:3.0:1746147189.197061:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463797888:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147189.197100:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197115:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197122:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197133:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 18 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197138:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.197140:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.197143:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197170:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 18 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197179:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 18 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.197189:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.197268:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197275:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.197283:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424704:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.197303:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197313:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 24 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.197319:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.197331:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.197348:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11799 00000100:00100000:3.0:1746147189.197353:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463798016:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147189.197370:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197379:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197385:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197391:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197395:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.197396:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.197398:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197412:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197420:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 35 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.197427:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466424960:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.197448:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 10 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.197455:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 10 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.197461:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466425088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.197481:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197488:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 15 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.197495:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466425216:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.197514:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137646e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.197527:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11800 00000100:00100000:3.0:1746147189.197532:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463798144:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147189.197545:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.197551:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11801 00010000:00010000:3.0:1746147189.197555:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147189.197559:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.197559:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463798272:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147189.197564:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147189.197566:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.197575:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197600:0:8478:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.197610:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.197611:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.197617:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147189.197618:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147189.197620:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.197635:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.197642:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 18 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.197649:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466425472:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147189.197670:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.198407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.198436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.198953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.199001:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798400 00000100:00100000:2.0:1746147189.199008:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798400 00000100:00100000:2.0:1746147189.199031:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798528 00000100:00100000:2.0:1746147189.199033:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798528 00000100:00100000:2.0:1746147189.199044:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11802 00000100:00100000:2.0:1746147189.199050:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463798400:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147189.199070:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199081:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199088:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199093:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147189.199094:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147189.199097:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199114:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199122:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.199129:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466425600:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.199178:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.199185:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 24 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.199192:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466425728:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.199209:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.199229:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463797760 00000100:00100000:2.0:1746147189.199232:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463797760 00002000:00100000:2.0:1746147189.199253:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1601536->2097151) req@ffff8800a56b5180 x1830967463797760/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.199262:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463797760 ext(1601536->2097151) 00010000:00010000:2.0:1746147189.199268:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 16 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.199281:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 16 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.199287:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b5180 00000100:00100000:2.0:1746147189.199305:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1550 00000100:00100000:2.0:1746147189.199310:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463797760:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147189.199905:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11803 00000100:00100000:3.0:1746147189.199912:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463798528:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147189.199927:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.199953:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.199958:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147189.199960:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147189.199962:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.199980:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.199987:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.199995:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466425856:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.200015:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137646f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.200571:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466424960:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.200579:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466425088:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.200594:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466425216:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.200612:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.200632:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424576:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.200639:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.200644:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466424832:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.200664:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.204373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.204445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.204458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.204488:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4672680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466425472:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.204508:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.204532:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798912 00000100:00100000:1.0:1746147189.204538:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798912 00010000:00010000:1.0:1746147189.204561:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 36 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.204579:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799040 00000100:00100000:1.0:1746147189.204580:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799040 00010000:00010000:1.0:1746147189.204599:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:1.0:1746147189.204618:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5846 00000100:00100000:1.0:1746147189.204625:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463798912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.204636:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.204653:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 36 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.204661:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 36 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.204678:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f72e600/0xb4b2209fbdac6da7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c4a expref: 36 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.204741:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5847 00000100:00100000:2.0:1746147189.204749:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463799040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.204757:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.204766:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.204774:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.204784:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac6e33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cc1 expref: 12 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.204798:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147189.205310:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.206986:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463799040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2224us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.206997:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5847 00000100:00100000:2.0:1746147189.207032:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799168 00000100:00100000:2.0:1746147189.207039:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799168 00002000:00100000:2.0:1746147189.207067:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1064959) req@ffff8800a56b4380 x1830967463799168/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 16872/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.207075:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4380 with x1830967463799168 ext(1048576->1064959) 00010000:00010000:2.0:1746147189.207082:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 19 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.207091:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 19 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.207096:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a56b4380 00000100:00100000:1.0:1746147189.207105:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463798912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2479us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.207111:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5846 00000100:00100000:2.0:1746147189.207114:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1551 00000100:00100000:2.0:1746147189.207119:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463799168:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147189.207410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.207418:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463799168:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 298us (3050us total) trans 21474840643 rc 0/0 00000100:00100000:2.0:1746147189.207424:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1551 00002000:00100000:2.0:1746147189.207428:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1064959) req@ffff8800a56b4380 x1830967463799168/t21474840643(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 16872/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.207434:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4380 with x1830967463799168 ext(1048576->1064959) 00010000:00010000:2.0:1746147189.207439:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 21 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.207445:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 21 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.207450:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a56b4380 00000100:00100000:3.0:1746147189.207755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.207779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.207806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.207873:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466425856:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.207892:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.207903:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798784 00000100:00100000:1.0:1746147189.207906:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798784 00000100:00100000:3.0:1746147189.207916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147189.207920:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 14 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:1.0:1746147189.207934:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799296 00000100:00100000:1.0:1746147189.207947:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799296 00010000:00010000:1.0:1746147189.207954:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 25 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.207962:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.208001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.208232:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463798656 00000100:00100000:0.0:1746147189.208235:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463798656 00010000:00010000:0.0:1746147189.208249:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 21 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.208265:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799424 00000100:00100000:0.0:1746147189.208267:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799424 00010000:00010000:0.0:1746147189.208279:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 18 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.208288:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799552 00000100:00100000:0.0:1746147189.208289:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799552 00010000:00010000:0.0:1746147189.208297:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 26 pid: 6881 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.208306:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5848 00000100:00100000:0.0:1746147189.208312:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463798784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.208319:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.208333:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 14 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208341:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 14 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208357:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac6e2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6cba expref: 14 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208371:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.208389:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463798784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 77us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.208394:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5848 00000100:00100000:0.0:1746147189.208404:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5849 00000100:00100000:0.0:1746147189.208409:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463799296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.208414:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.208420:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 26 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.208427:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 26 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.208437:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f360c00/0xb4b2209fbdac6d84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c35 expref: 26 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.208447:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.208458:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463799296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.208463:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5849 00000100:00100000:0.0:1746147189.208489:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5850 00000100:00100000:0.0:1746147189.208494:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463798656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.208499:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.208504:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 21 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208512:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 21 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208521:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6df4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c90 expref: 21 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.208530:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.208532:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.208535:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.208539:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5851 00010000:00010000:0.0:1746147189.208542:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.208546:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463799424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.208554:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.208558:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147189.208567:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 18 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.208569:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463798656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.208574:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5850 00010000:00010000:1.0:1746147189.208576:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 18 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.208596:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5852 00010000:00010000:1.0:1746147189.208600:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f360600/0xb4b2209fbdac6da0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6c43 expref: 18 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.208601:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463799552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.208606:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.208609:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.208611:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.208613:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.208614:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.208620:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.208622:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.208631:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147189.208636:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.208643:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463799552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.208648:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5852 00000100:00100000:1.0:1746147189.208654:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463799424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.208658:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5851 00010000:00010000:2.0:1746147189.208679:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1000/0xb4b2209fbdac6bb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4923392->18446744073709551615] (req 4923392->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6abb expref: 23 pid: 6881 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.208690:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466425600:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.208698:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b208000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466425728:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.208712:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.208725:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799808 00000100:00100000:2.0:1746147189.208727:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799808 00002000:00100000:2.0:1746147189.208744:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3117056->3145727) req@ffff8800a5a0f100 x1830967463799808/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.208751:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463799808 ext(3117056->3145727) 00010000:00010000:2.0:1746147189.208765:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.208773:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 35 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.208778:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0f100 00000100:00100000:2.0:1746147189.208799:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799680 00000100:00100000:2.0:1746147189.208801:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799680 00002000:00100000:2.0:1746147189.208811:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3919871) req@ffff8800a5a0f480 x1830967463799680/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.208818:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f480 with x1830967463799680 ext(3145728->3919871) 00010000:00010000:2.0:1746147189.208830:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 23 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.208839:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 23 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.208844:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0f480 00000100:00100000:1.0:1746147189.208845:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1552 00000100:00100000:1.0:1746147189.208852:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463799808:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147189.208858:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1553 00000100:00100000:2.0:1746147189.208863:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463799680:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:3.0:1746147189.208920:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208929:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208960:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208966:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208972:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208977:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b3b6400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147189.208979:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208989:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.208998:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209002:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.209044:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463798016:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 11690us (13241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.209050:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11799 00010000:00010000:3.0:1746147189.209077:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209083:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209093:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209098:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209103:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209112:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b17b4200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147189.209114:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209119:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209126:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.209130:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6f59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.209154:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463797888:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 12094us (13389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.209158:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11798 00000100:00100000:1.0:1746147189.210365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.210387:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463799936 00000100:00100000:0.0:1746147189.210393:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463799936 00010000:00010000:0.0:1746147189.210406:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.210421:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5853 00000100:00100000:0.0:1746147189.210425:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463799936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.210432:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.210441:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.210448:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.210459:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac6ec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d1c expref: 20 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.210466:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.210468:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.210470:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.210476:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.210488:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147189.210593:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210601:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210615:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210621:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210628:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210633:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc9b000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147189.210635:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210641:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210649:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.210654:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9b000/0xb4b2209fbdac6f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.211379:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463798272:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 13800us (15512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.211387:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11801 00000100:00100000:0.0:1746147189.211387:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463799936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 960us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.211396:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5853 00000100:00100000:1.0:1746147189.211813:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463799808:12345-192.168.203.36@tcp:4:cat.0 Request processed in 2961us (3849us total) trans 17179873235 rc 0/0 00000100:00100000:1.0:1746147189.211820:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1552 00002000:00100000:1.0:1746147189.211827:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3117056->3145727) req@ffff8800a5a0f100 x1830967463799808/t17179873235(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.211835:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f100 with x1830967463799808 ext(3117056->3145727) 00010000:00010000:1.0:1746147189.211842:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.211850:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.211856:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0f100 00000100:00100000:2.0:1746147189.212414:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463797760:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13102us (13476us total) trans 17179873236 rc 0/0 00000100:00100000:2.0:1746147189.212420:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1550 00002000:00100000:2.0:1746147189.212425:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41d:0x0] (1601536->2097151) req@ffff8800a56b5180 x1830967463797760/t17179873236(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.212431:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463797760 ext(1601536->2097151) 00010000:00010000:2.0:1746147189.212436:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.212445:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.212450:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b5180 00000100:00100000:2.0:1746147189.219794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.219872:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800064 00000100:00100000:1.0:1746147189.219880:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800064 00010000:00010000:1.0:1746147189.219908:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.219931:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5854 00000100:00100000:1.0:1746147189.219948:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463800064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.219959:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.219975:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.219985:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.220001:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e18a00/0xb4b2209fbdac6ecd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d23 expref: 37 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.220014:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.220015:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.220019:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.220026:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.220188:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147189.220386:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220394:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220411:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220418:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220425:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220430:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801309ece00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147189.220433:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220440:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220448:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.220453:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309ece00/0xb4b2209fbdac6f7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.220821:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463800064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 882us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.220827:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5854 00000100:00100000:2.0:1746147189.221043:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463798528:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 21131us (22606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.221049:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11803 00000100:00100000:2.0:1746147189.222338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.222386:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800192 00000100:00100000:1.0:1746147189.222393:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800192 00010000:00010000:1.0:1746147189.222419:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.222450:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5855 00000100:00100000:1.0:1746147189.222457:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463800192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.222469:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.222484:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.222493:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.222509:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308b5000/0xb4b2209fbdac6ebf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d15 expref: 17 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.222521:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.222522:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.222528:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.222536:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.222565:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.222574:0:7121:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 35 pid: 8481 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.222596:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6572d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466425984:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147189.223303:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.226611:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463799680:12345-192.168.203.36@tcp:4:cat.0 Request processed in 17736us (18598us total) trans 21474840644 rc 0/0 00000100:00100000:1.0:1746147189.226623:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1553 00002000:00100000:1.0:1746147189.226637:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3919871) req@ffff8800a5a0f480 x1830967463799680/t21474840644(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.226647:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0f480 with x1830967463799680 ext(3145728->3919871) 00010000:00010000:1.0:1746147189.226658:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.226668:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.226674:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5a0f480 00000100:00100000:3.0:1746147189.226826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.226849:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800448 00000100:00100000:3.0:1746147189.226857:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800448 00000100:00100000:3.0:1746147189.226894:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10537 00000100:00100000:3.0:1746147189.226900:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+39:28989:x1830967463800448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147189.226921:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147189.226933:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6572d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466425984:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147189.226934:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac6f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d7e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.226962:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.226998:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463800192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4541us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.227005:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5855 00010000:00010000:3.0:1746147189.227023:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.227036:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.227042:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.227063:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 23 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.227071:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 23 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.227080:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466426112:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.227137:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137646f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.227211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.227251:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800704 00000100:00100000:1.0:1746147189.227254:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800704 00002000:00100000:1.0:1746147189.227276:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a5a0d180 x1830967463800704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.227284:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d180 with x1830967463800704 ext(1048576->2097151) 00010000:00010000:1.0:1746147189.227289:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.227297:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.227302:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0d180 00000100:00100000:1.0:1746147189.227321:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1554 00000100:00100000:1.0:1746147189.227326:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463800704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.230003:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466426112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.230025:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147189.236450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.236639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.236716:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800960 00000100:00100000:3.0:1746147189.236725:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800960 00010000:00010000:3.0:1746147189.236758:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.236852:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463800832 00000100:00100000:3.0:1746147189.236855:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463800832 00010000:00010000:3.0:1746147189.236869:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.236888:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5856 00000100:00100000:3.0:1746147189.236896:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967463800960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.236907:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.236912:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.236921:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.236931:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5857 00010000:00010000:3.0:1746147189.236954:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6f4b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d77 expref: 24 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.236956:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463800832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.236969:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.236973:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.236978:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147189.236985:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.236987:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.236991:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.236996:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.237007:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147189.237012:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d5d1200/0xb4b2209fbdac6ed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4923391] (req 3145728->3919871) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d31 expref: 25 pid: 17548 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.237014:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.237019:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.237021:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.237023:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.237026:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746147189.237032:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147189.237033:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.237040:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+23:1956:x1830967463800960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 145us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.237045:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5856 00010000:00010000:1.0:1746147189.237048:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.237063:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463800832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.237068:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5857 00010000:00010000:2.0:1746147189.237281:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309ed800/0xb4b2209fbdac6f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 42 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237293:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 41 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237299:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.237306:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147189.237308:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309edc00, rc 0) 00000100:00100000:2.0:1746147189.237340:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+41:28989:x1830967463800448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10440us (10515us total) trans 8589944289 rc 0/0 00000100:00100000:2.0:1746147189.237346:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10537 00010000:00010000:2.0:1746147189.237365:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237371:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237386:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237393:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237400:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237405:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ddf0a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147189.237408:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237415:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237425:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.237430:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ddf0a00/0xb4b2209fbdac6f75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.237499:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463798400:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 38448us (39093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.237507:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11802 00000100:00100000:1.0:1746147189.239539:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463800704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12208us (12323us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147189.239548:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1554 00002000:00100000:1.0:1746147189.239557:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a5a0d180 x1830967463800704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.239565:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0d180 with x1830967463800704 ext(1048576->2097151) 00010000:00010000:1.0:1746147189.239573:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.239594:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.239600:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5a0d180 00000100:00100000:0.0:1746147189.248617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.248694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.248754:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801088 00000100:00100000:2.0:1746147189.248764:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801088 00000100:00100000:3.0:1746147189.248787:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801216 00000100:00100000:3.0:1746147189.248792:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801216 00010000:00010000:2.0:1746147189.248794:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.248823:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5858 00000100:00100000:3.0:1746147189.248825:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11804 00000100:00100000:2.0:1746147189.248830:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463801088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147189.248833:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:28985:x1830967463801216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.248843:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.248848:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.248861:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.248865:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d85 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.248872:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.248885:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141774, atime: 0x68141774, ctime: 0x68141774, blocks: 0x821 00010000:00010000:2.0:1746147189.248888:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9be00/0xb4b2209fbdac6f3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d70 expref: 36 pid: 8481 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.248900:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.248902:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.248902:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.248904:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.248907:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.248909:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.248913:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.248921:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.248930:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6400, rc 0) 00010000:00010000:2.0:1746147189.248931:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.249000:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463801088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 170us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.249006:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5858 00010000:00010000:2.0:1746147189.249045:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249106:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.249115:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:28985:x1830967463801216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 281us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.249121:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11804 00010000:00010000:2.0:1746147189.249125:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249131:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249136:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249141:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b3b6200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147189.249144:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249151:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249160:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.249165:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac6f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.249206:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463798144:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 51672us (53382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.249212:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11800 00000100:00100000:0.0:1746147189.249558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.249608:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801344 00000100:00100000:0.0:1746147189.249609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.249613:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801344 00000100:00100000:0.0:1746147189.249692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.249759:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801472 00000100:00100000:2.0:1746147189.249762:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801472 00000100:00100000:2.0:1746147189.249779:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801600 00000100:00100000:2.0:1746147189.249781:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801600 00000100:00100000:2.0:1746147189.249792:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11805 00000100:00100000:1.0:1746147189.249817:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11806 00000100:00100000:1.0:1746147189.249824:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463801472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.249833:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147189.249836:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11807 00010000:00010000:1.0:1746147189.249842:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d93 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.249844:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463801600:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.249853:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746147189.249854:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x68141774, atime: 0x68141774, ctime: 0x68141774, blocks: 0x821 00010000:00010000:1.0:1746147189.249862:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.249863:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d9a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.249863:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.249868:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147189.249874:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141774, atime: 0x68141774, ctime: 0x68141774, blocks: 0x821 00010000:00010000:1.0:1746147189.249881:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.249884:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.249886:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.249889:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b5000, rc 0) 00010000:00010000:3.0:1746147189.249891:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.249905:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 19 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.249913:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6800, rc 0) 00000100:00100000:1.0:1746147189.249922:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463801472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.249927:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11806 00000100:00100000:2.0:1746147189.249983:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463801344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.249992:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.250001:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6d8c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147189.250013:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141774, atime: 0x68141774, ctime: 0x68141774, blocks: 0x7f7 00010000:00010000:2.0:1746147189.250020:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.250022:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.250026:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.250034:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 20 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.250040:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ece00, rc 0) 00000100:00100000:2.0:1746147189.250059:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463801344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 262us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.250064:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11805 00000100:00100000:3.0:1746147189.250123:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463801600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 279us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.250129:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11807 00000100:00100000:0.0:1746147189.250968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.250993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.251153:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801728 00000100:00100000:3.0:1746147189.251158:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801728 00000100:00100000:3.0:1746147189.251175:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801856 00000100:00100000:3.0:1746147189.251177:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801856 00000100:00100000:3.0:1746147189.251187:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11808 00000100:00100000:3.0:1746147189.251191:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463801728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.251199:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.251207:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6da1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.251218:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.251219:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.251223:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.251231:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.251237:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6a00, rc 0) 00000100:00100000:3.0:1746147189.251256:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463801728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.251261:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11808 00000100:00100000:3.0:1746147189.251269:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11809 00000100:00100000:3.0:1746147189.251273:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463801856:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.251277:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.251283:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6da8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147189.251295:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4926336, mtime: 0x68141774, atime: 0x68141773, ctime: 0x68141774, blocks: 0x15df 00010000:00010000:3.0:1746147189.251300:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.251301:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.251304:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.251311:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.251317:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6c00, rc 0) 00000100:00100000:3.0:1746147189.251326:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463801856:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.251330:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11809 00000100:00100000:0.0:1746147189.251367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.251431:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463801984 00000100:00100000:2.0:1746147189.251435:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463801984 00000100:00100000:2.0:1746147189.251453:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11810 00000100:00100000:2.0:1746147189.251458:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463801984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.251465:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.251473:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6daf expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147189.251484:0:11147:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141774, atime: 0x68141774, ctime: 0x68141774, blocks: 0x1029 00010000:00010000:2.0:1746147189.251492:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.251494:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.251498:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 19 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.251507:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 19 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.251514:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801309ed800, rc 0) 00000100:00100000:2.0:1746147189.251534:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463801984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.251539:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11810 00000100:00100000:0.0:1746147189.254577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.254654:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463802240 00000100:00100000:1.0:1746147189.254662:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463802240 00002000:00100000:1.0:1746147189.254697:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f76f480 x1830967463802240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.254706:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76f480 with x1830967463802240 ext(1048576->2097151) 00002000:00010000:1.0:1746147189.254711:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76f480 00000100:00100000:1.0:1746147189.254773:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4536 00000100:00100000:1.0:1746147189.254780:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463802240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.259209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.260254:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463802496 00000100:00100000:3.0:1746147189.260263:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463802496 00000100:00100000:3.0:1746147189.260301:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10538 00000100:00100000:3.0:1746147189.260308:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:28982:x1830967463802496:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147189.260350:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.260370:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f72ec00/0xb4b2209fbdac6e95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d00 expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.260394:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147189.260398:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.260458:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:28982:x1830967463802496:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 149us (1254us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746147189.260464:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10538 00000100:00100000:0.0:1746147189.269415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.269473:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463802752 00000100:00100000:1.0:1746147189.269483:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463802752 00000100:00100000:1.0:1746147189.269538:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4180 00000100:00100000:1.0:1746147189.269545:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:28982:x1830967463802752:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147189.269737:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:28982:x1830967463802752:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 191us (328us total) trans 8589944290 rc 0/0 00000100:00100000:1.0:1746147189.269744:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4180 00000100:00100000:0.0:1746147189.271340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.272234:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463803008 00000100:00100000:2.0:1746147189.272245:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463803008 00002000:00100000:2.0:1746147189.272281:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134c54380 x1830967463803008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.272296:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967463803008 ext(0->1048575) 00002000:00010000:2.0:1746147189.272300:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:2.0:1746147189.272330:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4537 00000100:00100000:2.0:1746147189.272337:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463803008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.275462:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463802240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20674us (20881us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147189.275473:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4536 00002000:00100000:0.0:1746147189.275570:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f76f480 x1830967463802240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.275579:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76f480 with x1830967463802240 ext(1048576->2097151) 00002000:00010000:0.0:1746147189.275595:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76f480 00000100:00100000:0.0:1746147189.275643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.275715:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.275737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.275763:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463803392 00000100:00100000:0.0:1746147189.275770:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463803392 00000100:00100000:3.0:1746147189.275793:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463803264 00002000:00100000:0.0:1746147189.275794:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880134c54e00 x1830967463803392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147189.275797:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463803264 00002000:00100000:0.0:1746147189.275800:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967463803392 ext(1048576->2097151) 00002000:00010000:0.0:1746147189.275803:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00002000:00100000:3.0:1746147189.275813:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134c55880 x1830967463803264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147189.275815:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804032 00000100:00100000:0.0:1746147189.275817:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804032 00002000:00100000:3.0:1746147189.275820:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967463803264 ext(1048576->2097151) 00002000:00100000:0.0:1746147189.275824:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880134c55f80 x1830967463804032/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.275830:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55f80 with x1830967463804032 ext(1048576->2097151) 00002000:00010000:0.0:1746147189.275832:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55f80 00002000:00010000:3.0:1746147189.275835:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c55880 00000100:00100000:0.0:1746147189.276791:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4538 00000100:00100000:1.0:1746147189.276800:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4539 00000100:00100000:0.0:1746147189.276802:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463803392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147189.276810:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463804032:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147189.276811:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4540 00000100:00100000:3.0:1746147189.276819:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463803264:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.277381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.277701:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463803776 00000100:00100000:2.0:1746147189.277707:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463803776 00000100:00100000:2.0:1746147189.277733:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4181 00000100:00100000:2.0:1746147189.277737:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+23:28982:x1830967463803776:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147189.277873:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+24:28982:x1830967463803776:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 135us (492us total) trans 8589944291 rc 0/0 00000100:00100000:2.0:1746147189.277880:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4181 00000100:00100000:0.0:1746147189.286141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.286167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.286192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.286203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.286219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.286307:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804160 00000100:00100000:3.0:1746147189.286317:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804160 00000100:00100000:3.0:1746147189.286351:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804416 00000100:00100000:3.0:1746147189.286353:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804416 00000100:00100000:3.0:1746147189.286363:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804672 00000100:00100000:3.0:1746147189.286364:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804672 00000100:00100000:3.0:1746147189.286373:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804288 00000100:00100000:3.0:1746147189.286374:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804288 00000100:00100000:3.0:1746147189.286382:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804544 00000100:00100000:3.0:1746147189.286384:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804544 00000100:00100000:3.0:1746147189.286395:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11811 00000100:00100000:3.0:1746147189.286401:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463804160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.286416:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.286430:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6db6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.286449:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286451:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286458:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.286470:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147189.286473:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11812 00010000:00010000:3.0:1746147189.286479:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55800, rc 0) 00000100:00100000:1.0:1746147189.286481:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463804416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.286489:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.286498:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dc4 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.286509:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.286510:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.286515:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 38 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147189.286516:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463804160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.286522:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11811 00010000:00010000:1.0:1746147189.286524:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 38 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.286530:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4200, rc 0) 00000100:00100000:3.0:1746147189.286535:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11813 00000100:00100000:3.0:1746147189.286539:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463804672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.286543:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147189.286548:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463804416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147189.286549:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dd2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.286553:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11812 00010000:00010000:3.0:1746147189.286556:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286557:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286560:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147189.286564:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11814 00000100:00100000:1.0:1746147189.286569:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463804288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.286573:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.286574:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.286578:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55000, rc 0) 00010000:00010000:1.0:1746147189.286581:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dbd expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.286599:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463804672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 60us (406us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147189.286601:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147189.286603:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11813 00010000:00010000:1.0:1746147189.286603:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.286607:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 39 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147189.286611:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11815 00000100:00100000:3.0:1746147189.286615:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463804544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.286616:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 38 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.286619:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.286622:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4800, rc 0) 00010000:00010000:3.0:1746147189.286624:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dcb expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.286632:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286633:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.286636:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147189.286638:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463804288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 69us (434us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147189.286643:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147189.286643:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11814 00010000:00010000:3.0:1746147189.286648:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d55a00, rc 0) 00000100:00100000:3.0:1746147189.286658:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463804544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 43us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.286662:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11815 00000100:00100000:0.0:1746147189.288775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.290807:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804800 00000100:00100000:2.0:1746147189.290819:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804800 00000100:00100000:2.0:1746147189.290855:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11816 00000100:00100000:2.0:1746147189.290863:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:28989:x1830967463804800:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.290879:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.290893:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dd9 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.290918:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.290926:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 37 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.290951:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.290953:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.290956:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1593344->2007039] (req 1593344->2007039) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.290980:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 37 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.290990:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 37 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.291002:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466426240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.291354:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.291362:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 24 pid: 4444 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.291370:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466426368:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.291386:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.296523:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463803008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24176us (25178us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.296535:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4537 00002000:00100000:2.0:1746147189.296549:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134c54380 x1830967463803008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.296563:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54380 with x1830967463803008 ext(0->1048575) 00002000:00010000:2.0:1746147189.296568:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c54380 00000100:00100000:0.0:1746147189.303714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.303741:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463804928 00000100:00100000:0.0:1746147189.303749:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463804928 00010000:00010000:0.0:1746147189.303784:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 38 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:0.0:1746147189.303809:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5859 00000100:00100000:0.0:1746147189.303816:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463804928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.303829:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.303845:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 38 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.303855:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 38 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:0.0:1746147189.303874:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147189.304266:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4800/0xb4b2209fbdac6fde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dbd expref: 38 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.304282:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466426240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.304291:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466426368:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.304315:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1593344->2007039] (req 1593344->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.304324:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:0.0:1746147189.304384:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463804928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 568us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.304391:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5859 00000100:00100000:3.0:1746147189.304424:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463803264:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27607us (28708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.304430:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4540 00002000:00100000:3.0:1746147189.304438:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880134c55880 x1830967463803264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.304445:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55880 with x1830967463803264 ext(1048576->2097151) 00010000:00010000:3.0:1746147189.304451:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 23 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.304460:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 23 pid: 4444 timeout: 676 lvb_type: 1 00002000:00010000:3.0:1746147189.304465:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55880 00000100:00100000:2.0:1746147189.304539:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:28989:x1830967463804800:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 13676us (15769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.304540:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463804032:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27731us (28800us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.304545:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11816 00000100:00100000:1.0:1746147189.304547:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4539 00002000:00100000:1.0:1746147189.304553:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880134c55f80 x1830967463804032/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.304560:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55f80 with x1830967463804032 ext(1048576->2097151) 00002000:00010000:1.0:1746147189.304563:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c55f80 00000100:00100000:1.0:1746147189.306079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.306096:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463805312 00000100:00100000:1.0:1746147189.306103:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463805312 00002000:00100000:1.0:1746147189.306130:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a6572d80 x1830967463805312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.306138:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572d80 with x1830967463805312 ext(2097152->3145727) 00002000:00010000:1.0:1746147189.306142:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6572d80 00000100:00100000:1.0:1746147189.307265:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4541 00000100:00100000:1.0:1746147189.307275:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463805312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.307545:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463803392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30745us (31901us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147189.307552:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4538 00002000:00100000:0.0:1746147189.307558:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880134c54e00 x1830967463803392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.307566:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54e00 with x1830967463803392 ext(1048576->2097151) 00002000:00010000:0.0:1746147189.307569:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c54e00 00000100:00100000:2.0:1746147189.307678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.307978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.307992:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463805440 00000100:00100000:2.0:1746147189.307997:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463805440 00000100:00100000:3.0:1746147189.308039:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463805824 00000100:00100000:3.0:1746147189.308042:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463805824 00002000:00100000:2.0:1746147189.308105:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a0448000 x1830967463805440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.308112:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463805440 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.308116:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:0.0:1746147189.308125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147189.308150:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a0449c00 x1830967463805824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.308155:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449c00 with x1830967463805824 ext(3145728->4194303) 00002000:00010000:3.0:1746147189.308158:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449c00 00000100:00100000:2.0:1746147189.308177:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463805696 00000100:00100000:2.0:1746147189.308180:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463805696 00002000:00100000:2.0:1746147189.308190:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880134c56d80 x1830967463805696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.308195:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56d80 with x1830967463805696 ext(2097152->3145727) 00002000:00010000:2.0:1746147189.308197:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56d80 00000100:00100000:2.0:1746147189.308207:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4542 00000100:00100000:2.0:1746147189.308211:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463805440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.309140:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4543 00000100:00100000:2.0:1746147189.309147:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463805824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147189.310679:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4544 00000100:00100000:3.0:1746147189.310688:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463805696:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.311248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.312640:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463806080 00000100:00100000:2.0:1746147189.312650:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463806080 00000100:00100000:2.0:1746147189.312700:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11817 00000100:00100000:2.0:1746147189.312707:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:28992:x1830967463806080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.312722:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.312737:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6de0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.312756:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.312761:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1593344->2007039] (req 1593344->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.312767:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147189.312770:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.312819:0:4444:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1593344->2007039] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.312835:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.312843:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65800, rc 0) 00000100:00100000:2.0:1746147189.312870:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:28992:x1830967463806080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 163us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.312875:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11817 00000100:00100000:1.0:1746147189.313152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.314413:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463806208 00000100:00100000:2.0:1746147189.314420:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463806208 00010000:00010000:2.0:1746147189.314441:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 21 pid: 4444 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.314544:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5860 00000100:00100000:2.0:1746147189.314551:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463806208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.314562:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.314590:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 21 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.314601:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 21 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.314620:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b5000/0xb4b2209fbdac6f9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d93 expref: 21 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.314639:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.314641:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.314648:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.314654:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.314681:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.314690:0:7119:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.314701:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466426624:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.314777:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.319738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.319741:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466426624:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.319764:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.319765:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463806464 00000100:00100000:1.0:1746147189.319771:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463806464 00002000:00100000:1.0:1746147189.319813:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1593344->1597439) req@ffff8800a6572300 x1830967463806464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.319834:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572300 with x1830967463806464 ext(1593344->1597439) 00010000:00010000:1.0:1746147189.319841:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 21 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.319851:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463806208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5300us (6699us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147189.319853:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 21 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.319859:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6572300 00000100:00100000:2.0:1746147189.319860:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5860 00000100:00100000:1.0:1746147189.320041:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1555 00000100:00100000:1.0:1746147189.320049:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463806464:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147189.320179:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463806464:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 130us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147189.320184:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1555 00002000:00100000:1.0:1746147189.320189:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1593344->1597439) req@ffff8800a6572300 x1830967463806464/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.320232:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572300 with x1830967463806464 ext(1593344->1597439) 00010000:00010000:1.0:1746147189.320238:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.320247:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.320253:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6572300 00000100:00100000:2.0:1746147189.325895:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463805312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18613us (19811us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.325906:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4541 00002000:00100000:2.0:1746147189.325917:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a6572d80 x1830967463805312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.325927:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572d80 with x1830967463805312 ext(2097152->3145727) 00002000:00010000:2.0:1746147189.325932:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6572d80 00000100:00100000:2.0:1746147189.331141:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463805824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21986us (23154us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.331153:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4543 00002000:00100000:2.0:1746147189.331165:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a0449c00 x1830967463805824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.331174:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449c00 with x1830967463805824 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.331179:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449c00 00000100:00100000:2.0:1746147189.335577:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463805440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27357us (27892us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.335597:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4542 00002000:00100000:2.0:1746147189.335607:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a0448000 x1830967463805440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.335616:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967463805440 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.335621:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448000 00000100:00100000:3.0:1746147189.337456:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463805696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26765us (29326us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.337464:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4544 00002000:00100000:3.0:1746147189.337471:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880134c56d80 x1830967463805696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.337478:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c56d80 with x1830967463805696 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.337483:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c56d80 00000100:00100000:0.0:1746147189.341895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.342000:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463806720 00000100:00100000:3.0:1746147189.342011:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463806720 00002000:00100000:3.0:1746147189.342055:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (2002944->2007039) req@ffff880134c55500 x1830967463806720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.342065:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967463806720 ext(2002944->2007039) 00010000:00010000:3.0:1746147189.342073:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.342086:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.342092:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55500 00000100:00100000:3.0:1746147189.342128:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1556 00000100:00100000:3.0:1746147189.342140:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463806720:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.342296:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463806720:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 160us (409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147189.342302:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1556 00002000:00100000:3.0:1746147189.342306:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (2002944->2007039) req@ffff880134c55500 x1830967463806720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.342312:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c55500 with x1830967463806720 ext(2002944->2007039) 00010000:00010000:3.0:1746147189.342316:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.342325:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.342330:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c55500 00000100:00100000:0.0:1746147189.350856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.350981:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463806976 00000100:00100000:3.0:1746147189.350994:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463806976 00002000:00100000:3.0:1746147189.351039:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1593344->2007039) req@ffff88009050aa00 x1830967463806976/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.351047:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050aa00 with x1830967463806976 ext(1593344->2007039) 00010000:00010000:3.0:1746147189.351055:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.351066:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 20 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.351071:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009050aa00 00000100:00100000:3.0:1746147189.351110:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1557 00000100:00100000:3.0:1746147189.351118:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463806976:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147189.351142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.351164:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463807104 00000100:00100000:3.0:1746147189.351167:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463807104 00000100:00100000:3.0:1746147189.351198:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11818 00000100:00100000:3.0:1746147189.351203:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463807104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.351211:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.351224:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f361800/0xb4b2209fbdac6ffa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6de7 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.351264:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466426752:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.351351:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313840 going to sleep for 11 seconds 00002000:00010000:3.0:1746147189.356505:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:3.0:1746147189.356511:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147188 -> 1746147189 00002000:00010000:3.0:1746147189.356513:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:3.0:1746147189.356530:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466426752:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.356558:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f361800/0xb4b2209fbdac6ffa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de7 expref: 38 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.356571:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f361800/0xb4b2209fbdac6ffa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de7 expref: 38 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.356611:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f361800, rc 0) 00000100:00100000:3.0:1746147189.356669:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463807104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5464us (5527us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.356677:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11818 00000100:00100000:3.0:1746147189.364048:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463806976:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 12914us (13187us total) trans 17179873237 rc 0/0 00000100:00100000:3.0:1746147189.364063:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1557 00002000:00100000:3.0:1746147189.364075:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1593344->2007039) req@ffff88009050aa00 x1830967463806976/t17179873237(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.364086:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050aa00 with x1830967463806976 ext(1593344->2007039) 00010000:00010000:3.0:1746147189.364098:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.364117:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.364124:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009050aa00 00000100:00100000:1.0:1746147189.365120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.365211:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463807360 00000100:00100000:3.0:1746147189.365218:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463807360 00002000:00100000:3.0:1746147189.365252:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a6572a00 x1830967463807360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.365260:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572a00 with x1830967463807360 ext(4194304->4927487) 00002000:00010000:3.0:1746147189.365264:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6572a00 00000100:00100000:3.0:1746147189.365289:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4545 00000100:00100000:3.0:1746147189.365296:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463807360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.373522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.373618:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463807488 00000100:00100000:2.0:1746147189.373627:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463807488 00010000:00010000:2.0:1746147189.373661:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.373702:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5861 00000100:00100000:2.0:1746147189.373709:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463807488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.373722:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.373746:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.373765:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.373792:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac6fec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2007039) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd9 expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.373816:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.373819:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.373827:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.373836:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.373870:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.374464:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466426880:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.376233:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.377413:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463807360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12107us (12286us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147189.377424:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4545 00002000:00100000:3.0:1746147189.377433:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800a6572a00 x1830967463807360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.377444:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6572a00 with x1830967463807360 ext(4194304->4927487) 00002000:00010000:3.0:1746147189.377449:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6572a00 00000100:00100000:2.0:1746147189.383913:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466426880:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.383970:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.384020:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463807488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10309us (10510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.384030:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5861 00000100:00100000:1.0:1746147189.388535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.388742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.388809:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463808000 00000100:00100000:3.0:1746147189.388818:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463808000 00002000:00100000:3.0:1746147189.388858:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a6573100 x1830967463808000/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.388873:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573100 with x1830967463808000 ext(1048576->2097151) 00002000:00010000:3.0:1746147189.388879:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573100 00000100:00100000:3.0:1746147189.388910:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4546 00000100:00100000:3.0:1746147189.388918:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463808000:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.389119:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463807744 00000100:00100000:2.0:1746147189.389124:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463807744 00000100:00100000:2.0:1746147189.389455:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11819 00000100:00100000:2.0:1746147189.389463:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463807744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.389473:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.389491:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dee expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.389511:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.389513:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.389521:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 38 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.389536:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 38 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.389545:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491fc00, rc 0) 00000100:00100000:2.0:1746147189.389603:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463807744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 141us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.389609:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11819 00000100:00100000:3.0:1746147189.401455:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463808000:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12527us (12922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.401467:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4546 00002000:00100000:3.0:1746147189.401478:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a6573100 x1830967463808000/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.401487:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573100 with x1830967463808000 ext(1048576->2097151) 00002000:00010000:3.0:1746147189.401494:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573100 00000100:00100000:0.0:1746147189.414926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.415161:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463808256 00000100:00100000:2.0:1746147189.415170:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463808256 00000100:00100000:2.0:1746147189.415228:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10539 00000100:00100000:2.0:1746147189.415235:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+326:28997:x1830967463808256:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.415266:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.415285:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f600/0xb4b2209fbdac7008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6df5 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.415385:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147189.415399:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147189.415411:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147189.415421:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147189.415535:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f600/0xb4b2209fbdac7008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 329 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.415554:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 328 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.415562:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.415565:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147189.415567:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:2.0:1746147189.416864:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+328:28997:x1830967463808256:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1622us (1943us total) trans 8589944292 rc 0/0 00000100:00100000:2.0:1746147189.416873:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10539 00000100:00100000:0.0:1746147189.418462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.418533:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463808512 00000100:00100000:3.0:1746147189.418542:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463808512 00000100:00100000:0.0:1746147189.418543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.418560:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463808768 00000100:00100000:0.0:1746147189.418563:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463808768 00002000:00100000:0.0:1746147189.418591:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880090508a80 x1830967463808768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.418601:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967463808768 ext(3145728->4194303) 00002000:00010000:0.0:1746147189.418606:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508a80 00000100:00100000:0.0:1746147189.418635:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4547 00000100:00100000:0.0:1746147189.418641:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463808768:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147189.419202:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090508380 x1830967463808512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.419210:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508380 with x1830967463808512 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.419214:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508380 00000100:00100000:3.0:1746147189.419235:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4548 00000100:00100000:3.0:1746147189.419242:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463808512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147189.419302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.420467:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809024 00000100:00100000:3.0:1746147189.420474:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809024 00002000:00100000:3.0:1746147189.420497:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a6571c00 x1830967463809024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.420510:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6571c00 with x1830967463809024 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.420514:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6571c00 00000100:00100000:3.0:1746147189.420531:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4549 00000100:00100000:3.0:1746147189.420537:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463809024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.431277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.431351:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809280 00000100:00100000:2.0:1746147189.431363:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809280 00002000:00100000:2.0:1746147189.431414:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090509c00 x1830967463809280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.431426:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509c00 with x1830967463809280 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.431433:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090509c00 00000100:00100000:2.0:1746147189.431462:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4550 00000100:00100000:2.0:1746147189.431471:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463809280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.443200:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463808768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24545us (24642us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.443214:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4547 00002000:00100000:2.0:1746147189.443227:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880090508a80 x1830967463808768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.443238:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508a80 with x1830967463808768 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.443244:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508a80 00000100:00100000:2.0:1746147189.446208:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463809024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25661us (26900us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.446220:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4549 00002000:00100000:2.0:1746147189.446230:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a6571c00 x1830967463809024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.446240:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6571c00 with x1830967463809024 ext(2097152->3145727) 00002000:00010000:2.0:1746147189.446246:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6571c00 00000100:00100000:3.0:1746147189.452085:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463808512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 32831us (33616us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.452099:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4548 00002000:00100000:3.0:1746147189.452182:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880090508380 x1830967463808512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.452191:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508380 with x1830967463808512 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.452198:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508380 00000100:00100000:2.0:1746147189.452595:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463809280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21112us (21316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.452604:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4550 00002000:00100000:2.0:1746147189.452611:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880090509c00 x1830967463809280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.452619:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509c00 with x1830967463809280 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.452623:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090509c00 00000100:00100000:0.0:1746147189.468259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.468505:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809536 00000100:00100000:2.0:1746147189.468514:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809536 00002000:00100000:2.0:1746147189.468566:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009050bb80 x1830967463809536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.468577:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050bb80 with x1830967463809536 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.468614:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050bb80 00000100:00100000:2.0:1746147189.468647:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4551 00000100:00100000:2.0:1746147189.468654:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463809536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.488331:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463809536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19664us (20071us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147189.488344:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4551 00002000:00100000:2.0:1746147189.488355:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009050bb80 x1830967463809536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.488364:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050bb80 with x1830967463809536 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.488371:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050bb80 00000100:00100000:0.0:1746147189.498507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.498621:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809664 00000100:00100000:2.0:1746147189.498630:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809664 00000100:00100000:2.0:1746147189.498671:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11820 00000100:00100000:2.0:1746147189.498677:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:28997:x1830967463809664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.498697:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.498716:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6dfc expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.498744:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 20 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.498753:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.498759:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.498761:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.498764:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.498790:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.498801:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.498812:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466427008:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.498911:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 20 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.498918:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 20 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.498925:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466427136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.498970:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.506890:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466427008:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.506909:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466427136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.507045:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.507071:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f200, rc 0) 00000100:00100000:2.0:1746147189.507138:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:28997:x1830967463809664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8460us (8639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.507147:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11820 00000100:00100000:0.0:1746147189.508317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.508363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.508423:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809920 00000100:00100000:3.0:1746147189.508429:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809920 00010000:00010000:3.0:1746147189.508455:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 21 pid: 8480 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.508485:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463809792 00000100:00100000:3.0:1746147189.508487:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463809792 00010000:00010000:3.0:1746147189.508495:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.508507:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5862 00000100:00100000:3.0:1746147189.508512:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463809920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.508523:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147189.508524:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5863 00000100:00100000:2.0:1746147189.508531:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463809792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.508541:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.508545:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 21 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.508551:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.508553:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 21 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.508562:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.508897:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6800/0xb4b2209fbdac6fa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d9a expref: 21 pid: 8480 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.508905:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4200/0xb4b2209fbdac6fd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dc4 expref: 39 pid: 17530 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.508921:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.508923:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.508929:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.510434:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.510447:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147189.510471:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 38 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.510484:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466427264:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147189.510516:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967463809920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2001us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.510525:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5862 00000100:00100000:2.0:1746147189.510549:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.512393:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466427264:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147189.512413:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.512464:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463809792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3933us (4099us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.512474:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5863 00000100:00100000:0.0:1746147189.513341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.513626:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810176 00000100:00100000:2.0:1746147189.513633:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810176 00002000:00100000:2.0:1746147189.513668:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1609728->1613823) req@ffff880090508e00 x1830967463810176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.513677:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967463810176 ext(1609728->1613823) 00002000:00010000:2.0:1746147189.513682:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:2.0:1746147189.513706:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4552 00000100:00100000:2.0:1746147189.513712:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463810176:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.513853:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463810176:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 140us (513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147189.513858:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4552 00002000:00100000:2.0:1746147189.513863:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1609728->1613823) req@ffff880090508e00 x1830967463810176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.513869:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508e00 with x1830967463810176 ext(1609728->1613823) 00002000:00010000:2.0:1746147189.513871:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508e00 00000100:00100000:1.0:1746147189.528252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.528341:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810304 00000100:00100000:2.0:1746147189.528349:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810304 00000100:00100000:2.0:1746147189.528655:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11821 00000100:00100000:2.0:1746147189.528663:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:28997:x1830967463810304:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.528680:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.528698:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e03 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.528728:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.528737:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.528744:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.529113:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.529118:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->1105919] (req 1048576->1105919) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.529150:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 21 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.529161:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 21 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.529173:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466427392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.529991:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.530001:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.530010:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466427520:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.530249:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.534126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.534210:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810432 00000100:00100000:3.0:1746147189.534218:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810432 00010000:00010000:3.0:1746147189.534251:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.534287:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5864 00000100:00100000:3.0:1746147189.534295:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463810432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.534307:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.534329:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.534341:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.534365:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147189.534408:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac6fb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da1 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.534418:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463810432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.534425:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5864 00000100:00100000:2.0:1746147189.534427:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466427392:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.534435:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466427520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.534458:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->1105919] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 28 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.534467:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ea00, rc 0) 00000100:00100000:2.0:1746147189.534487:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:28997:x1830967463810304:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5825us (6246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.534493:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11821 00000100:00100000:0.0:1746147189.535450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.535577:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810560 00000100:00100000:2.0:1746147189.535589:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810560 00010000:00010000:2.0:1746147189.535605:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.535629:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5865 00000100:00100000:2.0:1746147189.535634:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463810560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.535642:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.535652:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.535661:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.535674:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6400/0xb4b2209fbdac6f98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d85 expref: 28 pid: 8480 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.535683:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.535685:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.535691:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.535698:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.535720:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 27 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.535730:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466427648:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.536434:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.537463:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466427648:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.537477:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.537506:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463810560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1870us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.537515:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5865 00000100:00100000:0.0:1746147189.537817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.538150:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810816 00000100:00100000:2.0:1746147189.538155:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810816 00002000:00100000:2.0:1746147189.538188:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1101824->1105919) req@ffff880090508700 x1830967463810816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.538204:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967463810816 ext(1101824->1105919) 00002000:00010000:2.0:1746147189.538209:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508700 00000100:00100000:2.0:1746147189.538238:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4553 00000100:00100000:2.0:1746147189.538246:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463810816:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.538538:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463810816:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 292us (720us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147189.538545:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4553 00002000:00100000:2.0:1746147189.538550:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1101824->1105919) req@ffff880090508700 x1830967463810816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.538557:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508700 with x1830967463810816 ext(1101824->1105919) 00002000:00010000:2.0:1746147189.538560:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090508700 00000100:00100000:0.0:1746147189.541204:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466427776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147189.541261:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147189.541384:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466427776 00000100:00100000:1.0:1746147189.541391:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466427776 00000100:00080000:2.0:1746147189.541465:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147189.541579:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1746147189.541597:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466427776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147189.541619:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 488439808 pending 22151168 free 3839885312 avail 3837788160 00000100:00100000:1.0:1746147189.541661:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466427776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.541667:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1746147189.542140:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840626 gen 2 00000004:00080000:0.0:1746147189.542146:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b480, transno 21474840587 00000004:00080000:0.0:1746147189.542162:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 21474840588 00000004:00080000:0.0:1746147189.542165:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090508000, transno 21474840589 00000004:00080000:0.0:1746147189.542167:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80d500, transno 21474840590 00000004:00080000:0.0:1746147189.542169:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090509880, transno 21474840591 00000004:00080000:0.0:1746147189.542173:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047480, transno 21474840592 00000004:00080000:0.0:1746147189.542175:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df480, transno 21474840593 00000004:00080000:0.0:1746147189.542178:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009050b800, transno 21474840594 00000004:00080000:0.0:1746147189.542180:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a80f800, transno 21474840595 00000004:00080000:0.0:1746147189.542182:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132e13b80, transno 21474840596 00000004:00080000:0.0:1746147189.542184:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937ee680, transno 21474840597 00000004:00080000:0.0:1746147189.542186:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e682300, transno 21474840598 00000004:00080000:0.0:1746147189.542189:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc9880, transno 21474840599 00000004:00080000:0.0:1746147189.542191:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937ece00, transno 21474840600 00000004:00080000:0.0:1746147189.542193:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6ba680, transno 21474840601 00000004:00080000:0.0:1746147189.542196:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcbb80, transno 21474840602 00000004:00080000:0.0:1746147189.542198:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d03800, transno 21474840603 00000004:00080000:0.0:1746147189.542200:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937efb80, transno 21474840604 00000004:00080000:0.0:1746147189.542202:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47aad80, transno 21474840606 00000004:00080000:0.0:1746147189.542204:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a9500, transno 21474840607 00000004:00080000:0.0:1746147189.542207:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47abb80, transno 21474840608 00000004:00080000:0.0:1746147189.542209:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937ef800, transno 21474840609 00000004:00080000:0.0:1746147189.542211:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a8e00, transno 21474840610 00000004:00080000:0.0:1746147189.542213:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47ab480, transno 21474840611 00000004:00080000:0.0:1746147189.542215:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a9880, transno 21474840612 00000004:00080000:0.0:1746147189.542217:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a47a8a80, transno 21474840613 00000004:00080000:0.0:1746147189.542220:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc94700, transno 21474840614 00000004:00080000:0.0:1746147189.542222:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012eced500, transno 21474840618 00000004:00080000:0.0:1746147189.542224:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecedc00, transno 21474840619 00000004:00080000:0.0:1746147189.542226:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012eceea00, transno 21474840620 00000004:00080000:0.0:1746147189.542228:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecece00, transno 21474840621 00000004:00080000:0.0:1746147189.542230:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecef100, transno 21474840622 00000004:00080000:0.0:1746147189.542233:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecedf80, transno 21474840623 00000004:00080000:0.0:1746147189.542235:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ececa80, transno 21474840624 00000004:00080000:0.0:1746147189.542237:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929f6300, transno 21474840625 00000004:00080000:0.0:1746147189.542240:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d5ded80, transno 21474840626 00000100:00100000:0.0:1746147189.542250:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466427776:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746147189.543590:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 36 done 00000100:00100000:0.0:1746147189.557238:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147189.557286:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967466428160:0@lo:400:kworker.0 00000100:00100000:2.0:1746147189.557293:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967466428288:0@lo:400:kworker.0 00000100:00100000:0.0:1746147189.557293:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147189.557320:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147189.557332:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466428416:0@lo:400:kworker.0 00000100:00100000:1.0:1746147189.557337:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147189.557348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147189.557355:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466428288 00000100:00100000:2.0:1746147189.557362:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466428288 00000100:00100000:1.0:1746147189.557372:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147189.557377:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466428032:0@lo:400:kworker.0 00000100:00100000:0.0:1746147189.557378:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466428416 00000100:00100000:0.0:1746147189.557380:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466428416 00000100:00100000:1.0:1746147189.557400:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147189.557428:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466428032 00000100:00100000:0.0:1746147189.557432:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466428032 00000100:00100000:0.0:1746147189.557449:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1746147189.557455:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009343e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967466428032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147189.557541:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466427904 00000100:00100000:3.0:1746147189.557547:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466427904 00000100:00100000:3.0:1746147189.557574:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1746147189.557588:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1830967466427904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746147189.557608:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 435486720 pending 23855104 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746147189.557674:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466428544:0@lo:400:kworker.0 00000100:00100000:3.0:1746147189.557713:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1830967466427904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.557719:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1746147189.557752:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873218 gen 2 00000004:00080000:3.0:1746147189.557757:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ded80, transno 17179873182 00000004:00080000:3.0:1746147189.557763:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dce00, transno 17179873183 00000004:00080000:3.0:1746147189.557765:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df800, transno 17179873184 00000004:00080000:3.0:1746147189.557768:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd500, transno 17179873185 00000004:00080000:3.0:1746147189.557771:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc700, transno 17179873186 00000004:00080000:3.0:1746147189.557773:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc000, transno 17179873187 00000004:00080000:3.0:1746147189.557775:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd180, transno 17179873188 00000004:00080000:3.0:1746147189.557777:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936de680, transno 17179873189 00000004:00080000:3.0:1746147189.557779:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448700, transno 17179873190 00000004:00080000:3.0:1746147189.557781:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044a680, transno 17179873191 00000004:00080000:3.0:1746147189.557784:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6bad80, transno 17179873192 00000004:00080000:3.0:1746147189.557787:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a044b800, transno 17179873193 00000004:00080000:3.0:1746147189.557789:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6b9f80, transno 17179873194 00000004:00080000:3.0:1746147189.557791:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b6b8e00, transno 17179873195 00000004:00080000:3.0:1746147189.557793:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0448a80, transno 17179873196 00000004:00080000:3.0:1746147189.557795:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0449500, transno 17179873197 00000004:00080000:3.0:1746147189.557797:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d49bb80, transno 17179873200 00000004:00080000:3.0:1746147189.557799:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498700, transno 17179873201 00000004:00080000:3.0:1746147189.557801:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d49b800, transno 17179873202 00000004:00080000:3.0:1746147189.557803:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d499f80, transno 17179873203 00000004:00080000:3.0:1746147189.557805:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498e00, transno 17179873204 00000004:00080000:3.0:1746147189.557807:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498a80, transno 17179873205 00000004:00080000:3.0:1746147189.557809:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d49a300, transno 17179873206 00000004:00080000:3.0:1746147189.557810:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d498380, transno 17179873207 00000004:00080000:3.0:1746147189.557812:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b7480, transno 17179873211 00000004:00080000:3.0:1746147189.557814:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b6a00, transno 17179873212 00000004:00080000:3.0:1746147189.557816:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b5f80, transno 17179873213 00000004:00080000:3.0:1746147189.557818:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecefb80, transno 17179873214 00000004:00080000:3.0:1746147189.557820:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b5c00, transno 17179873215 00000004:00080000:3.0:1746147189.557822:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecef800, transno 17179873216 00000004:00080000:3.0:1746147189.557824:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b6680, transno 17179873217 00000004:00080000:3.0:1746147189.557826:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a56b6300, transno 17179873218 00000100:00100000:3.0:1746147189.557833:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147189.558167:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147189.558297:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466428160 00000100:00100000:1.0:1746147189.558298:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466428544 00000100:00100000:1.0:1746147189.558301:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466428544 00000100:00100000:2.0:1746147189.558303:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466428160 00000100:00100000:2.0:1746147189.558326:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1746147189.558332:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967466428288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147189.558340:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009343e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967466428032:12345-0@lo:400:kworker.0 Request processed in 884us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.558345:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1746147189.558358:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967466428288:12345-0@lo:400:kworker.0 Request processed in 28us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.558362:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1746147189.558372:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1746147189.558373:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746147189.558376:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466428544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147189.558378:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1830967466428416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147189.558380:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1746147189.558386:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967466428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147189.558395:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830967466428544:12345-0@lo:400:kworker.0 Request processed in 19us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.558398:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1830967466428416:12345-0@lo:400:kworker.0 Request processed in 21us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.558400:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1746147189.558402:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1746147189.558415:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967466428160:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00080000:2.0:1746147189.558418:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147189.558420:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1746147189.558422:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147189.558442:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967466428288:0@lo:400:kworker.0 00000100:00100000:1.0:1746147189.558442:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466428032:0@lo:400:kworker.0 00000100:00100000:1.0:1746147189.558452:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830967466428544:0@lo:400:kworker.0 00000100:00100000:1.0:1746147189.558459:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967466428160:0@lo:400:kworker.0 00000100:00100000:2.0:1746147189.558468:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466428416:0@lo:400:kworker.0 00000004:00080000:3.0:1746147189.558555:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:0.0:1746147189.594247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.594608:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463810944 00000100:00100000:2.0:1746147189.594617:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463810944 00000100:00100000:2.0:1746147189.594652:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11822 00000100:00100000:2.0:1746147189.594659:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29001:x1830967463810944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.594674:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.594686:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e0a expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.594711:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.594719:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.594724:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.594726:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.594729:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3031040->3145727] (req 3031040->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.594759:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 26 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.594768:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 26 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.594778:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466428672:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.594871:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.594879:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.594888:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466428800:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.594905:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.595882:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466428672:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.595894:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466428800:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.595912:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3031040->3145727] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.595924:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491fe00, rc 0) 00000100:00100000:2.0:1746147189.595996:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29001:x1830967463810944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1336us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.596005:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11822 00000100:00100000:0.0:1746147189.598990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.599106:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811072 00000100:00100000:1.0:1746147189.599114:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811072 00000100:00100000:1.0:1746147189.599151:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10540 00000100:00100000:1.0:1746147189.599157:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:29002:x1830967463811072:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147189.599184:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.599657:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac7032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e11 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.599725:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.599738:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.599749:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.599764:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.599771:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.599776:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.601252:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.601268:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 40 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.601277:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 327 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.601283:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.601318:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 327 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.601330:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 327 pid: 16361 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.601341:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466428928:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.601458:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 40 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.601467:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 40 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.601591:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466429056:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.602191:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.604190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.604240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.604595:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811200 00000100:00100000:2.0:1746147189.604603:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811200 00010000:00010000:2.0:1746147189.604744:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.605013:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811328 00000100:00100000:2.0:1746147189.605017:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811328 00010000:00010000:2.0:1746147189.605030:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.605181:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5866 00000100:00100000:3.0:1746147189.605191:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463811200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.605204:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.605226:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605238:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605260:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d55a00/0xb4b2209fbdac6fe5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dcb expref: 27 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605289:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.605330:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463811200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.605336:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5866 00000100:00100000:3.0:1746147189.605351:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5867 00000100:00100000:3.0:1746147189.605356:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1959:x1830967463811328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.605362:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.605369:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605376:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605388:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3b6c00/0xb4b2209fbdac6fbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6da8 expref: 22 pid: 4445 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.605793:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.605795:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.605804:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.605813:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.605844:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.605856:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466429184:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147189.606568:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.607526:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466428928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.607744:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466429056:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.607769:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147189.609368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.609401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.609605:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811584 00000100:00100000:2.0:1746147189.609616:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811584 00000100:00100000:2.0:1746147189.609658:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4182 00000100:00100000:2.0:1746147189.609665:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:7641:x1830967463811584:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147189.609677:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811712 00000100:00100000:1.0:1746147189.609681:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811712 00010000:00010000:1.0:1746147189.609702:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 41 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.609724:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5868 00000100:00100000:1.0:1746147189.609730:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+41:1957:x1830967463811712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.609740:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.609746:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 41 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.609756:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 41 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.609777:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801309edc00/0xb4b2209fbdac6f8a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d7e expref: 41 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.609794:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.609800:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.609807:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.609812:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.609817:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.609854:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1957:x1830967463811712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.609860:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5868 00000100:00100000:2.0:1746147189.609888:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+329:7641:x1830967463811584:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 223us (525us total) trans 8589944293 rc 0/0 00000100:00100000:2.0:1746147189.609894:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4182 00000100:00100000:3.0:1746147189.610063:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466429184:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147189.610077:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.610111:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463811328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4754us (5870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.610117:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5867 00000100:00100000:2.0:1746147189.611537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.611601:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463811968 00000100:00100000:0.0:1746147189.611605:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463811968 00002000:00100000:0.0:1746147189.611634:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3031040->3035135) req@ffff88008fc95c00 x1830967463811968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.611643:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95c00 with x1830967463811968 ext(3031040->3035135) 00002000:00010000:0.0:1746147189.611648:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc95c00 00000100:00100000:3.0:1746147189.611784:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4554 00000100:00100000:3.0:1746147189.611792:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463811968:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.611962:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463811968:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 171us (427us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147189.611968:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4554 00002000:00100000:3.0:1746147189.611974:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (3031040->3035135) req@ffff88008fc95c00 x1830967463811968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.611982:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95c00 with x1830967463811968 ext(3031040->3035135) 00002000:00010000:3.0:1746147189.611985:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc95c00 00000100:00100000:0.0:1746147189.614382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.614442:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812096 00000100:00100000:2.0:1746147189.614450:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812096 00010000:00010000:2.0:1746147189.614482:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 329 pid: 16361 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.614518:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5869 00000100:00100000:2.0:1746147189.614525:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+329:1956:x1830967463812096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.614540:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.614546:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 329 pid: 16361 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.614557:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 329 pid: 16361 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.614579:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009491f800/0xb4b2209fbdac700f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6df5 expref: 329 pid: 16361 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.614614:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.614619:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.614632:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.614639:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.614673:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.614713:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:1956:x1830967463812096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 188us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.614720:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5869 00010000:00010000:1.0:1746147189.614897:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.614905:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147189.614966:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:1.0:1746147189.614971:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147189.614986:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.614995:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615004:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615010:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615019:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615026:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cbf600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147189.615029:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615036:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615045:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147189.615047:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147189.615051:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615055:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf600/0xb4b2209fbdac7039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615204:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615210:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615214:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615218:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cbf400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147189.615221:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615225:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615232:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98ff00) 00010000:00010000:1.0:1746147189.615234:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147189.615237:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615241:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf400/0xb4b2209fbdac7040 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.615276:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac7032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.615287:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.615293:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.615295:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147189.615297:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbfa00, rc 0) 00000100:00100000:1.0:1746147189.615335:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:29002:x1830967463811072:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 16178us (16353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.615341:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10540 00000100:00100000:2.0:1746147189.620084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.620227:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812224 00000100:00100000:2.0:1746147189.620234:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812224 00000100:00100000:2.0:1746147189.620274:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812352 00000100:00100000:2.0:1746147189.620276:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812352 00000100:00100000:3.0:1746147189.620277:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812480 00000100:00100000:3.0:1746147189.620280:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812480 00000100:00100000:2.0:1746147189.620288:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812736 00000100:00100000:2.0:1746147189.620289:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812736 00000100:00100000:2.0:1746147189.620297:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812992 00000100:00100000:3.0:1746147189.620298:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812608 00000100:00100000:2.0:1746147189.620298:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812992 00000100:00100000:3.0:1746147189.620299:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812608 00000100:00100000:3.0:1746147189.620305:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463812864 00000100:00100000:3.0:1746147189.620307:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463812864 00000100:00100000:2.0:1746147189.620310:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11823 00000100:00100000:3.0:1746147189.620316:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11824 00000100:00100000:2.0:1746147189.620316:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+20:29001:x1830967463812224:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:3.0:1746147189.620319:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463812352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.620334:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.620334:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.620351:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e1f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.620351:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e18 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.620374:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.620382:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 37 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.620387:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.620389:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.620391:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.620397:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466429312:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.620407:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 37 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.620420:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 37 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.620426:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466429440:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147189.620482:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11825 00000100:00100000:0.0:1746147189.620489:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463812480:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147189.620496:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147189.620502:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e26 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.620512:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.620513:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.620520:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147189.620531:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147189.620540:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e000, rc 0) 00000100:00100000:1.0:1746147189.620621:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11826 00000100:00100000:1.0:1746147189.620629:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463812736:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147189.620635:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.620641:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac7063 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e34 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.620664:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466429568:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.621370:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.621382:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.621392:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466429696:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.621449:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.621474:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11827 00000100:00100000:3.0:1746147189.621480:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463812608:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.621487:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.621494:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e2d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.621505:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.621506:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.621511:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147189.621512:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463812480:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 1023us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.621518:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11825 00010000:00010000:3.0:1746147189.621521:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.621527:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19400, rc 0) 00000100:00100000:0.0:1746147189.621535:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11828 00000100:00100000:0.0:1746147189.621541:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463812992:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147189.621542:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463812608:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 64us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.621547:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11827 00010000:00010000:0.0:1746147189.621547:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147189.621553:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f63ea00/0xb4b2209fbdac7071 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e42 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.621555:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11829 00000100:00100000:3.0:1746147189.621560:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463812864:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147189.621565:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.621571:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea19c00/0xb4b2209fbdac7078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e3b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147189.621599:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466429824:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147189.621621:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.621677:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.621684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.621686:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.621693:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813120 00000100:00100000:2.0:1746147189.621697:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813120 00000100:00100000:2.0:1746147189.621733:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11830 00000100:00100000:2.0:1746147189.621738:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463813120:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147189.621744:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.621752:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbeb800/0xb4b2209fbdac707f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e49 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.621763:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.621771:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeb800/0xb4b2209fbdac707f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e49 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.621779:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeb800/0xb4b2209fbdac707f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e49 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.621792:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeb800, rc 0) 00000100:00100000:0.0:1746147189.622068:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466429952:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147189.622132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.622143:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813248 00000100:00100000:1.0:1746147189.622147:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813248 00000100:00100000:1.0:1746147189.622163:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11831 00000100:00100000:1.0:1746147189.622167:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463813248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.622173:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.622179:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbec00/0xb4b2209fbdac7086 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e50 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.622199:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6570380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466430080:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147189.622239:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.622646:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463813120:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 906us (960us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.622651:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11830 00000100:00100000:3.0:1746147189.622723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.622782:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813376 00000100:00100000:2.0:1746147189.622785:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813376 00000100:00100000:2.0:1746147189.623629:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11832 00000100:00100000:2.0:1746147189.623637:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463813376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.623647:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.623656:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbebe00/0xb4b2209fbdac708d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e57 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.623687:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466430208:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147189.623740:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.623898:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00002000:00010000:1.0:1746147189.624719:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:1.0:1746147189.624723:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147188 -> 1746147189 00002000:00010000:1.0:1746147189.624726:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:1.0:1746147189.624749:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6570380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466430080:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147189.624774:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbec00/0xb4b2209fbdac7086 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e50 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.624784:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbec00/0xb4b2209fbdac7086 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e50 expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.624793:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbec00, rc 0) 00000100:00100000:1.0:1746147189.624816:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463813248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2648us (2683us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147189.624821:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11831 00000100:00100000:1.0:1746147189.624858:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466429568:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147189.624871:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac7063 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e34 expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.624879:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf000/0xb4b2209fbdac7063 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e34 expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.624885:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbf000, rc 0) 00000100:00100000:1.0:1746147189.624898:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463812736:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4271us (4729us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147189.624902:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11826 00000100:00100000:1.0:1746147189.624930:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466429440:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.624955:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466429696:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.624973:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 21 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.624980:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e200, rc 0) 00000100:00100000:1.0:1746147189.624994:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29001:x1830967463812224:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4678us (4921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.624999:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11823 00002000:00010000:2.0:1746147189.625222:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:2.0:1746147189.625225:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147188 -> 1746147189 00002000:00010000:2.0:1746147189.625226:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:2.0:1746147189.625239:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466429824:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.625261:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea19c00/0xb4b2209fbdac7078 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e3b expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.625270:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea19c00/0xb4b2209fbdac7078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e3b expref: 14 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.625281:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19c00, rc 0) 00000100:00100000:2.0:1746147189.625300:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463812864:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3740us (5095us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.625306:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11829 00002000:00010000:3.0:1746147189.625444:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:3.0:1746147189.625447:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147187 -> 1746147189 00002000:00010000:3.0:1746147189.625449:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:3.0:1746147189.625459:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466429312:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.625474:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7055 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e1f expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.625483:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e1f expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.625495:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4ae00, rc 0) 00000100:00100000:3.0:1746147189.625511:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463812352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5191us (5392us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.625520:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11824 00000100:00100000:0.0:1746147189.627711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.627966:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813504 00000100:00100000:3.0:1746147189.627973:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813504 00010000:00010000:3.0:1746147189.628001:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 676 lvb_type: 1 00000100:00100000:3.0:1746147189.628552:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5870 00000100:00100000:3.0:1746147189.628560:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463813504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147189.628572:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147189.628601:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.628612:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.628634:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801309ed800/0xb4b2209fbdac6fc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6daf expref: 21 pid: 11147 timeout: 676 lvb_type: 1 00010000:00010000:3.0:1746147189.628649:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147189.628697:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463813504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 138us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.628702:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5870 00000100:00100000:2.0:1746147189.629782:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466430208:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.629815:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbebe00/0xb4b2209fbdac708d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e57 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.629826:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbebe00/0xb4b2209fbdac708d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e57 expref: 22 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.629834:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbebe00, rc 0) 00000100:00100000:2.0:1746147189.629876:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463813376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6239us (7151us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.629883:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11832 00000100:00100000:1.0:1746147189.629886:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466429952:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147189.629905:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f63ea00/0xb4b2209fbdac7071 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e42 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.629914:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f63ea00/0xb4b2209fbdac7071 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e42 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.629926:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63ea00, rc 0) 00000100:00100000:1.0:1746147189.629959:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463812992:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8418us (9776us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147189.629965:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11828 00000100:00100000:0.0:1746147189.631108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.631176:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813632 00000100:00100000:2.0:1746147189.631182:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813632 00010000:00010000:2.0:1746147189.631206:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.631240:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5871 00000100:00100000:2.0:1746147189.631247:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463813632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.631259:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.631274:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.631285:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.631304:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d55000/0xb4b2209fbdac6fd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dd2 expref: 38 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.631316:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.631318:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.631324:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.631331:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.631361:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 19 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.631372:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430336:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.631454:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.631805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.631850:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463813888 00000100:00100000:1.0:1746147189.631854:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463813888 00000100:00100000:1.0:1746147189.631889:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10541 00000100:00100000:1.0:1746147189.631893:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:29002:x1830967463813888:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147189.631911:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.631927:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf800/0xb4b2209fbdac7094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e5e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.632037:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.632051:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.632057:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.632076:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.632086:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 26 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.632099:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6573b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466430464:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.632132:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.635238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.635439:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463814016 00000100:00100000:1.0:1746147189.635447:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463814016 00000100:00100000:1.0:1746147189.635504:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11833 00000100:00100000:1.0:1746147189.635512:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:29008:x1830967463814016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.635531:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.635549:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e65 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.635579:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.635597:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147189.635598:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147189.635602:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.635632:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 37 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.635642:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 37 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.635654:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6573800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466430592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.636025:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.638083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.638085:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6573b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466430464:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.638110:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147189.638172:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430336:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.638186:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.638227:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463813632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6979us (7121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.638236:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5871 00000100:00100000:2.0:1746147189.638261:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463814144 00000100:00100000:2.0:1746147189.638265:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463814144 00010000:00010000:2.0:1746147189.638284:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 27 pid: 14049 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.638306:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5872 00000100:00100000:2.0:1746147189.638312:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+27:1957:x1830967463814144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.638322:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.638497:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 27 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.638510:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 27 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.638531:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbfa00/0xb4b2209fbdac7047 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e11 expref: 27 pid: 14049 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.638543:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.638546:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.638555:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.638561:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.638576:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.638600:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:1957:x1830967463814144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 288us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.638606:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5872 00010000:00010000:1.0:1746147189.638691:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147189.638697:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147189.638716:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147189.638869:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbf800/0xb4b2209fbdac7094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e5e expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.638887:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e5e expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.638893:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147189.638896:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147189.638898:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbe400, rc 0) 00000100:00100000:1.0:1746147189.638930:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:29002:x1830967463813888:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 7036us (7125us total) trans 8589944294 rc 0/0 00000100:00100000:1.0:1746147189.638961:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10541 00000100:00100000:0.0:1746147189.640297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.640847:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6573800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466430592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.640876:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.640896:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbf200, rc 0) 00000100:00100000:1.0:1746147189.640933:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29008:x1830967463814016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5421us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.640965:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463814272 00000100:00100000:1.0:1746147189.640968:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11833 00000100:00100000:2.0:1746147189.640971:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463814272 00002000:00100000:2.0:1746147189.641002:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1609728->2097151) req@ffff88009f046680 x1830967463814272/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.641010:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830967463814272 ext(1609728->2097151) 00010000:00010000:2.0:1746147189.641016:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 37 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.641028:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 37 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.641033:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f046680 00000100:00100000:2.0:1746147189.641051:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1558 00000100:00100000:2.0:1746147189.641057:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463814272:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147189.642176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.642977:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463814656 00000100:00100000:2.0:1746147189.642983:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463814656 00002000:00100000:2.0:1746147189.643011:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800a5a0ed80 x1830967463814656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.643020:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463814656 ext(0->1048575) 00002000:00010000:2.0:1746147189.643025:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:2.0:1746147189.643050:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4555 00000100:00100000:2.0:1746147189.643055:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463814656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.645822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.645870:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463815040 00000100:00100000:2.0:1746147189.645877:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463815040 00000100:00100000:2.0:1746147189.645929:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10542 00000100:00100000:2.0:1746147189.645955:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:29002:x1830967463815040:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147189.645978:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.645981:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147189.646009:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cbe400/0xb4b2209fbdac709b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e5e expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.646024:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.646028:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147189.646037:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb400/0xb4b2209fbdac70b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e6c expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.646092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147189.646124:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147189.646131:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463814912 00000100:00100000:3.0:1746147189.646135:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463814912 00010000:00010000:2.0:1746147189.646136:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646145:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646156:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147189.646161:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4183 00010000:00010000:2.0:1746147189.646161:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646166:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147189.646167:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+40:29001:x1830967463814912:12345-192.168.203.36@tcp:35:multiop.0 00010000:00010000:2.0:1746147189.646171:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeb600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147189.646174:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646183:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646189:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.646191:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147189.646194:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646198:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb600/0xb4b2209fbdac70b7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.646218:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb400/0xb4b2209fbdac70b0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e6c expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.646225:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeb400/0xb4b2209fbdac70b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e6c expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.646232:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeb400, rc 0) 00000100:00100000:2.0:1746147189.646307:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:29002:x1830967463815040:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 371us (496us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.646309:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+41:29001:x1830967463814912:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 140us (216us total) trans 8589944295 rc 0/0 00000100:00100000:2.0:1746147189.646313:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10542 00000100:00100000:3.0:1746147189.646315:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4183 00000100:00100000:1.0:1746147189.651542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.651638:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463815296 00000100:00100000:2.0:1746147189.651646:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463815296 00002000:00100000:2.0:1746147189.651686:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a6573b80 x1830967463815296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.651697:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573b80 with x1830967463815296 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.651702:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573b80 00000100:00100000:2.0:1746147189.651721:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4556 00000100:00100000:2.0:1746147189.651729:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463815296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.654489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.654530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.654599:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463815552 00000100:00100000:1.0:1746147189.654606:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463815552 00002000:00100000:1.0:1746147189.654694:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1609727) req@ffff88012ecefb80 x1830967463815552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.654703:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967463815552 ext(1048576->1609727) 00010000:00010000:1.0:1746147189.654809:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 41 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.654825:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 41 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:1.0:1746147189.654832:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecefb80 00000100:00100000:1.0:1746147189.654856:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463815808 00000100:00100000:1.0:1746147189.654859:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463815808 00002000:00100000:1.0:1746147189.654873:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x418:0x0] (1105920->2097151) req@ffff88012ecef800 x1830967463815808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.654880:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967463815808 ext(1105920->2097151) 00002000:00010000:1.0:1746147189.654883:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecef800 00000100:00100000:1.0:1746147189.654894:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1559 00000100:00100000:1.0:1746147189.654901:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463815552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.655168:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4557 00000100:00100000:2.0:1746147189.655174:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463815808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147189.659613:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967463814272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 18542us (19310us total) trans 17179873238 rc 0/0 00000100:00100000:3.0:1746147189.659626:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1558 00002000:00100000:3.0:1746147189.659635:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1609728->2097151) req@ffff88009f046680 x1830967463814272/t17179873238(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.659644:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830967463814272 ext(1609728->2097151) 00010000:00010000:3.0:1746147189.659655:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 43 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.659670:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 43 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.659676:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f046680 00000100:00100000:2.0:1746147189.660314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.660334:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816064 00000100:00100000:2.0:1746147189.660340:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816064 00000100:00100000:2.0:1746147189.660365:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4184 00000100:00100000:2.0:1746147189.660371:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:29002:x1830967463816064:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147189.660516:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:29002:x1830967463816064:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 144us (204us total) trans 8589944296 rc 0/0 00000100:00100000:2.0:1746147189.660522:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4184 00000100:00100000:3.0:1746147189.662817:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463814656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19630us (20512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.662830:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4555 00002000:00100000:3.0:1746147189.662841:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800a5a0ed80 x1830967463814656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.662850:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5a0ed80 with x1830967463814656 ext(0->1048575) 00002000:00010000:3.0:1746147189.662857:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5a0ed80 00000100:00100000:2.0:1746147189.664060:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463815296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12325us (12522us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.664069:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4556 00002000:00100000:2.0:1746147189.664077:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a6573b80 x1830967463815296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.664085:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573b80 with x1830967463815296 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.664090:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573b80 00000100:00100000:2.0:1746147189.667223:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463815552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12311us (12734us total) trans 0 rc 561152/561152 00000100:00100000:2.0:1746147189.667233:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1559 00002000:00100000:2.0:1746147189.667242:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1609727) req@ffff88012ecefb80 x1830967463815552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.667251:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecefb80 with x1830967463815552 ext(1048576->1609727) 00010000:00010000:2.0:1746147189.667261:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 39 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.667274:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 39 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.667280:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ecefb80 00000100:00100000:3.0:1746147189.667417:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463815808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12242us (12885us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1746147189.667424:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4557 00002000:00100000:3.0:1746147189.667429:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1105920->2097151) req@ffff88012ecef800 x1830967463815808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.667435:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef800 with x1830967463815808 ext(1105920->2097151) 00002000:00010000:3.0:1746147189.667438:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecef800 00000100:00100000:1.0:1746147189.670120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.670603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.670708:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816192 00000100:00100000:0.0:1746147189.670708:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816320 00000100:00100000:2.0:1746147189.670715:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816192 00000100:00100000:0.0:1746147189.670716:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816320 00010000:00010000:2.0:1746147189.670747:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 40 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:0.0:1746147189.670763:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11834 00000100:00100000:0.0:1746147189.670770:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+40:29007:x1830967463816320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147189.670784:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147189.670800:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e73 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.670823:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147189.670828:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.670839:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 41 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.670853:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cbe800, rc 0) 00000100:00100000:2.0:1746147189.670868:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5873 00000100:00100000:2.0:1746147189.670875:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463816192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.670884:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147189.670965:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:29007:x1830967463816320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 194us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.670970:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11834 00010000:00010000:2.0:1746147189.671022:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 40 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.671034:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 40 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.671090:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac701d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dfc expref: 40 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.671100:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.671102:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.671108:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.671116:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.671123:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.671124:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.671127:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.671134:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.671158:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 39 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.671169:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430720:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.671244:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 20 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.671252:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430848:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.671269:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.674238:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.676625:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466430848:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.676650:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.676700:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463816192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5825us (6587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.676710:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5873 00000100:00100000:1.0:1746147189.676799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.676831:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816576 00000100:00100000:1.0:1746147189.676835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.676836:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816576 00002000:00100000:2.0:1746147189.676870:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a6570380 x1830967463816576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.676882:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570380 with x1830967463816576 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.676886:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570380 00000100:00100000:2.0:1746147189.676908:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816832 00000100:00100000:2.0:1746147189.676910:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816832 00002000:00100000:2.0:1746147189.676919:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a6573480 x1830967463816832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.676925:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573480 with x1830967463816832 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.676927:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573480 00000100:00100000:2.0:1746147189.676955:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4558 00000100:00100000:2.0:1746147189.676960:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463816576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147189.677981:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4559 00000100:00100000:3.0:1746147189.677990:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463816832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.687243:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463816576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10269us (10628us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.687256:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4558 00002000:00100000:2.0:1746147189.687266:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a6570380 x1830967463816576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.687276:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570380 with x1830967463816576 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.687283:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6570380 00000100:00100000:3.0:1746147189.687446:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463816832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9457us (10609us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.687453:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4559 00002000:00100000:3.0:1746147189.687458:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800a6573480 x1830967463816832/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.687465:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6573480 with x1830967463816832 ext(1048576->2097151) 00002000:00010000:3.0:1746147189.687469:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6573480 00000100:00100000:0.0:1746147189.696703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.696745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.696832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.696919:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463816960 00000100:00100000:2.0:1746147189.696928:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463816960 00000100:00100000:2.0:1746147189.696992:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817088 00000100:00100000:2.0:1746147189.696994:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817088 00000100:00100000:2.0:1746147189.697016:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817216 00000100:00100000:2.0:1746147189.697018:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817216 00000100:00100000:2.0:1746147189.697037:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11835 00000100:00100000:2.0:1746147189.697044:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29008:x1830967463816960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.697062:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.697078:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e7a expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.697104:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.697112:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147189.697113:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147189.697116:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.697141:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.697151:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 26 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.697161:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466430976:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.697235:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.697300:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11836 00000100:00100000:2.0:1746147189.697305:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463817088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.697312:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.697318:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbebc00/0xb4b2209fbdac70cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e81 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.697342:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466431104:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147189.697363:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099ea8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.697442:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11837 00000100:00100000:1.0:1746147189.697449:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463817216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.697456:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.697467:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac70d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e88 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.697490:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466431232:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147189.697518:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.702830:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466430976:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.702865:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.702881:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeba00, rc 0) 00000100:00100000:2.0:1746147189.702957:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29008:x1830967463816960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5912us (6262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.702965:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11835 00002000:00010000:1.0:1746147189.703200:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:1.0:1746147189.703204:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147188 -> 1746147189 00002000:00010000:1.0:1746147189.703206:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:1.0:1746147189.703226:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6570000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466431232:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147189.703253:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac70d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e88 expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.703264:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6200/0xb4b2209fbdac70d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e88 expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.703278:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6200, rc 0) 00000100:00100000:1.0:1746147189.703299:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463817216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5850us (6466us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147189.703305:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11837 00000100:00100000:1.0:1746147189.703362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.703502:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817344 00000100:00100000:3.0:1746147189.703508:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817344 00002000:00100000:3.0:1746147189.703543:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1105919) req@ffff8800a6570000 x1830967463817344/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.703551:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570000 with x1830967463817344 ext(1048576->1105919) 00010000:00010000:3.0:1746147189.703557:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 28 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.703572:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 28 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.703578:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6570000 00000100:00100000:3.0:1746147189.703599:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1560 00000100:00100000:3.0:1746147189.703605:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463817344:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147189.703996:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466431104:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.704011:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbebc00/0xb4b2209fbdac70cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e81 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.704020:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbebc00/0xb4b2209fbdac70cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e81 expref: 29 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.704031:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbebc00, rc 0) 00000100:00100000:2.0:1746147189.704647:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463817088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7339us (7899us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.704656:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11836 00000100:00100000:3.0:1746147189.709492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.709569:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817472 00000100:00100000:3.0:1746147189.709578:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817472 00000100:00100000:3.0:1746147189.709662:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11838 00000100:00100000:3.0:1746147189.709670:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:29007:x1830967463817472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.709697:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.709719:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e8f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.709745:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.709751:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147189.709753:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147189.709755:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.709780:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.709792:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 21 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.709803:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466431360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.709875:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.711471:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463817344:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7857us (8100us total) trans 21474840645 rc 0/0 00000100:00100000:2.0:1746147189.711483:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1560 00002000:00100000:2.0:1746147189.711493:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1105919) req@ffff8800a6570000 x1830967463817344/t21474840645(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.711502:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6570000 with x1830967463817344 ext(1048576->1105919) 00010000:00010000:2.0:1746147189.711512:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 30 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.711525:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 30 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.711532:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6570000 00000100:00100000:0.0:1746147189.712641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.712740:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466431360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.712769:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.712783:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea18200, rc 0) 00000100:00100000:3.0:1746147189.713263:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:29007:x1830967463817472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3591us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.713271:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11838 00000100:00100000:2.0:1746147189.713428:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817600 00000100:00100000:2.0:1746147189.713437:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817600 00002000:00100000:2.0:1746147189.713476:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (3031040->3145727) req@ffff88009f045880 x1830967463817600/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.713484:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967463817600 ext(3031040->3145727) 00010000:00010000:2.0:1746147189.713491:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.713571:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 22 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.713591:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f045880 00000100:00100000:2.0:1746147189.713626:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1561 00000100:00100000:2.0:1746147189.713634:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463817600:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147189.715371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.715415:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817728 00000100:00100000:3.0:1746147189.715431:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817728 00010000:00010000:3.0:1746147189.715460:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 29 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.715514:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5874 00000100:00100000:1.0:1746147189.715537:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463817728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.715553:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.715575:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 29 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.715599:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 29 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.715619:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7024 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e03 expref: 29 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.715635:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.715636:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.715643:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.715650:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.715681:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.715692:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466431488:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147189.715780:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.718505:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463817600:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4861us (5860us total) trans 21474840646 rc 0/0 00000100:00100000:2.0:1746147189.718515:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1561 00002000:00100000:2.0:1746147189.718524:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (3031040->3145727) req@ffff88009f045880 x1830967463817600/t21474840646(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.718533:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830967463817600 ext(3031040->3145727) 00010000:00010000:2.0:1746147189.718543:0:8486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.718557:0:8486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00002000:00010000:2.0:1746147189.718562:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f045880 00000100:00100000:1.0:1746147189.718657:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466431488:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147189.718711:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.718745:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463817728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3223us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.718753:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5874 00000100:00100000:0.0:1746147189.720548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.720625:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463817856 00000100:00100000:1.0:1746147189.720632:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463817856 00010000:00010000:1.0:1746147189.720657:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.720689:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5875 00000100:00100000:1.0:1746147189.720695:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463817856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.720707:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147189.720723:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.720732:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.720750:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491fe00/0xb4b2209fbdac702b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e0a expref: 24 pid: 4444 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.720763:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.720765:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.720770:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.720782:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.720806:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.720816:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466431616:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147189.721277:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.723026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.723230:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463818112 00000100:00100000:2.0:1746147189.723238:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463818112 00002000:00100000:2.0:1746147189.723272:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f768700 x1830967463818112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.723280:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768700 with x1830967463818112 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.723284:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f768700 00000100:00100000:2.0:1746147189.723310:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4560 00000100:00100000:2.0:1746147189.723317:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463818112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.723356:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466431616:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147189.723375:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.723421:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463817856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2725us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.723429:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5875 00000100:00100000:0.0:1746147189.729120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.729545:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463818368 00000100:00100000:3.0:1746147189.729554:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463818368 00002000:00100000:3.0:1746147189.729602:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a6571f80 x1830967463818368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.729610:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6571f80 with x1830967463818368 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.729615:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6571f80 00000100:00100000:3.0:1746147189.729647:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4561 00000100:00100000:3.0:1746147189.729654:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463818368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.730421:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463818112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7102us (7398us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.730429:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4560 00002000:00100000:2.0:1746147189.730438:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f768700 x1830967463818112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.730446:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f768700 with x1830967463818112 ext(1048576->2097151) 00002000:00010000:2.0:1746147189.730448:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f768700 00000100:00100000:0.0:1746147189.737258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.737352:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463818496 00000100:00100000:3.0:1746147189.737362:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463818496 00000100:00100000:3.0:1746147189.739413:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11839 00000100:00100000:3.0:1746147189.739429:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29008:x1830967463818496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.739445:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.739461:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e96 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.739484:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.739486:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.739492:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.739503:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.739511:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea19800, rc 0) 00000100:00100000:3.0:1746147189.739557:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29008:x1830967463818496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 134us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.739563:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11839 00000100:00100000:3.0:1746147189.740680:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463818368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11024us (11564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.740687:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4561 00002000:00100000:3.0:1746147189.740695:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a6571f80 x1830967463818368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.740707:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6571f80 with x1830967463818368 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.740712:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6571f80 00000100:00100000:0.0:1746147189.748357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.748534:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463818624 00000100:00100000:3.0:1746147189.748543:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463818624 00000100:00100000:0.0:1746147189.749670:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11840 00000100:00100000:1.0:1746147189.749741:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:29007:x1830967463818624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.749758:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.749773:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6e9d expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.749796:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.749802:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147189.749804:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147189.749807:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.749830:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.749845:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 20 pid: 6881 timeout: 676 lvb_type: 0 00000100:00100000:1.0:1746147189.749855:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466431744:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147189.749928:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.750370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.750400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.750426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.750449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.750464:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463819136 00000100:00100000:0.0:1746147189.750470:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463819136 00002000:00100000:0.0:1746147189.750496:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3526656->4194303) req@ffff880099f69500 x1830967463819136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.750503:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967463819136 ext(3526656->4194303) 00010000:00010000:0.0:1746147189.750509:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 21 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.750519:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 21 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:0.0:1746147189.750524:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69500 00000100:00100000:0.0:1746147189.750537:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463819008 00000100:00100000:0.0:1746147189.750539:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463819008 00002000:00100000:0.0:1746147189.750550:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2478080->3526655) req@ffff880099f6b800 x1830967463819008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.750556:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b800 with x1830967463819008 ext(2478080->3526655) 00010000:00010000:0.0:1746147189.750559:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 22 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.750567:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 22 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:0.0:1746147189.750572:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6b800 00000100:00100000:0.0:1746147189.750590:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463819392 00000100:00100000:0.0:1746147189.750596:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463819392 00002000:00100000:0.0:1746147189.750607:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880099f68380 x1830967463819392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.750614:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967463819392 ext(2097152->3145727) 00002000:00010000:0.0:1746147189.750617:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68380 00000100:00100000:0.0:1746147189.750626:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463819520 00000100:00100000:0.0:1746147189.750628:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463819520 00002000:00100000:0.0:1746147189.750636:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69f80 x1830967463819520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.750642:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967463819520 ext(3145728->4194303) 00002000:00010000:0.0:1746147189.750644:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69f80 00000100:00100000:2.0:1746147189.750652:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1562 00000100:00100000:2.0:1746147189.750659:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463819136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.751333:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1563 00000100:00100000:0.0:1746147189.751341:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463819008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147189.751802:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4562 00000100:00100000:2.0:1746147189.751809:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463819392:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147189.751899:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4563 00000100:00100000:1.0:1746147189.751906:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463819520:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.758915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.759976:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466431744:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.760005:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.760019:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b3b6a00, rc 0) 00000100:00100000:1.0:1746147189.760063:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:29007:x1830967463818624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10384us (11712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.760070:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11840 00000100:00100000:3.0:1746147189.761488:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463819776 00000100:00100000:3.0:1746147189.761498:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463819776 00002000:00100000:3.0:1746147189.761532:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2478079) req@ffff880099f6a680 x1830967463819776/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.761539:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967463819776 ext(2097152->2478079) 00010000:00010000:3.0:1746147189.761546:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 25 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.761558:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 25 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.761563:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6a680 00000100:00100000:3.0:1746147189.761605:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1564 00000100:00100000:3.0:1746147189.761612:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463819776:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147189.763185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.764572:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463819136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13909us (14198us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746147189.764594:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1562 00002000:00100000:3.0:1746147189.764604:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3526656->4194303) req@ffff880099f69500 x1830967463819136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.764612:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69500 with x1830967463819136 ext(3526656->4194303) 00010000:00010000:3.0:1746147189.764622:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 25 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.764633:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 25 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.764639:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f69500 00000100:00100000:2.0:1746147189.764803:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820032 00000100:00100000:2.0:1746147189.764810:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820032 00000100:00100000:2.0:1746147189.764840:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10543 00000100:00100000:2.0:1746147189.764846:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+328:29012:x1830967463820032:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.764862:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.764875:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac70ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ea4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.765224:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.765241:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.765258:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147189.765269:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:2.0:1746147189.765397:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c95800/0xb4b2209fbdac70ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 331 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.765431:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 330 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.765440:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.765442:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147189.765446:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1bc00, rc 0) 00000100:00100000:2.0:1746147189.765501:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:29012:x1830967463820032:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 653us (2317us total) trans 8589944297 rc 0/0 00000100:00100000:2.0:1746147189.765509:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10543 00000100:00100000:0.0:1746147189.771714:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463819520:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19801us (21257us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147189.771725:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4563 00002000:00100000:0.0:1746147189.771736:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69f80 x1830967463819520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.771745:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69f80 with x1830967463819520 ext(3145728->4194303) 00002000:00010000:0.0:1746147189.771750:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69f80 00000100:00100000:0.0:1746147189.772104:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463819008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20764us (21702us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147189.772110:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1563 00002000:00100000:0.0:1746147189.772116:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2478080->3526655) req@ffff880099f6b800 x1830967463819008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147189.772123:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6b800 with x1830967463819008 ext(2478080->3526655) 00010000:00010000:0.0:1746147189.772130:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 23 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:0.0:1746147189.772142:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 23 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:0.0:1746147189.772148:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6b800 00000100:00100000:3.0:1746147189.774815:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463819776:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13195us (15899us total) trans 17179873239 rc 0/0 00000100:00100000:3.0:1746147189.774825:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1564 00002000:00100000:3.0:1746147189.774835:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2478079) req@ffff880099f6a680 x1830967463819776/t17179873239(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/448 e 0 to 0 dl 1746147200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.774843:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a680 with x1830967463819776 ext(2097152->2478079) 00010000:00010000:3.0:1746147189.774852:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 23 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:3.0:1746147189.774864:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 23 pid: 6881 timeout: 676 lvb_type: 0 00002000:00010000:3.0:1746147189.774869:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099f6a680 00000100:00100000:2.0:1746147189.775716:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463819392:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23900us (25281us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.775727:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4562 00002000:00100000:2.0:1746147189.775737:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880099f68380 x1830967463819392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.775746:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68380 with x1830967463819392 ext(2097152->3145727) 00002000:00010000:2.0:1746147189.775751:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68380 00000100:00100000:0.0:1746147189.781474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147189.781539:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820160 00000100:00100000:1.0:1746147189.781549:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820160 00000100:00100000:1.0:1746147189.781612:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11841 00000100:00100000:1.0:1746147189.781620:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29008:x1830967463820160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147189.781638:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147189.781656:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6eab expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.781684:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147189.781688:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.781698:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.781707:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b17b4600, rc 0) 00000100:00100000:1.0:1746147189.781761:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29008:x1830967463820160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.781767:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11841 00000100:00100000:0.0:1746147189.782011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.782767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.782919:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820288 00000100:00100000:2.0:1746147189.782926:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820288 00000100:00100000:2.0:1746147189.783072:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11842 00000100:00100000:2.0:1746147189.783080:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:29012:x1830967463820288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.783091:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.783101:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6eb2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.783116:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820416 00000100:00100000:1.0:1746147189.783120:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820416 00010000:00010000:2.0:1746147189.783122:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.783129:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.783135:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.783136:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.783140:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.783142:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.783145:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [778240->851967] (req 778240->851967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.783153:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5876 00000100:00100000:1.0:1746147189.783158:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463820416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147189.783166:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.783168:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.783177:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:1.0:1746147189.783181:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.783186:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466431872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.783190:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.783203:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491e200/0xb4b2209fbdac704e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e18 expref: 24 pid: 6881 timeout: 676 lvb_type: 0 00010000:00010000:1.0:1746147189.783217:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.783218:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.783223:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.783230:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.783235:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.783236:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147189.783239:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147189.783245:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.783252:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 10 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147189.783261:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.783264:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 10 pid: 4444 timeout: 676 lvb_type: 1 00000100:00100000:1.0:1746147189.783269:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466432128:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.783271:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147189.783296:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147189.783303:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466432256:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.783615:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 23 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.783623:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 23 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.783631:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.783649:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099ea8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.783844:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147189.789124:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466432128:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147189.789137:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f768a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466432256:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147189.789157:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147189.789206:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463820416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6047us (6440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147189.789215:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5876 00000100:00100000:2.0:1746147189.789316:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466431872:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.789325:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432000:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147189.789332:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147189.789352:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [778240->851967] (req 778240->851967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.789367:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811400, rc 0) 00000100:00100000:2.0:1746147189.789385:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:29012:x1830967463820288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6307us (7375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.789391:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11842 00000100:00100000:0.0:1746147189.790442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.790471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.790496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.790554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.790591:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820672 00000100:00100000:2.0:1746147189.790598:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820672 00010000:00010000:2.0:1746147189.790622:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 24 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.790642:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820544 00000100:00100000:2.0:1746147189.790643:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820544 00010000:00010000:2.0:1746147189.790652:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 11 pid: 4444 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.790662:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463820928 00000100:00100000:2.0:1746147189.790663:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463820928 00010000:00010000:2.0:1746147189.790670:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 676 lvb_type: 1 00000100:00100000:2.0:1746147189.790689:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5877 00000100:00100000:2.0:1746147189.790695:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463820672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.790706:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.790723:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 24 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790732:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 24 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790748:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309ece00/0xb4b2209fbdac6fad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6d8c expref: 24 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790761:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.790783:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5840050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463820672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.790790:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5877 00000100:00100000:2.0:1746147189.790833:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5878 00000100:00100000:2.0:1746147189.790838:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463820544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.790844:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.790851:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 11 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790857:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 11 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790868:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0xb4b2209fbdac705c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e26 expref: 11 pid: 4444 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790876:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.790888:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463820544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.790893:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5878 00000100:00100000:2.0:1746147189.790901:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5879 00000100:00100000:2.0:1746147189.790905:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463820928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.790910:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.790916:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790923:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790955:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d55800/0xb4b2209fbdac6fc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6db6 expref: 29 pid: 8478 timeout: 676 lvb_type: 1 00010000:00010000:2.0:1746147189.790962:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.790965:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.790970:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.790977:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.791004:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 28 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.791014:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466432512:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.791058:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147189.791241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.791448:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463821184 00000100:00100000:3.0:1746147189.791453:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463821184 00002000:00100000:3.0:1746147189.791480:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880099f69880 x1830967463821184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.791488:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463821184 ext(3145728->4194303) 00002000:00010000:3.0:1746147189.791491:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:3.0:1746147189.791502:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463821056 00000100:00100000:3.0:1746147189.791504:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463821056 00002000:00100000:3.0:1746147189.791513:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880099f68000 x1830967463821056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.791519:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967463821056 ext(2097152->3145727) 00002000:00010000:3.0:1746147189.791521:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:3.0:1746147189.791530:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4564 00000100:00100000:3.0:1746147189.791535:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463821184:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147189.792592:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4565 00000100:00100000:1.0:1746147189.792601:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463821056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.797671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.797757:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466432512:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.797774:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.797814:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463820928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6907us (7316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.797823:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5879 00000100:00100000:1.0:1746147189.798404:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463821568 00000100:00100000:1.0:1746147189.798411:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463821568 00002000:00100000:1.0:1746147189.798442:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (778240->782335) req@ffff880099f68a80 x1830967463821568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.798449:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68a80 with x1830967463821568 ext(778240->782335) 00002000:00010000:1.0:1746147189.798453:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68a80 00000100:00100000:1.0:1746147189.798482:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4566 00000100:00100000:1.0:1746147189.798489:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463821568:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147189.798628:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463821568:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 140us (964us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147189.798633:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4566 00002000:00100000:1.0:1746147189.798638:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (778240->782335) req@ffff880099f68a80 x1830967463821568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.798644:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68a80 with x1830967463821568 ext(778240->782335) 00002000:00010000:1.0:1746147189.798647:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f68a80 00000100:00100000:0.0:1746147189.803088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.803239:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147189.803269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.803424:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463821952 00000100:00100000:2.0:1746147189.803434:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463821952 00002000:00100000:2.0:1746147189.803471:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69c00 x1830967463821952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.803483:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967463821952 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.803488:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:2.0:1746147189.803505:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463822080 00000100:00100000:2.0:1746147189.803507:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463822080 00002000:00100000:2.0:1746147189.803518:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9880 x1830967463822080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.803523:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967463822080 ext(2097152->3145727) 00002000:00010000:2.0:1746147189.803526:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:2.0:1746147189.803540:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463822208 00000100:00100000:2.0:1746147189.803542:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463822208 00002000:00100000:2.0:1746147189.803551:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edcbb80 x1830967463822208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.803556:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967463822208 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.803558:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcbb80 00000100:00100000:2.0:1746147189.803569:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4567 00000100:00100000:2.0:1746147189.803575:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463821952:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147189.803597:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4568 00000100:00100000:1.0:1746147189.803604:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463822080:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147189.804828:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4569 00000100:00100000:3.0:1746147189.804838:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463822208:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.807734:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463821184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16189us (17171us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.807744:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4564 00002000:00100000:2.0:1746147189.807756:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880099f69880 x1830967463821184/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.807763:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69880 with x1830967463821184 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.807768:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f69880 00000100:00100000:1.0:1746147189.812314:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463821056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19706us (21064us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147189.812324:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4565 00002000:00100000:1.0:1746147189.812337:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880099f68000 x1830967463821056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.812345:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f68000 with x1830967463821056 ext(2097152->3145727) 00002000:00010000:1.0:1746147189.812351:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f68000 00000100:00100000:2.0:1746147189.814511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.814561:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463822592 00000100:00100000:2.0:1746147189.814569:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463822592 00002000:00100000:2.0:1746147189.814621:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (847872->851967) req@ffff88012ecece00 x1830967463822592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.814630:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967463822592 ext(847872->851967) 00002000:00010000:2.0:1746147189.814635:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:2.0:1746147189.814662:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4570 00000100:00100000:2.0:1746147189.814670:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463822592:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.814828:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463822592:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 158us (323us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147189.814833:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4570 00002000:00100000:2.0:1746147189.814839:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x416:0x0] (847872->851967) req@ffff88012ecece00 x1830967463822592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.814845:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecece00 with x1830967463822592 ext(847872->851967) 00002000:00010000:2.0:1746147189.814847:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecece00 00000100:00100000:1.0:1746147189.825216:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463822080:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 21603us (21968us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147189.825226:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4568 00002000:00100000:1.0:1746147189.825237:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009edc9880 x1830967463822080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147189.825244:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830967463822080 ext(2097152->3145727) 00002000:00010000:1.0:1746147189.825249:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:2.0:1746147189.826345:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463821952:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 22766us (23262us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147189.826354:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4567 00002000:00100000:2.0:1746147189.826360:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880099f69c00 x1830967463821952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.826367:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f69c00 with x1830967463821952 ext(3145728->4194303) 00002000:00010000:2.0:1746147189.826370:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f69c00 00000100:00100000:0.0:1746147189.829532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.829653:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463822720 00000100:00100000:2.0:1746147189.829662:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463822720 00000100:00100000:2.0:1746147189.829712:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11843 00000100:00100000:2.0:1746147189.829720:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463822720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.829736:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.829750:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6eb9 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.829794:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432640:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147189.833300:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.834111:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463822208:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 29271us (30837us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147189.834121:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4569 00002000:00100000:3.0:1746147189.834132:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009edcbb80 x1830967463822208/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147189.834141:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcbb80 with x1830967463822208 ext(3145728->4194303) 00002000:00010000:3.0:1746147189.834146:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcbb80 00002000:00010000:2.0:1746147189.836851:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147188 -> 1746147189 00002000:00010000:2.0:1746147189.836857:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147188 -> 1746147189 00002000:00010000:2.0:1746147189.836859:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147188 -> 1746147189 00000100:00100000:2.0:1746147189.836879:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432640:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.836908:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7112 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb9 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.836920:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb9 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.836961:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae800, rc 0) 00000100:00100000:2.0:1746147189.837012:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463822720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7292us (7485us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.837021:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11843 00010000:00010000:2.0:1746147189.837214:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147189.842601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.843268:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463822848 00000100:00100000:2.0:1746147189.843278:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463822848 00000100:00100000:2.0:1746147189.843361:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11844 00000100:00100000:2.0:1746147189.843368:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463822848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.843384:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.843399:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ec0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.843420:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.843421:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.843428:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.843440:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.843448:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afa00, rc 0) 00000100:00100000:2.0:1746147189.844072:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463822848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 702us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.844078:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11844 00000100:00100000:0.0:1746147189.844315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.844385:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463823104 00000100:00100000:2.0:1746147189.844390:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463823104 00002000:00100000:2.0:1746147189.844413:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edc9500 x1830967463823104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.844420:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9500 with x1830967463823104 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.844423:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9500 00000100:00100000:2.0:1746147189.844434:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4571 00000100:00100000:2.0:1746147189.844439:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.853534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.853702:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9259us (9384us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147189.853714:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4571 00002000:00100000:2.0:1746147189.853726:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edc9500 x1830967463823104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.853734:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9500 with x1830967463823104 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.853739:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9500 00000100:00100000:2.0:1746147189.853759:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463823360 00000100:00100000:2.0:1746147189.853765:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463823360 00002000:00100000:2.0:1746147189.853788:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edc9180 x1830967463823360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.853794:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967463823360 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.853796:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:2.0:1746147189.853810:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4572 00000100:00100000:2.0:1746147189.853816:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463823360:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147189.862022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.864003:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463823488 00000100:00100000:2.0:1746147189.864015:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463823488 00000100:00100000:2.0:1746147189.864074:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11845 00000100:00100000:2.0:1746147189.864081:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147189.864097:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.864111:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdac7120 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ec7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.864154:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432768:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147189.864231:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.865705:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463823360:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11884us (12173us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147189.865714:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4572 00002000:00100000:2.0:1746147189.865722:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009edc9180 x1830967463823360/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:565/0 lens 488/440 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.865731:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830967463823360 ext(4194304->4927487) 00002000:00010000:2.0:1746147189.865736:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:2.0:1746147189.876294:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432768:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147189.876334:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdac7120 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec7 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.876348:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af600/0xb4b2209fbdac7120 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec7 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147189.876373:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af600, rc 0) 00000100:00100000:2.0:1746147189.876434:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12353us (14418us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147189.876442:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11845 00000100:00100000:0.0:1746147189.892254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.892353:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463823872 00000100:00100000:3.0:1746147189.892369:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463823872 00000100:00100000:3.0:1746147189.892423:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11846 00000100:00100000:3.0:1746147189.892431:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147189.892448:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.892463:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7127 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ed5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.892645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.892754:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432896:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147189.892806:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463823744 00000100:00100000:2.0:1746147189.892813:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463823744 00000100:00100000:2.0:1746147189.892859:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10544 00000100:00100000:2.0:1746147189.892865:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+41:29016:x1830967463823744:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147189.892886:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147189.892900:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac712e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ece expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.893013:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.893028:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147189.893038:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147189.893049:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000100:00100000:3.0:1746147189.893055:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00010000:00010000:2.0:1746147189.893161:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac712e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 44 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.893179:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 43 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.893186:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147189.893189:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147189.893191:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afc00, rc 0) 00000100:00100000:2.0:1746147189.893242:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+43:29016:x1830967463823744:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 377us (597us total) trans 8589944298 rc 0/0 00000100:00100000:2.0:1746147189.893249:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10544 00000100:00100000:3.0:1746147189.895751:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466432896:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147189.895784:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7127 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ed5 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.895798:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7127 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ed5 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147189.895810:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e18400, rc 0) 00000100:00100000:3.0:1746147189.896096:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463823872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3664us (3850us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147189.896104:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11846 00000100:00100000:0.0:1746147189.908389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147189.909317:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824000 00000100:00100000:3.0:1746147189.909328:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824000 00000100:00100000:3.0:1746147189.909385:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11847 00000100:00100000:3.0:1746147189.909393:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29016:x1830967463824000:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147189.909409:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147189.909422:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6edc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909449:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909456:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909463:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.909465:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147189.909468:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3309568->3534847] (req 3309568->3534847) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909495:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909505:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.909517:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433024:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.909627:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.909635:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 28 pid: 4445 timeout: 676 lvb_type: 0 00000100:00100000:3.0:1746147189.909642:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433152:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.909661:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147189.911538:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147189.911548:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433152:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147189.911590:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3309568->3534847] (req 3309568->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147189.911609:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3600, rc 0) 00000100:00100000:3.0:1746147189.911654:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29016:x1830967463824000:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2261us (3272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147189.911661:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11847 00000100:00100000:0.0:1746147189.915055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.915186:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824128 00000100:00100000:2.0:1746147189.915195:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824128 00010000:00010000:2.0:1746147189.915228:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.915255:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5880 00000100:00100000:2.0:1746147189.915262:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463824128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.915277:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.915294:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.915304:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.915322:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea19800/0xb4b2209fbdac70e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e96 expref: 24 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.916631:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.916686:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463824128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1421us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.916695:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5880 00000100:00100000:0.0:1746147189.919097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.919187:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824256 00000100:00100000:2.0:1746147189.919197:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824256 00010000:00010000:2.0:1746147189.919225:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 676 lvb_type: 0 00000100:00100000:2.0:1746147189.919256:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5881 00000100:00100000:2.0:1746147189.919264:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463824256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147189.919279:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147189.919296:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.919308:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.919326:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea18200/0xb4b2209fbdac70da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e8f expref: 29 pid: 4445 timeout: 676 lvb_type: 0 00010000:00010000:2.0:1746147189.919337:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.919339:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147189.919344:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.919351:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147189.919378:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 22 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147189.919388:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466433280:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147189.919469:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147189.926020:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466433280:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147189.926040:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147189.926116:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463824256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6851us (7022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147189.926126:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5881 00000100:00100000:0.0:1746147189.931162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147189.933416:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824512 00000100:00100000:2.0:1746147189.933428:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824512 00002000:00100000:2.0:1746147189.933470:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3530752->3534847) req@ffff88009edcad80 x1830967463824512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/0 e 0 to 0 dl 1746147200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.933479:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967463824512 ext(3530752->3534847) 00002000:00010000:2.0:1746147189.933483:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:2.0:1746147189.933514:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4573 00000100:00100000:2.0:1746147189.933522:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463824512:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147189.933674:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463824512:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 152us (2518us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147189.933680:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4573 00002000:00100000:2.0:1746147189.933685:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3530752->3534847) req@ffff88009edcad80 x1830967463824512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746147200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147189.933692:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830967463824512 ext(3530752->3534847) 00002000:00010000:2.0:1746147189.933694:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:0.0:1746147190.020042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.020277:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824640 00000100:00100000:3.0:1746147190.020321:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824640 00000100:00100000:3.0:1746147190.020367:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11848 00000100:00100000:3.0:1746147190.020373:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463824640:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.020387:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.020397:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac714a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ee3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.020435:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433408:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147190.020510:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.021588:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433408:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.021612:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac714a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ee3 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.021623:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18000/0xb4b2209fbdac714a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ee3 expref: 24 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.021635:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e18000, rc 0) 00000100:00100000:3.0:1746147190.021822:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463824640:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1447us (1785us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147190.021832:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11848 00000100:00100000:0.0:1746147190.025701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.025970:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824768 00000100:00100000:3.0:1746147190.025980:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824768 00000100:00100000:3.0:1746147190.026029:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11849 00000100:00100000:3.0:1746147190.026037:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29022:x1830967463824768:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.026052:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.026066:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6eea expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.026087:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.026093:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147190.026094:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147190.026097:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.026122:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 27 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.026131:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 27 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.026141:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433536:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147190.026214:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.028223:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466433536:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.028254:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.028267:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e18400, rc 0) 00000100:00100000:3.0:1746147190.028442:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29022:x1830967463824768:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2403us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.028450:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11849 00000100:00100000:0.0:1746147190.029630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.029723:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463824896 00000100:00100000:1.0:1746147190.029730:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463824896 00002000:00100000:1.0:1746147190.029771:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (778240->851967) req@ffff8800929f7480 x1830967463824896/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.029780:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7480 with x1830967463824896 ext(778240->851967) 00010000:00010000:1.0:1746147190.029787:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 28 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.029802:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 28 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.029807:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f7480 00000100:00080000:2.0:1746147190.029950:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147190.030658:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1565 00000100:00100000:1.0:1746147190.030667:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967463824896:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147190.035753:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463824896:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5079us (6118us total) trans 21474840647 rc 0/0 00000100:00100000:1.0:1746147190.035765:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1565 00002000:00100000:1.0:1746147190.035777:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (778240->851967) req@ffff8800929f7480 x1830967463824896/t21474840647(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.035785:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7480 with x1830967463824896 ext(778240->851967) 00010000:00010000:1.0:1746147190.035795:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.035808:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.035815:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f7480 00000100:00100000:0.0:1746147190.038010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.038109:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463825024 00000100:00100000:2.0:1746147190.038118:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463825024 00010000:00010000:2.0:1746147190.038146:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.038169:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5882 00000100:00100000:2.0:1746147190.038175:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463825024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.038187:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.038205:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.038215:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.038235:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac710b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->851967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eb2 expref: 30 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.038271:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.038273:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.038280:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.038287:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.038314:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.038324:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466433664:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.038396:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.040542:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466433664:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.040558:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.040601:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463825024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2426us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.040610:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5882 00000100:00100000:0.0:1746147190.043912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.045731:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463825280 00000100:00100000:1.0:1746147190.045743:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463825280 00002000:00100000:1.0:1746147190.045788:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800929f5c00 x1830967463825280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.045797:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5c00 with x1830967463825280 ext(0->1048575) 00002000:00010000:1.0:1746147190.045803:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f5c00 00000100:00100000:1.0:1746147190.045838:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4574 00000100:00100000:1.0:1746147190.045846:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463825280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.057459:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463825280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11607us (13545us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.057471:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4574 00002000:00100000:1.0:1746147190.057482:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800929f5c00 x1830967463825280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.057489:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5c00 with x1830967463825280 ext(0->1048575) 00002000:00010000:1.0:1746147190.057494:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f5c00 00000100:00100000:0.0:1746147190.058808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.058905:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463825408 00000100:00100000:2.0:1746147190.058913:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463825408 00000100:00100000:2.0:1746147190.058975:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:2.0:1746147190.058981:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009343d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967463825408:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1746147190.059018:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009343d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967463825408:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.059023:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:0.0:1746147190.075567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.075616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.075671:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463825664 00000100:00100000:3.0:1746147190.075680:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463825664 00002000:00100000:3.0:1746147190.075720:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f6d80 x1830967463825664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147190.075720:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463825792 00000100:00100000:1.0:1746147190.075724:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463825792 00002000:00100000:3.0:1746147190.075728:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6d80 with x1830967463825664 ext(2097152->3145727) 00002000:00010000:3.0:1746147190.075732:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f6d80 00002000:00100000:1.0:1746147190.075740:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800929f7b80 x1830967463825792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 504/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.075747:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7b80 with x1830967463825792 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.075750:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7b80 00000100:00100000:3.0:1746147190.075760:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4575 00000100:00100000:1.0:1746147190.075765:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4576 00000100:00100000:3.0:1746147190.075767:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463825664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.075771:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463825792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.082560:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463825792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6778us (6932us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147190.082571:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4576 00002000:00100000:1.0:1746147190.082590:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800929f7b80 x1830967463825792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 504/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.082600:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7b80 with x1830967463825792 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.082606:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7b80 00000100:00100000:3.0:1746147190.084329:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463825664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8558us (8766us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.084338:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4575 00002000:00100000:3.0:1746147190.084346:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f6d80 x1830967463825664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.084354:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f6d80 with x1830967463825664 ext(2097152->3145727) 00002000:00010000:3.0:1746147190.084357:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f6d80 00000100:00100000:0.0:1746147190.092860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.092977:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463826176 00000100:00100000:3.0:1746147190.092987:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463826176 00002000:00100000:3.0:1746147190.093032:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800929f7800 x1830967463826176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.093041:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7800 with x1830967463826176 ext(4194304->4927487) 00002000:00010000:3.0:1746147190.093045:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7800 00000100:00100000:3.0:1746147190.093077:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4577 00000100:00100000:3.0:1746147190.093084:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463826176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147190.099358:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463826176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6264us (6495us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147190.099369:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4577 00002000:00100000:3.0:1746147190.099380:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff8800929f7800 x1830967463826176/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.099389:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f7800 with x1830967463826176 ext(4194304->4927487) 00002000:00010000:3.0:1746147190.099393:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929f7800 00000100:00100000:0.0:1746147190.120106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.120324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.120450:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463826304 00000100:00100000:3.0:1746147190.120459:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463826304 00000100:00100000:3.0:1746147190.120507:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463826432 00000100:00100000:3.0:1746147190.120510:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463826432 00000100:00100000:3.0:1746147190.120530:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11850 00000100:00100000:3.0:1746147190.120537:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463826304:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147190.120547:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11851 00010000:00010000:3.0:1746147190.120553:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147190.120555:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463826432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.120562:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.120569:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ef1 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.120570:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac715f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ef8 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.120599:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.120601:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.120608:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 31 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.124284:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 32 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.124300:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811400, rc 0) 00000100:00100000:2.0:1746147190.124461:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466433792:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147190.124567:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.125934:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463826304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5391us (5829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.125956:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11850 00000100:00100000:2.0:1746147190.126441:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466433792:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.126476:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac715f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef8 expref: 31 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.126488:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac715f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef8 expref: 31 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.126510:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af800, rc 0) 00000100:00100000:2.0:1746147190.126539:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463826432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5985us (6215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.126544:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11851 00000100:00100000:1.0:1746147190.142831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.142864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.142914:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463826816 00000100:00100000:3.0:1746147190.142921:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463826816 00002000:00100000:3.0:1746147190.142971:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f769500 x1830967463826816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.142980:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769500 with x1830967463826816 ext(1048576->2097151) 00002000:00010000:3.0:1746147190.142989:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769500 00000100:00100000:3.0:1746147190.143003:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463826688 00000100:00100000:3.0:1746147190.143006:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463826688 00002000:00100000:3.0:1746147190.143108:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f76bb80 x1830967463826688/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.143116:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76bb80 with x1830967463826688 ext(0->1048575) 00002000:00010000:3.0:1746147190.143119:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76bb80 00000100:00100000:3.0:1746147190.143131:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4578 00000100:00100000:3.0:1746147190.143138:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463826816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.144934:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4579 00000100:00100000:0.0:1746147190.144961:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463826688:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.157894:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463826688:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12929us (15020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.157905:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4579 00002000:00100000:1.0:1746147190.157914:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f76bb80 x1830967463826688/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.157923:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76bb80 with x1830967463826688 ext(0->1048575) 00002000:00010000:1.0:1746147190.157928:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76bb80 00000100:00100000:3.0:1746147190.158954:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463826816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15814us (16126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.158962:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4578 00002000:00100000:3.0:1746147190.158969:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f769500 x1830967463826816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.159160:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f769500 with x1830967463826816 ext(1048576->2097151) 00002000:00010000:3.0:1746147190.159165:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f769500 00000100:00100000:0.0:1746147190.169802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.171680:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827072 00000100:00100000:2.0:1746147190.171690:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827072 00000100:00100000:2.0:1746147190.171745:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11852 00000100:00100000:2.0:1746147190.171751:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29030:x1830967463827072:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.171796:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.171812:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6eff expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.171843:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.171851:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.171856:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.171857:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.171860:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3043328->3047423] (req 3043328->3047423) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.171887:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.171899:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.171910:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466433920:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.172057:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.172067:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 39 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.172075:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466434048:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.172101:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.176888:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466433920:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.176901:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466434048:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.176929:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3043328->3047423] (req 3043328->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 24 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.177025:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af600, rc 0) 00000100:00100000:2.0:1746147190.177081:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29030:x1830967463827072:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5329us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.177090:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11852 00000100:00100000:0.0:1746147190.178223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.178608:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827200 00000100:00100000:2.0:1746147190.178615:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827200 00010000:00010000:2.0:1746147190.178647:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.178683:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5883 00000100:00100000:2.0:1746147190.178689:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463827200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.178701:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.178720:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.178729:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.178748:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3b6a00/0xb4b2209fbdac70e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e9d expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00000100:00080000:0.0:1746147190.178832:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147190.179296:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.179337:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463827200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 646us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.179343:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5883 00000100:00100000:0.0:1746147190.180985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.181098:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827328 00000100:00100000:2.0:1746147190.181104:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827328 00010000:00010000:2.0:1746147190.181126:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.181146:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5884 00000100:00100000:2.0:1746147190.181151:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463827328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.181161:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.181181:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.181190:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.181206:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b17b4600/0xb4b2209fbdac7104 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eab expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.181217:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.181219:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.181224:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.181234:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.181262:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.181273:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466434176:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.181757:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.184495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.184598:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466434176:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.184614:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.184645:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463827328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3494us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.184653:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5884 00000100:00100000:3.0:1746147190.184762:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827584 00000100:00100000:3.0:1746147190.184768:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827584 00002000:00100000:3.0:1746147190.184798:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3043328->3047423) req@ffff8800929f5500 x1830967463827584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.184807:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5500 with x1830967463827584 ext(3043328->3047423) 00002000:00010000:3.0:1746147190.184811:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5500 00000100:00100000:3.0:1746147190.184837:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4580 00000100:00100000:3.0:1746147190.184844:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463827584:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147190.184996:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463827584:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 152us (507us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147190.185001:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4580 00002000:00100000:3.0:1746147190.185007:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3043328->3047423) req@ffff8800929f5500 x1830967463827584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.185014:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5500 with x1830967463827584 ext(3043328->3047423) 00002000:00010000:3.0:1746147190.185017:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929f5500 00000100:00100000:0.0:1746147190.185863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.185927:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827712 00000100:00100000:2.0:1746147190.185932:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827712 00000100:00100000:2.0:1746147190.185985:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11853 00000100:00100000:2.0:1746147190.185991:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:29024:x1830967463827712:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.186002:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.186016:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f06 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.186037:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.186043:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.186045:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.186048:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.186069:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 23 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.186277:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 23 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.186288:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466434304:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.187335:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.187792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.187957:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827840 00000100:00100000:3.0:1746147190.187963:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827840 00000100:00100000:3.0:1746147190.188018:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11854 00000100:00100000:3.0:1746147190.188024:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463827840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.188036:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.188046:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac7174 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f0d expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.188077:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466434432:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147190.189178:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.189521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.189651:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463827968 00000100:00100000:1.0:1746147190.189657:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463827968 00000100:00100000:1.0:1746147190.189735:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11855 00000100:00100000:1.0:1746147190.189743:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463827968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.189755:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.189767:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491fe00/0xb4b2209fbdac717b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f14 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.189801:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466434560:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147190.189841:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.192357:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466434432:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.192388:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac7174 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f0d expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.192398:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac7174 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f0d expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147190.192507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.192564:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466434304:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.192591:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.192602:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af800, rc 0) 00000100:00100000:2.0:1746147190.192647:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+32:29024:x1830967463827712:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6656us (6785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.192655:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11853 00000100:00100000:1.0:1746147190.192893:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466434560:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.192913:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491fe00/0xb4b2209fbdac717b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f14 expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.192923:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491fe00/0xb4b2209fbdac717b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f14 expref: 40 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.192956:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491fe00, rc 0) 00000100:00100000:1.0:1746147190.192980:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463827968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3237us (3461us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.192985:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11855 00010000:00010000:3.0:1746147190.193122:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7400, rc 0) 00000100:00100000:3.0:1746147190.193144:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967463827840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5120us (5353us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147190.193149:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11854 00000100:00100000:1.0:1746147190.193388:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828096 00000100:00100000:1.0:1746147190.193393:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828096 00002000:00100000:1.0:1746147190.193418:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3309568->3534847) req@ffff8800929f5180 x1830967463828096/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.193426:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5180 with x1830967463828096 ext(3309568->3534847) 00010000:00010000:1.0:1746147190.193432:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.193442:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 24 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.193447:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f5180 00000100:00100000:1.0:1746147190.194303:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1566 00000100:00100000:1.0:1746147190.194311:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463828096:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147190.196640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.196959:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828224 00000100:00100000:3.0:1746147190.196966:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828224 00000100:00100000:3.0:1746147190.197009:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11856 00000100:00100000:3.0:1746147190.197015:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:29028:x1830967463828224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.197027:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.197041:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f1b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.197061:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147190.197066:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.197075:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147190.197079:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.197107:0:8478:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.197119:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 32 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.197128:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7600, rc 0) 00000100:00100000:3.0:1746147190.197157:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+32:29028:x1830967463828224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 143us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.197163:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11856 00000100:00100000:1.0:1746147190.197696:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463828096:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 3384us (5188us total) trans 21474840648 rc 0/0 00000100:00100000:1.0:1746147190.197705:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1566 00002000:00100000:1.0:1746147190.197712:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3309568->3534847) req@ffff8800929f5180 x1830967463828096/t21474840648(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.197724:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f5180 with x1830967463828096 ext(3309568->3534847) 00010000:00010000:1.0:1746147190.197730:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.197739:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.197744:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f5180 00000100:00100000:0.0:1746147190.202343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.202438:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828352 00000100:00100000:2.0:1746147190.202446:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828352 00010000:00010000:2.0:1746147190.202475:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.202551:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5885 00000100:00100000:2.0:1746147190.202558:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463828352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.202573:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.202601:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.202611:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.202631:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7143 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3309568->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6edc expref: 26 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.202658:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.202660:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.202666:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.202673:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.202701:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.202712:0:8494:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 31 pid: 4444 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.202721:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466434816:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.203397:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.206257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.206353:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466434816:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.206369:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.206406:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463828352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3849us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.206414:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5885 00000100:00100000:1.0:1746147190.206495:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828608 00000100:00100000:1.0:1746147190.206500:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828608 00002000:00100000:1.0:1746147190.206528:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2383872->2387967) req@ffff88009b6b8e00 x1830967463828608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.206538:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8e00 with x1830967463828608 ext(2383872->2387967) 00010000:00010000:1.0:1746147190.206544:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.206555:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.206562:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8e00 00000100:00100000:1.0:1746147190.206597:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1567 00000100:00100000:1.0:1746147190.206604:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463828608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.206738:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463828608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 134us (490us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147190.206743:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1567 00002000:00100000:1.0:1746147190.206749:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2383872->2387967) req@ffff88009b6b8e00 x1830967463828608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.206755:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8e00 with x1830967463828608 ext(2383872->2387967) 00010000:00010000:1.0:1746147190.206760:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.206769:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.206775:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b8e00 00000100:00100000:0.0:1746147190.214103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.214149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.214277:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828864 00000100:00100000:1.0:1746147190.214285:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828864 00002000:00100000:1.0:1746147190.214319:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2383872->3145727) req@ffff88009b6ba680 x1830967463828864/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.214328:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6ba680 with x1830967463828864 ext(2383872->3145727) 00010000:00010000:1.0:1746147190.214335:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.214342:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463828992 00000100:00100000:2.0:1746147190.214346:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463828992 00010000:00010000:1.0:1746147190.214347:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 32 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.214353:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6ba680 00000100:00100000:2.0:1746147190.214798:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11857 00000100:00100000:1.0:1746147190.214798:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1568 00000100:00100000:2.0:1746147190.214806:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:29024:x1830967463828992:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147190.214806:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463828864:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147190.214817:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.214830:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f22 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.214848:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.214854:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.214856:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.214859:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.214882:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.214891:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 22 pid: 4444 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.214901:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466434944:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.214984:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.219367:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466434944:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.219392:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 40 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.219407:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae000, rc 0) 00000100:00100000:3.0:1746147190.219459:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:29024:x1830967463828992:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4654us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.219467:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11857 00000100:00100000:1.0:1746147190.223931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.224246:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463829120 00000100:00100000:3.0:1746147190.224254:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463829120 00002000:00100000:3.0:1746147190.224287:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3043328->3047423) req@ffff880090509500 x1830967463829120/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 4584/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.224296:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967463829120 ext(3043328->3047423) 00010000:00010000:3.0:1746147190.224303:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 23 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.224314:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 23 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.224320:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090509500 00000100:00100000:3.0:1746147190.224350:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1569 00000100:00100000:3.0:1746147190.224356:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463829120:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147190.224699:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463829120:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 342us (773us total) trans 17179873240 rc 0/0 00000100:00100000:3.0:1746147190.224706:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1569 00002000:00100000:3.0:1746147190.224712:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3043328->3047423) req@ffff880090509500 x1830967463829120/t17179873240(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 4584/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.224719:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509500 with x1830967463829120 ext(3043328->3047423) 00010000:00010000:3.0:1746147190.224724:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.224733:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.224738:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090509500 00000100:00100000:2.0:1746147190.226195:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463828864:12345-192.168.203.36@tcp:4:cat.0 Request processed in 11386us (12096us total) trans 21474840649 rc 0/0 00000100:00100000:2.0:1746147190.226202:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1568 00002000:00100000:2.0:1746147190.226209:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2383872->3145727) req@ffff88009b6ba680 x1830967463828864/t21474840649(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.226217:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6ba680 with x1830967463828864 ext(2383872->3145727) 00010000:00010000:2.0:1746147190.226223:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.226233:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00002000:00010000:2.0:1746147190.226240:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6ba680 00000100:00100000:0.0:1746147190.227728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.227826:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463829248 00000100:00100000:2.0:1746147190.227833:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463829248 00010000:00010000:2.0:1746147190.227857:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.227976:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5886 00000100:00100000:2.0:1746147190.227983:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463829248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.227996:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.228011:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.228020:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.228038:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac7166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3047423) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eff expref: 25 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.228062:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.228064:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.228070:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.228076:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.228104:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.228211:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466435072:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.228275:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.229373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.229515:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463829376 00000100:00100000:1.0:1746147190.229520:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463829376 00010000:00010000:1.0:1746147190.229540:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.229569:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5887 00000100:00100000:1.0:1746147190.229574:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463829376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.229592:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147190.229605:0:7120:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147189 -> 1746147190 00002000:00010000:1.0:1746147190.229607:0:7120:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147189 -> 1746147190 00010000:00010000:1.0:1746147190.229611:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.229619:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.229633:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0xb4b2209fbdac716d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f06 expref: 34 pid: 4444 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.229652:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.229653:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.229657:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.229663:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.229681:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 33 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.229689:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466435200:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147190.229829:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.229892:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466435072:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.229905:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.230337:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463829248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2353us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.230343:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5886 00000100:00100000:1.0:1746147190.231350:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466435200:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147190.231365:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147190.231389:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463829376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1814us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.231395:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5887 00000100:00100000:0.0:1746147190.231986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.232100:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463829632 00000100:00100000:2.0:1746147190.232106:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463829632 00002000:00100000:2.0:1746147190.232135:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2183168->2187263) req@ffff88009b6bb480 x1830967463829632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.232150:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967463829632 ext(2183168->2187263) 00002000:00010000:2.0:1746147190.232154:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:2.0:1746147190.233260:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4581 00000100:00100000:2.0:1746147190.233269:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463829632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.233400:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463829632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 133us (1415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147190.233406:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4581 00002000:00100000:2.0:1746147190.233411:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2183168->2187263) req@ffff88009b6bb480 x1830967463829632/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.233418:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bb480 with x1830967463829632 ext(2183168->2187263) 00002000:00010000:2.0:1746147190.233421:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6bb480 00000100:00100000:0.0:1746147190.233543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.233591:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463829888 00000100:00100000:2.0:1746147190.233595:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463829888 00002000:00100000:2.0:1746147190.233614:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b6b8700 x1830967463829888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.233622:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8700 with x1830967463829888 ext(2097152->3145727) 00002000:00010000:2.0:1746147190.233625:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b8700 00000100:00100000:2.0:1746147190.233641:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4582 00000100:00100000:2.0:1746147190.233647:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463829888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.241524:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463829888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7869us (7973us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.241535:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4582 00002000:00100000:2.0:1746147190.241545:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b6b8700 x1830967463829888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.241553:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8700 with x1830967463829888 ext(2097152->3145727) 00002000:00010000:2.0:1746147190.241558:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b8700 00000100:00100000:0.0:1746147190.245557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.247042:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463830144 00000100:00100000:0.0:1746147190.247050:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463830144 00002000:00100000:0.0:1746147190.247086:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2187264->3145727) req@ffff88009b6b8a80 x1830967463830144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147190.247094:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8a80 with x1830967463830144 ext(2187264->3145727) 00002000:00010000:0.0:1746147190.247098:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b8a80 00000100:00100000:1.0:1746147190.247114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.247121:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463830400 00000100:00100000:0.0:1746147190.247123:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463830400 00002000:00100000:0.0:1746147190.247133:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009050a680 x1830967463830400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147190.247136:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4583 00002000:00100000:0.0:1746147190.247138:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050a680 with x1830967463830400 ext(3145728->4194303) 00002000:00010000:0.0:1746147190.247141:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050a680 00000100:00100000:1.0:1746147190.247143:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463830144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147190.247149:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4584 00000100:00100000:3.0:1746147190.247158:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463830400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.248332:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.248378:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463830656 00000100:00100000:1.0:1746147190.248382:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463830656 00002000:00100000:1.0:1746147190.248402:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012eceea00 x1830967463830656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.248409:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967463830656 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.248411:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eceea00 00000100:00100000:1.0:1746147190.248422:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4585 00000100:00100000:1.0:1746147190.248427:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463830656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147190.259383:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463830400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12220us (12269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.259393:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4584 00002000:00100000:3.0:1746147190.259403:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009050a680 x1830967463830400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.259411:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050a680 with x1830967463830400 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.259416:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009050a680 00000100:00100000:2.0:1746147190.260918:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463830144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13772us (15363us total) trans 0 rc 958464/958464 00000100:00100000:2.0:1746147190.260925:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4583 00002000:00100000:2.0:1746147190.260932:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2187264->3145727) req@ffff88009b6b8a80 x1830967463830144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.260962:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b8a80 with x1830967463830144 ext(2187264->3145727) 00002000:00010000:2.0:1746147190.260966:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b6b8a80 00000100:00100000:1.0:1746147190.262774:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463830656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14342us (14438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.262786:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4585 00002000:00100000:1.0:1746147190.262793:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012eceea00 x1830967463830656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.262801:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceea00 with x1830967463830656 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.262805:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eceea00 00000100:00100000:0.0:1746147190.270437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.270850:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463830912 00000100:00100000:1.0:1746147190.270857:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463830912 00002000:00100000:1.0:1746147190.270894:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009b6bbb80 x1830967463830912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.270903:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967463830912 ext(4194304->4927487) 00002000:00010000:1.0:1746147190.270908:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00000100:00100000:2.0:1746147190.271133:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4586 00000100:00100000:2.0:1746147190.271143:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463830912:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.276803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.276892:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831040 00000100:00100000:3.0:1746147190.276899:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831040 00000100:00100000:3.0:1746147190.276954:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10545 00000100:00100000:3.0:1746147190.276962:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+26:29033:x1830967463831040:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.276983:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.276996:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f29 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.277042:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.277051:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147190.277070:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463830912:12345-192.168.203.36@tcp:3:cat.0 Request processed in 5928us (6639us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147190.277079:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4586 00002000:00100000:2.0:1746147190.277087:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009b6bbb80 x1830967463830912/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.277096:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6bbb80 with x1830967463830912 ext(4194304->4927487) 00002000:00010000:2.0:1746147190.277100:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6bbb80 00010000:00010000:3.0:1746147190.277994:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278013:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278019:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278025:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278114:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278125:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.278132:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 42 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.278137:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.278162:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 42 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.278171:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 42 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.278181:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435328:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.279871:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 329 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.279883:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 329 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.279892:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.280795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.280872:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831296 00000100:00100000:2.0:1746147190.280879:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831296 00000100:00100000:2.0:1746147190.280917:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4185 00000100:00100000:2.0:1746147190.280923:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+43:27397:x1830967463831296:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147190.281080:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+44:27397:x1830967463831296:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 156us (286us total) trans 8589944299 rc 0/0 00000100:00100000:2.0:1746147190.281087:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4185 00000100:00080000:0.0:1746147190.281270:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147190.282731:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.282757:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435328:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147190.282794:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435456:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.282818:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147190.283800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.284028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.284104:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831680 00000100:00100000:2.0:1746147190.284110:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831680 00000100:00100000:2.0:1746147190.284146:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4186 00000100:00100000:2.0:1746147190.284152:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:27397:x1830967463831680:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147190.284268:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831424 00000100:00100000:1.0:1746147190.284273:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831424 00010000:00010000:1.0:1746147190.284290:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 44 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.284310:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5888 00000100:00100000:1.0:1746147190.284315:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1956:x1830967463831424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.284322:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147190.284327:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 44 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.284336:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 44 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.284341:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+331:27397:x1830967463831680:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 187us (542us total) trans 8589944300 rc 0/0 00000100:00100000:2.0:1746147190.284347:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4186 00010000:00010000:1.0:1746147190.284352:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4afc00/0xb4b2209fbdac7135 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ece expref: 44 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.284369:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.284374:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.284381:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.284386:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.284390:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147190.284406:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+43:1956:x1830967463831424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.284412:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5888 00000100:00080000:0.0:1746147190.284641:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147190.289568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.289904:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831808 00000100:00100000:1.0:1746147190.289912:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831808 00010000:00010000:1.0:1746147190.289969:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 331 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.289994:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5889 00000100:00100000:1.0:1746147190.290001:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+331:1957:x1830967463831808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.290012:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147190.290017:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 331 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.290026:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 331 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.290047:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac70f6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ea4 expref: 331 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.290061:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.290065:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.290072:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.290078:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.290110:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147190.290133:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290144:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147190.290145:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+330:1957:x1830967463831808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 144us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.290151:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5889 00000004:00200000:3.0:1746147190.290179:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:3.0:1746147190.290183:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147190.290195:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290204:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290211:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290217:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290222:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290226:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9e7c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147190.290230:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290239:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290247:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147190.290249:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147190.290251:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290255:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac7197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290275:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290280:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290285:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290288:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9e7e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147190.290290:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290294:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290300:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13b00) 00010000:00010000:3.0:1746147190.290302:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147190.290304:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290309:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac719e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.290337:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.290349:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.290355:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.290357:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147190.290359:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7400, rc 0) 00000100:00100000:3.0:1746147190.290407:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+27:29033:x1830967463831040:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 13445us (13609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.290413:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10545 00000100:00100000:0.0:1746147190.294443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.294483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.294521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.294564:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463831936 00000100:00100000:2.0:1746147190.294572:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463831936 00000100:00100000:2.0:1746147190.294627:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832064 00000100:00100000:2.0:1746147190.294629:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832064 00000100:00100000:2.0:1746147190.294651:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832192 00000100:00100000:2.0:1746147190.294653:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832192 00000100:00100000:2.0:1746147190.294666:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11858 00000100:00100000:2.0:1746147190.294672:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463831936:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147190.294686:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.294700:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f30 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.294718:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294720:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294727:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294745:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294754:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49a00, rc 0) 00000100:00100000:2.0:1746147190.294790:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463831936:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.294796:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11858 00000100:00100000:2.0:1746147190.294809:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11859 00000100:00100000:2.0:1746147190.294814:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463832064:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147190.294820:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.294830:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f37 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.294840:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294841:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294846:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294854:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294861:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49400, rc 0) 00000100:00100000:2.0:1746147190.294876:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463832064:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 62us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.294881:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11859 00000100:00100000:2.0:1746147190.294889:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11860 00000100:00100000:2.0:1746147190.294894:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463832192:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147190.294898:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.294904:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f3e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.294912:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294914:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.294917:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294924:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.294931:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49600, rc 0) 00000100:00100000:2.0:1746147190.294969:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463832192:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 74us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.294973:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11860 00000100:00100000:2.0:1746147190.295294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.295314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.295361:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832320 00000100:00100000:3.0:1746147190.295365:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832320 00000100:00100000:3.0:1746147190.295386:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832448 00000100:00100000:3.0:1746147190.295387:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832448 00000100:00100000:3.0:1746147190.295396:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11861 00000100:00100000:3.0:1746147190.295400:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463832320:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.295406:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.295412:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f45 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.295420:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.295421:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.295425:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.295432:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.295438:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e6a00, rc 0) 00000100:00100000:3.0:1746147190.295454:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463832320:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.295458:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11861 00000100:00100000:3.0:1746147190.295466:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11862 00000100:00100000:3.0:1746147190.295470:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463832448:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.295474:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.295479:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7200/0xb4b2209fbdac71c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f4c expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.295504:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466435584:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147190.295543:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00002000:00010000:3.0:1746147190.298260:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147189 -> 1746147190 00002000:00010000:3.0:1746147190.298266:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147189 -> 1746147190 00002000:00010000:3.0:1746147190.298268:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147189 -> 1746147190 00000100:00100000:3.0:1746147190.298287:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466435584:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.298317:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7200/0xb4b2209fbdac71c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f4c expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.298329:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7200/0xb4b2209fbdac71c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f4c expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.298353:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7200, rc 0) 00000100:00100000:3.0:1746147190.300064:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463832448:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4587us (4742us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147190.300073:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11862 00000100:00100000:0.0:1746147190.304746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.304826:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832704 00000100:00100000:3.0:1746147190.304833:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832704 00000100:00100000:3.0:1746147190.304870:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10546 00000100:00100000:3.0:1746147190.304877:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+27:29033:x1830967463832704:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.304891:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.304905:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7000/0xb4b2209fbdac71cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f53 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.305000:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.305013:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.305019:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.305044:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.305052:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 28 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.305061:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435712:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147190.305501:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.306916:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435712:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.306966:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147190.307547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.307633:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463832832 00000100:00100000:2.0:1746147190.307639:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463832832 00010000:00010000:2.0:1746147190.307662:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 29 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.307696:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5890 00000100:00100000:2.0:1746147190.307703:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+29:1958:x1830967463832832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.307718:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.307723:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 29 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.307733:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 29 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.307749:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7400/0xb4b2209fbdac71a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f29 expref: 29 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.307775:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147190.307779:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.307787:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.307793:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.307817:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.307848:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+28:1958:x1830967463832832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.307854:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5890 00010000:00010000:3.0:1746147190.308043:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.308049:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147190.308065:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147190.308170:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7000/0xb4b2209fbdac71cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f53 expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.308182:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f53 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.308187:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.308190:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147190.308192:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e6e00, rc 0) 00000100:00100000:3.0:1746147190.308229:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+28:29033:x1830967463832704:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3352us (3489us total) trans 8589944301 rc 0/0 00000100:00100000:3.0:1746147190.308235:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10546 00000100:00100000:2.0:1746147190.314025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.314110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.318255:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833088 00000100:00100000:3.0:1746147190.318264:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833088 00000100:00100000:3.0:1746147190.318301:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833344 00000100:00100000:3.0:1746147190.318303:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833344 00000100:00100000:3.0:1746147190.318319:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10547 00000100:00100000:3.0:1746147190.318326:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+43:29036:x1830967463833088:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147190.318344:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.318358:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6600/0xb4b2209fbdac71e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f5a expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318437:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.318448:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.318457:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147190.318465:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147190.318549:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6600/0xb4b2209fbdac71e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 46 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318560:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 45 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318567:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.318569:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147190.318571:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e6400, rc 0) 00000100:00100000:3.0:1746147190.318629:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+45:29036:x1830967463833088:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 303us (4611us total) trans 8589944302 rc 0/0 00000100:00100000:3.0:1746147190.318635:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10547 00000100:00100000:3.0:1746147190.318647:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10548 00000100:00100000:3.0:1746147190.318652:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+28:29033:x1830967463833344:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.318662:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.318664:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147190.318673:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6e00/0xb4b2209fbdac71d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f53 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318686:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.318688:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147190.318692:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6c00/0xb4b2209fbdac71f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f61 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318719:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.318726:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 44 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318730:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.318752:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 44 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.318760:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 44 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.318770:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435840:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147190.318816:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.321621:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466435840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.321798:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147190.332772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.332863:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833472 00000100:00100000:1.0:1746147190.332870:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833472 00010000:00010000:1.0:1746147190.332898:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 45 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.333088:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5891 00000100:00100000:1.0:1746147190.333096:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+45:1957:x1830967463833472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.333109:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147190.333115:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 45 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.333129:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 45 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.333145:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6400/0xb4b2209fbdac71eb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f5a expref: 45 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.333355:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.333360:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.333368:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.333373:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.333406:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147190.333571:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333590:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333604:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333609:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333614:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333618:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9e6200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147190.333621:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333627:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333634:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.333636:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147190.333638:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.333641:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6200/0xb4b2209fbdac7200 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147190.333805:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+44:1957:x1830967463833472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 709us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.333899:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5891 00010000:00010000:3.0:1746147190.334005:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6c00/0xb4b2209fbdac71f9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f61 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.334012:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e6c00/0xb4b2209fbdac71f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f61 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.334023:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e6c00, rc 0) 00000100:00100000:3.0:1746147190.334048:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+27:29033:x1830967463833344:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 15395us (19938us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147190.334054:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10548 00000100:00100000:1.0:1746147190.336174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.336210:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833600 00000100:00100000:3.0:1746147190.336216:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833600 00000100:00100000:3.0:1746147190.336254:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11863 00000100:00100000:1.0:1746147190.336255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.336260:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463833600:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147190.336268:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833728 00000100:00100000:1.0:1746147190.336270:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833728 00010000:00010000:3.0:1746147190.336272:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.336284:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f68 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.336286:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11864 00000100:00100000:1.0:1746147190.336290:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463833728:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.336295:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.336302:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.336303:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac720e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f6f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.336304:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.336311:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.336322:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.336329:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e6000, rc 0) 00000100:00100000:1.0:1746147190.336331:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466435968:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147190.336383:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.336469:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463833600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 208us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.336475:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11863 00000100:00100000:1.0:1746147190.336772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.336864:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463833984 00000100:00100000:2.0:1746147190.336868:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463833984 00000100:00100000:2.0:1746147190.336900:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4187 00000100:00100000:2.0:1746147190.336906:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+27:29033:x1830967463833984:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147190.337070:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+28:29033:x1830967463833984:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 163us (297us total) trans 8589944303 rc 0/0 00000100:00100000:2.0:1746147190.337076:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4187 00000100:00100000:1.0:1746147190.338142:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466435968:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.338166:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac720e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f6f expref: 25 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.338176:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f200/0xb4b2209fbdac720e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f6f expref: 25 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.338187:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f200, rc 0) 00000100:00100000:1.0:1746147190.338226:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463833728:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1934us (1969us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.338231:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11864 00000100:00100000:0.0:1746147190.361556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.361653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.361708:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463834240 00000100:00100000:2.0:1746147190.361716:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463834240 00002000:00100000:2.0:1746147190.361750:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800936dc700 x1830967463834240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.361759:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830967463834240 ext(2097152->3145727) 00002000:00010000:2.0:1746147190.361763:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:2.0:1746147190.361784:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4587 00000100:00100000:2.0:1746147190.361792:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463834240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.362480:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463834368 00000100:00100000:1.0:1746147190.362485:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463834368 00000100:00100000:1.0:1746147190.362522:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11865 00000100:00100000:1.0:1746147190.362528:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29036:x1830967463834368:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147190.362539:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.362552:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f76 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.362572:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.362594:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.362600:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 32 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.362606:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.362608:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.362611:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [126976->618495] (req 126976->618495) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.362638:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 32 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.362648:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 32 pid: 8478 timeout: 677 lvb_type: 1 00000100:00100000:1.0:1746147190.362658:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436096:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.362730:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.362736:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 12 pid: 8478 timeout: 677 lvb_type: 1 00000100:00100000:1.0:1746147190.362743:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436224:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.362763:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 29 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.362769:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 29 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.362776:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436352:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.362787:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.367742:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436096:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.367753:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436224:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.367761:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436352:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.367790:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [126976->618495] (req 126976->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.367805:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ea00, rc 0) 00000100:00100000:1.0:1746147190.367857:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29036:x1830967463834368:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5328us (6203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.367865:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11865 00000100:00100000:0.0:1746147190.371528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.372099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.372131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.373116:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463834624 00000100:00100000:2.0:1746147190.373126:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463834624 00010000:00010000:2.0:1746147190.373160:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 33 pid: 8478 timeout: 677 lvb_type: 1 00000100:00100000:2.0:1746147190.373186:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463834496 00000100:00100000:2.0:1746147190.373188:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463834496 00010000:00010000:2.0:1746147190.373199:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 13 pid: 8478 timeout: 677 lvb_type: 1 00000100:00100000:2.0:1746147190.373212:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463834752 00000100:00100000:2.0:1746147190.373214:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463834752 00010000:00010000:2.0:1746147190.373223:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 29 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.373236:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5892 00000100:00100000:2.0:1746147190.373243:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463834624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.373253:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.373270:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 33 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373279:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 33 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373297:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e811400/0xb4b2209fbdac7158 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ef1 expref: 33 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373313:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.373354:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463834624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 111us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.373360:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5892 00000100:00100000:2.0:1746147190.373373:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5893 00000100:00100000:2.0:1746147190.373378:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463834496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.373384:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.373391:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 13 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373398:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 13 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373408:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac71ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f30 expref: 13 pid: 8478 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.373419:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.373427:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463834240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11637us (11878us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.373434:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463834496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.373435:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4587 00000100:00100000:2.0:1746147190.373439:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5893 00002000:00100000:0.0:1746147190.373443:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800936dc700 x1830967463834240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147190.373448:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5894 00002000:00100000:0.0:1746147190.373450:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830967463834240 ext(2097152->3145727) 00000100:00100000:2.0:1746147190.373453:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463834752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1746147190.373455:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dc700 00010000:00010000:2.0:1746147190.373458:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.373463:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 27 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.373471:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 27 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.373480:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e18400/0xb4b2209fbdac7151 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6eea expref: 27 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.373491:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.373492:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.373498:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.373505:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.373530:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.373542:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466436480:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.373613:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.379222:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466436480:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.379251:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.379423:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463834752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5966us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.379435:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5894 00000100:00100000:0.0:1746147190.379512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.379607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.379633:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835136 00000100:00100000:1.0:1746147190.379641:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835136 00000100:00100000:2.0:1746147190.379669:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835008 00000100:00100000:2.0:1746147190.379672:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835008 00002000:00100000:2.0:1746147190.379702:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (126976->131071) req@ffff8800936dca80 x1830967463835008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.379711:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967463835008 ext(126976->131071) 00002000:00010000:2.0:1746147190.379716:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:2.0:1746147190.379728:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4588 00000100:00100000:2.0:1746147190.379899:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463835008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147190.380141:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463835008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 405us (630us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147190.380146:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4588 00002000:00100000:2.0:1746147190.380151:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (126976->131071) req@ffff8800936dca80 x1830967463835008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.380190:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830967463835008 ext(126976->131071) 00002000:00010000:2.0:1746147190.380193:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:1.0:1746147190.380208:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11866 00000100:00100000:1.0:1746147190.380215:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29039:x1830967463835136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.380225:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.380288:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f7d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.380318:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.380326:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147190.380328:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147190.380332:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.380361:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.380373:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 39 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.380386:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466436608:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.380447:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.382519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.382727:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466436608:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.382750:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.382762:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:1.0:1746147190.382796:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29039:x1830967463835136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2581us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.382802:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11866 00000100:00100000:2.0:1746147190.382889:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835264 00000100:00100000:2.0:1746147190.382894:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835264 00002000:00100000:2.0:1746147190.382924:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2187263) req@ffff8800936ddc00 x1830967463835264/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.382932:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830967463835264 ext(2097152->2187263) 00010000:00010000:2.0:1746147190.382956:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.382967:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 40 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:2.0:1746147190.382972:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddc00 00000100:00100000:2.0:1746147190.382986:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1570 00000100:00100000:2.0:1746147190.382991:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463835264:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147190.387738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.387835:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835520 00000100:00100000:1.0:1746147190.387848:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835520 00002000:00100000:1.0:1746147190.387901:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (614400->618495) req@ffff8800936df100 x1830967463835520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.387917:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967463835520 ext(614400->618495) 00002000:00010000:1.0:1746147190.387924:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:1.0:1746147190.388302:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4589 00000100:00100000:1.0:1746147190.388310:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463835520:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147190.388515:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463835264:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5522us (5998us total) trans 17179873241 rc 0/0 00000100:00100000:3.0:1746147190.388527:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1570 00002000:00100000:3.0:1746147190.388533:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2187263) req@ffff8800936ddc00 x1830967463835264/t17179873241(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.388540:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830967463835264 ext(2097152->2187263) 00010000:00010000:3.0:1746147190.388548:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.388647:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.388658:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddc00 00000100:00100000:1.0:1746147190.389117:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463835520:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 805us (1381us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147190.389126:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4589 00002000:00100000:1.0:1746147190.389134:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (614400->618495) req@ffff8800936df100 x1830967463835520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.389141:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df100 with x1830967463835520 ext(614400->618495) 00002000:00010000:1.0:1746147190.389145:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df100 00000100:00100000:0.0:1746147190.394926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.395164:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835648 00000100:00100000:2.0:1746147190.395171:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835648 00010000:00010000:2.0:1746147190.395274:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.395399:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5895 00000100:00100000:2.0:1746147190.395407:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967463835648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.395419:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.395438:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.395449:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.395468:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae000/0xb4b2209fbdac7189 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f22 expref: 42 pid: 6881 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.395490:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.395492:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.395497:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.395504:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.395531:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.395541:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466436736:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.395621:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.395873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.395967:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463835904 00000100:00100000:3.0:1746147190.395972:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463835904 00000100:00100000:3.0:1746147190.396005:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4188 00000100:00100000:3.0:1746147190.396010:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+44:29036:x1830967463835904:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147190.396178:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+45:29036:x1830967463835904:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 167us (305us total) trans 8589944304 rc 0/0 00000100:00100000:3.0:1746147190.396188:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4188 00000100:00100000:3.0:1746147190.398183:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466436736:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.398205:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.398251:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1959:x1830967463835648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2844us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.398259:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5895 00000100:00100000:0.0:1746147190.403441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.403501:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463836160 00000100:00100000:1.0:1746147190.403509:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463836160 00002000:00100000:1.0:1746147190.403546:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800936de300 x1830967463836160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.403554:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830967463836160 ext(2097152->3145727) 00002000:00010000:1.0:1746147190.403559:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936de300 00000100:00100000:1.0:1746147190.403593:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4590 00000100:00100000:1.0:1746147190.403601:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463836160:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147190.403729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.403758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.403801:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463836416 00000100:00100000:3.0:1746147190.403806:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463836416 00002000:00100000:3.0:1746147190.403822:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800936dea00 x1830967463836416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.403829:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dea00 with x1830967463836416 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.403831:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dea00 00000100:00100000:3.0:1746147190.403841:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463836672 00000100:00100000:3.0:1746147190.403843:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463836672 00002000:00100000:3.0:1746147190.403853:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800936dd500 x1830967463836672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.403859:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd500 with x1830967463836672 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.403861:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd500 00000100:00100000:3.0:1746147190.403878:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4591 00000100:00100000:3.0:1746147190.403883:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463836416:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147190.403893:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4592 00000100:00100000:1.0:1746147190.403900:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463836672:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147190.419996:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463836672:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16088us (16228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.420005:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4592 00002000:00100000:1.0:1746147190.420014:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800936dd500 x1830967463836672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.420022:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd500 with x1830967463836672 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.420027:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd500 00000100:00100000:3.0:1746147190.420100:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463836416:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 16215us (16371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.420106:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4591 00002000:00100000:3.0:1746147190.420111:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800936dea00 x1830967463836416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.420117:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dea00 with x1830967463836416 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.420121:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dea00 00000100:00100000:1.0:1746147190.423078:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463836160:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 19469us (19635us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.423090:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4590 00002000:00100000:1.0:1746147190.423101:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800936de300 x1830967463836160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.423110:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830967463836160 ext(2097152->3145727) 00002000:00010000:1.0:1746147190.423115:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936de300 00000100:00100000:0.0:1746147190.430124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.430185:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463836928 00000100:00100000:1.0:1746147190.430194:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463836928 00002000:00100000:1.0:1746147190.430231:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009e682300 x1830967463836928/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.430240:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967463836928 ext(4194304->4927487) 00002000:00010000:1.0:1746147190.430244:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:1.0:1746147190.430273:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4593 00000100:00100000:1.0:1746147190.430280:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463836928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147190.440837:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463836928:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10550us (10712us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746147190.440847:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4593 00002000:00100000:1.0:1746147190.440857:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88009e682300 x1830967463836928/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 733184/733184 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.440866:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967463836928 ext(4194304->4927487) 00002000:00010000:1.0:1746147190.440872:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:0.0:1746147190.461696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.462043:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837184 00000100:00100000:3.0:1746147190.462050:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837184 00000100:00100000:3.0:1746147190.462089:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10549 00000100:00100000:3.0:1746147190.462096:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+330:29044:x1830967463837184:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147190.462116:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.462131:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f84 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.462206:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.462217:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147190.462226:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147190.462235:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:3.0:1746147190.465673:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 333 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.465713:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 332 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.465721:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147190.465723:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147190.465726:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7e00, rc 0) 00000100:00100000:3.0:1746147190.465797:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+332:29044:x1830967463837184:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3700us (4107us total) trans 8589944305 rc 0/0 00000100:00100000:3.0:1746147190.465807:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10549 00000100:00100000:0.0:1746147190.512419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.512977:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837312 00000100:00100000:1.0:1746147190.512984:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837312 00000100:00100000:1.0:1746147190.513037:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11867 00000100:00100000:1.0:1746147190.513047:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463837312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.513063:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.513078:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7546000/0xb4b2209fbdac7238 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f8b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.513123:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436864:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147190.513527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.513638:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.513683:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837440 00000100:00100000:3.0:1746147190.513687:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837440 00000100:00100000:3.0:1746147190.513715:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11868 00000100:00100000:3.0:1746147190.513721:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967463837440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.513728:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.513737:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f92 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.513748:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.513750:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.513757:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.513768:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 42 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.513776:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7c00, rc 0) 00000100:00100000:3.0:1746147190.513808:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463837440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.513816:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11868 00002000:00010000:1.0:1746147190.516309:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147189 -> 1746147190 00002000:00010000:1.0:1746147190.516316:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147189 -> 1746147190 00002000:00010000:1.0:1746147190.516317:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147189 -> 1746147190 00000100:00100000:1.0:1746147190.516337:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436864:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.516366:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7546000/0xb4b2209fbdac7238 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f8b expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.516378:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7546000/0xb4b2209fbdac7238 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f8b expref: 33 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.516448:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7546000, rc 0) 00000100:00100000:1.0:1746147190.516498:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463837312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3454us (4085us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.516505:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11867 00000100:00100000:0.0:1746147190.519680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.519861:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837568 00000100:00100000:1.0:1746147190.519868:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837568 00000100:00100000:1.0:1746147190.519972:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11869 00000100:00100000:1.0:1746147190.519981:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:29048:x1830967463837568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.519994:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.520009:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6f99 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.520035:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.520042:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147190.520044:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147190.520047:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 33 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.520073:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.520083:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 25 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.520099:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436992:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.520182:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.523199:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466436992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.523226:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 33 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.523241:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d50d600, rc 0) 00000100:00100000:1.0:1746147190.523275:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+33:29048:x1830967463837568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3295us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.523282:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11869 00000100:00100000:0.0:1746147190.533271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.536315:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837696 00000100:00100000:1.0:1746147190.536325:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837696 00002000:00100000:1.0:1746147190.536365:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (126976->618495) req@ffff88009e681c00 x1830967463837696/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.536374:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463837696 ext(126976->618495) 00010000:00010000:1.0:1746147190.536382:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 26 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.536395:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 26 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.536401:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e681c00 00000100:00100000:1.0:1746147190.536436:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1571 00000100:00100000:1.0:1746147190.536443:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463837696:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147190.544213:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463837696:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7763us (10941us total) trans 21474840650 rc 0/0 00000100:00100000:1.0:1746147190.544222:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1571 00002000:00100000:1.0:1746147190.544233:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (126976->618495) req@ffff88009e681c00 x1830967463837696/t21474840650(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.544240:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463837696 ext(126976->618495) 00010000:00010000:1.0:1746147190.544253:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.544266:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.544272:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e681c00 00000100:00100000:0.0:1746147190.547781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.548474:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463837824 00000100:00100000:3.0:1746147190.548481:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463837824 00010000:00010000:3.0:1746147190.548508:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.548529:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5896 00000100:00100000:3.0:1746147190.548535:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463837824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.548544:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.548558:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.548568:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.548599:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac7215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->618495) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f76 expref: 28 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.548617:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.548619:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.548624:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.548630:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.548654:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.548662:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466437120:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147190.548725:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.550063:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466437120:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.550080:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.550106:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463837824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1570us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.550113:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5896 00000100:00100000:0.0:1746147190.554407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.564393:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838080 00000100:00100000:1.0:1746147190.564402:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838080 00002000:00100000:1.0:1746147190.564443:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009e682a00 x1830967463838080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.564453:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682a00 with x1830967463838080 ext(0->1048575) 00002000:00010000:1.0:1746147190.564457:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682a00 00000100:00100000:1.0:1746147190.564486:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4594 00000100:00100000:1.0:1746147190.564492:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463838080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.575602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.575661:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838208 00000100:00100000:1.0:1746147190.575668:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838208 00000100:00100000:1.0:1746147190.575709:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11870 00000100:00100000:1.0:1746147190.575716:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29044:x1830967463838208:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147190.575733:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.575747:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fa0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.575773:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.575782:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.575789:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.575795:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.575796:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.575799:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 36 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.575830:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 11 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.575839:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 11 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:1.0:1746147190.575848:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437248:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.576491:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 26 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.576505:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 26 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:1.0:1746147190.576517:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437376:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.576567:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 36 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.576583:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 35 pid: 8478 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.576591:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437504:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.576607:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463838080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12114us (22205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.576610:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.576615:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4594 00002000:00100000:2.0:1746147190.576623:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009e682a00 x1830967463838080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.576631:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682a00 with x1830967463838080 ext(0->1048575) 00002000:00010000:2.0:1746147190.577716:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e682a00 00000100:00100000:0.0:1746147190.583642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.583673:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437248:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.583674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.583683:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437376:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.583691:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437504:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.583694:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838336 00000100:00100000:0.0:1746147190.583699:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838336 00010000:00010000:1.0:1746147190.583719:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.583725:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 12 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:0.0:1746147190.583745:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838464 00000100:00100000:0.0:1746147190.583747:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838464 00010000:00010000:0.0:1746147190.583757:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 27 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:0.0:1746147190.583771:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5897 00000100:00100000:0.0:1746147190.583781:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463838336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.583793:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.583810:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 12 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:0.0:1746147190.583819:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 12 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:0.0:1746147190.583840:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6a00/0xb4b2209fbdac71c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f45 expref: 12 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:0.0:1746147190.583867:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147190.583875:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678c00, rc 0) 00000100:00100000:2.0:1746147190.584125:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5898 00000100:00100000:2.0:1746147190.584132:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463838464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.584140:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.584149:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 27 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.584157:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 27 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.584168:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e6000/0xb4b2209fbdac7207 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f68 expref: 27 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.584180:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.584271:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463838336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 494us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.584272:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:29044:x1830967463838208:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8555us (8676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.584277:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5897 00000100:00100000:1.0:1746147190.584279:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11870 00000100:00100000:2.0:1746147190.584283:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463838464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 151us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.584289:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5898 00000100:00100000:0.0:1746147190.584307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.584318:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838592 00000100:00100000:0.0:1746147190.584321:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838592 00010000:00010000:0.0:1746147190.584331:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 34 pid: 8478 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.584353:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5899 00000100:00100000:0.0:1746147190.584358:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463838592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.584364:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147190.584370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147190.584372:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 34 pid: 8478 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.584379:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 34 pid: 8478 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.584391:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7600/0xb4b2209fbdac7182 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f1b expref: 34 pid: 8478 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.584397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147190.584402:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.584403:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.584409:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 33 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.584413:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838720 00010000:00010000:0.0:1746147190.584415:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 33 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.584416:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838720 00000100:00100000:1.0:1746147190.584416:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463838848 00000100:00100000:1.0:1746147190.584419:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463838848 00000100:00100000:3.0:1746147190.584435:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11871 00010000:00010000:0.0:1746147190.584437:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 33 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.584440:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463838720:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147190.584440:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11872 00000100:00100000:1.0:1746147190.584445:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463838848:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147190.584446:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466437632:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.584463:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.584472:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fa7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.584475:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.584482:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d72c800/0xb4b2209fbdac725b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fae expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.584483:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.584485:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.584489:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147190.584494:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1ab180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147190.584499:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147190.584505:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437760:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.584506:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9e7a00, rc 0) 00000100:00100000:3.0:1746147190.584522:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463838720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.584527:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11871 00000100:00100000:1.0:1746147190.584532:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00002000:00010000:1.0:1746147190.587370:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147189 -> 1746147190 00000100:00100000:0.0:1746147190.587382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.587390:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466437760:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.587412:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d72c800/0xb4b2209fbdac725b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fae expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.587421:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d72c800/0xb4b2209fbdac725b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fae expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.587429:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d72c800, rc 0) 00000100:00100000:1.0:1746147190.587455:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463838848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3010us (3057us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.587459:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11872 00000100:00100000:2.0:1746147190.587596:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466437632:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.587606:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.587639:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463838592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3280us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.587646:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5899 00000100:00100000:3.0:1746147190.587698:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463839104 00000100:00100000:3.0:1746147190.587704:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463839104 00002000:00100000:3.0:1746147190.587730:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3858432->3862527) req@ffff88009e683480 x1830967463839104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.587740:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967463839104 ext(3858432->3862527) 00002000:00010000:3.0:1746147190.587743:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e683480 00000100:00100000:3.0:1746147190.587767:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4595 00000100:00100000:3.0:1746147190.587773:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463839104:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147190.587879:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1957:x1830967463839104:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 105us (498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147190.587887:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4595 00002000:00100000:3.0:1746147190.587891:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3858432->3862527) req@ffff88009e683480 x1830967463839104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.587897:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e683480 with x1830967463839104 ext(3858432->3862527) 00002000:00010000:3.0:1746147190.587900:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e683480 00000100:00100000:0.0:1746147190.592885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.593127:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463839232 00000100:00100000:1.0:1746147190.593134:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463839232 00000100:00100000:1.0:1746147190.593177:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11873 00000100:00100000:1.0:1746147190.593192:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+42:29044:x1830967463839232:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147190.593285:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.593300:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fb5 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.593323:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.593331:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 43 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.593337:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.593339:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.593342:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.593364:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 43 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.593374:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 43 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:1.0:1746147190.593384:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466437888:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.593460:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.593468:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 24 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.594206:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466438016:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.594330:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.596694:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466437888:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.596704:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466438016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.596733:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.596746:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d72ca00, rc 0) 00000100:00100000:1.0:1746147190.596970:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29044:x1830967463839232:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3786us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.596977:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11873 00000100:00100000:0.0:1746147190.599432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.599478:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463839360 00000100:00100000:2.0:1746147190.599485:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463839360 00010000:00010000:2.0:1746147190.599508:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.599534:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5900 00000100:00100000:2.0:1746147190.599541:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463839360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.599552:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.599569:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.599590:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.599607:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f800/0xb4b2209fbdac721c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f7d expref: 25 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.599626:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.599666:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463839360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.599672:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5900 00000100:00100000:0.0:1746147190.603273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.603348:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463839616 00000100:00100000:3.0:1746147190.603355:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463839616 00002000:00100000:3.0:1746147190.603388:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009e680a80 x1830967463839616/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.603397:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680a80 with x1830967463839616 ext(0->1048575) 00002000:00010000:3.0:1746147190.603402:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680a80 00000100:00100000:3.0:1746147190.603417:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4596 00000100:00100000:3.0:1746147190.603423:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463839616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.605319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.605355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.605409:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463839872 00000100:00100000:1.0:1746147190.605415:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463839872 00002000:00100000:1.0:1746147190.605443:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e681f80 x1830967463839872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.605451:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967463839872 ext(2097152->3145727) 00002000:00010000:1.0:1746147190.605455:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:3.0:1746147190.605459:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463840256 00000100:00100000:3.0:1746147190.605463:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463840256 00000100:00100000:1.0:1746147190.605468:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4597 00000100:00100000:1.0:1746147190.605473:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463839872:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147190.605478:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3858431) req@ffff88009e681880 x1830967463840256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.605486:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681880 with x1830967463840256 ext(3145728->3858431) 00002000:00010000:3.0:1746147190.605489:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681880 00000100:00100000:3.0:1746147190.605498:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4598 00000100:00100000:3.0:1746147190.605503:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463840256:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.608991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.609031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.609067:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463840384 00000100:00100000:2.0:1746147190.609075:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463840384 00000100:00100000:1.0:1746147190.609169:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463840640 00000100:00100000:1.0:1746147190.609173:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463840640 00002000:00100000:2.0:1746147190.609194:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e680e00 x1830967463840384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.609194:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e681500 x1830967463840640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.609203:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680e00 with x1830967463840384 ext(2097152->3145727) 00002000:00100000:1.0:1746147190.609207:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967463840640 ext(3145728->4194303) 00010000:00010000:2.0:1746147190.609210:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:1.0:1746147190.609211:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.609222:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:1.0:1746147190.609223:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00002000:00010000:2.0:1746147190.609229:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e680e00 00002000:00010000:1.0:1746147190.609229:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e681500 00000100:00100000:1.0:1746147190.609245:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1572 00000100:00100000:1.0:1746147190.609250:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463840640:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.609373:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1573 00000100:00100000:2.0:1746147190.609378:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463840384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.613832:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463839616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10401us (10557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.613842:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4596 00002000:00100000:2.0:1746147190.613852:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009e680a80 x1830967463839616/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.613860:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680a80 with x1830967463839616 ext(0->1048575) 00002000:00010000:2.0:1746147190.613864:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e680a80 00000100:00100000:1.0:1746147190.619119:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463839872:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13636us (13795us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.619130:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4597 00002000:00100000:1.0:1746147190.619140:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e681f80 x1830967463839872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.619149:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681f80 with x1830967463839872 ext(2097152->3145727) 00002000:00010000:1.0:1746147190.619154:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681f80 00000100:00100000:3.0:1746147190.624447:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463840256:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18937us (19084us total) trans 0 rc 712704/712704 00000100:00100000:3.0:1746147190.624459:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4598 00002000:00100000:3.0:1746147190.624468:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3858431) req@ffff88009e681880 x1830967463840256/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.624476:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681880 with x1830967463840256 ext(3145728->3858431) 00002000:00010000:3.0:1746147190.624481:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681880 00000100:00100000:0.0:1746147190.624814:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967463840640:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15562us (15781us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147190.624820:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1572 00002000:00100000:0.0:1746147190.624825:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009e681500 x1830967463840640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147190.624832:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681500 with x1830967463840640 ext(3145728->4194303) 00010000:00010000:0.0:1746147190.624838:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 45 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:0.0:1746147190.624851:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 45 pid: 6881 timeout: 677 lvb_type: 1 00002000:00010000:0.0:1746147190.624857:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e681500 00000100:00100000:0.0:1746147190.633099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.633138:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463840896 00000100:00100000:0.0:1746147190.633146:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463840896 00000100:00100000:0.0:1746147190.633195:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10550 00000100:00100000:0.0:1746147190.633202:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+45:29053:x1830967463840896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147190.633221:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.633259:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8200/0xb4b2209fbdac7269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fbc expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.633384:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.633397:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.633409:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147190.633417:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147190.633507:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8200/0xb4b2209fbdac7269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 48 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.633522:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 47 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.633528:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:2.0:1746147190.633654:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463840384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24275us (24669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.633661:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1573 00002000:00100000:2.0:1746147190.633668:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e680e00 x1830967463840384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.633675:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680e00 with x1830967463840384 ext(2097152->3145727) 00010000:00010000:2.0:1746147190.633681:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 43 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.633691:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 43 pid: 6881 timeout: 677 lvb_type: 1 00002000:00010000:2.0:1746147190.633696:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e680e00 00010000:00010000:1.0:1746147190.634530:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147190.634535:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcf8000, rc 0) 00000100:00100000:1.0:1746147190.634563:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+47:29053:x1830967463840896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1360us (1469us total) trans 8589944306 rc 0/0 00000100:00100000:2.0:1746147190.634568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.634569:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10550 00000100:00100000:1.0:1746147190.634603:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841024 00000100:00100000:1.0:1746147190.634607:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841024 00000100:00100000:1.0:1746147190.634629:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11874 00000100:00100000:1.0:1746147190.634633:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463841024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.634643:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147190.634645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147190.634652:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcf8600/0xb4b2209fbdac727e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fc3 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.634657:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841152 00000100:00100000:2.0:1746147190.634660:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841152 00000100:00100000:2.0:1746147190.634675:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11875 00000100:00100000:2.0:1746147190.634680:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463841152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.634686:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147190.634687:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466438144:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.634694:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d000/0xb4b2209fbdac7285 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fca expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.634704:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.634709:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d000/0xb4b2209fbdac7285 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fca expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.634717:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d000/0xb4b2209fbdac7285 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fca expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.634728:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d000, rc 0) 00000100:00100000:1.0:1746147190.634736:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.634743:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463841152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 64us (99us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.634748:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11875 00000100:00100000:0.0:1746147190.637269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.637271:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466438144:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.637298:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcf8600/0xb4b2209fbdac727e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fc3 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.637309:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcf8600/0xb4b2209fbdac727e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fc3 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.637318:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcf8600, rc 0) 00000100:00100000:2.0:1746147190.637327:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841280 00000100:00100000:2.0:1746147190.637332:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841280 00000100:00100000:2.0:1746147190.637358:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11876 00000100:00100000:1.0:1746147190.637360:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463841024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2725us (2792us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.637363:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29048:x1830967463841280:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147190.637366:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11874 00010000:00010000:2.0:1746147190.637378:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.637390:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fd1 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.637661:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.637665:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.637672:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.637684:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.637693:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d400, rc 0) 00000100:00100000:2.0:1746147190.637713:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+44:29048:x1830967463841280:12345-192.168.203.36@tcp:101:cat.0 Request processed in 350us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.637717:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11876 00000100:00100000:0.0:1746147190.639217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.639281:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841408 00000100:00100000:2.0:1746147190.639285:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841408 00010000:00010000:2.0:1746147190.639304:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00000100:00100000:2.0:1746147190.639321:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5901 00000100:00100000:2.0:1746147190.639327:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463841408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.639335:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.639349:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.639358:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.639372:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9e7c00/0xb4b2209fbdac723f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f92 expref: 44 pid: 6881 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.639386:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.639388:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.639392:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.639399:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.639423:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.639432:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466438272:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147190.639496:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.640145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.640392:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841536 00000100:00100000:2.0:1746147190.640396:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841536 00000100:00100000:3.0:1746147190.640485:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eced500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466438272:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.640495:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.640524:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463841408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1197us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.640530:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5901 00000100:00100000:2.0:1746147190.640730:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11877 00000100:00100000:2.0:1746147190.640736:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29051:x1830967463841536:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.640747:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.640757:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fd8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.640773:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.640778:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.640780:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.640782:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.640797:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.640807:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 32 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.640814:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466438400:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.641200:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.642855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.642990:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463841792 00000100:00100000:2.0:1746147190.642997:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463841792 00002000:00100000:2.0:1746147190.643027:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880132e13b80 x1830967463841792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.643035:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13b80 with x1830967463841792 ext(2097152->3145727) 00002000:00010000:2.0:1746147190.643039:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13b80 00000100:00100000:2.0:1746147190.643053:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4599 00000100:00100000:2.0:1746147190.643059:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463841792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.645471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.645563:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842048 00000100:00100000:1.0:1746147190.645570:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842048 00002000:00100000:1.0:1746147190.645611:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3563520->3567615) req@ffff880132e13480 x1830967463842048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.645620:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967463842048 ext(3563520->3567615) 00002000:00010000:1.0:1746147190.645624:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480 00000100:00100000:1.0:1746147190.645651:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4600 00000100:00100000:1.0:1746147190.645658:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967463842048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.645774:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1956:x1830967463842048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 116us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147190.645780:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4600 00002000:00100000:1.0:1746147190.645785:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3563520->3567615) req@ffff880132e13480 x1830967463842048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.645791:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13480 with x1830967463842048 ext(3563520->3567615) 00002000:00010000:1.0:1746147190.645794:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13480 00000100:00100000:0.0:1746147190.651173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.651356:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466438400:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.651380:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.651394:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5dc00, rc 0) 00000100:00100000:2.0:1746147190.651429:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29051:x1830967463841536:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10692us (11284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.651437:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11877 00000100:00100000:3.0:1746147190.651522:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842176 00000100:00100000:3.0:1746147190.651528:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842176 00002000:00100000:3.0:1746147190.651557:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3858432->4194303) req@ffff880132e12680 x1830967463842176/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.651565:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463842176 ext(3858432->4194303) 00010000:00010000:3.0:1746147190.651571:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 33 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.651589:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 33 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.651595:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e12680 00000100:00100000:3.0:1746147190.651623:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1574 00000100:00100000:3.0:1746147190.651629:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463842176:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147190.653367:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463841792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10302us (10510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.653376:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4599 00002000:00100000:2.0:1746147190.653383:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880132e13b80 x1830967463841792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.653392:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13b80 with x1830967463841792 ext(2097152->3145727) 00002000:00010000:2.0:1746147190.653396:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13b80 00000100:00100000:0.0:1746147190.655564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.655622:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842304 00000100:00100000:1.0:1746147190.655629:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842304 00000100:00100000:1.0:1746147190.655674:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10551 00000100:00100000:1.0:1746147190.655681:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+28:29054:x1830967463842304:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147190.655699:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.655713:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8e00/0xb4b2209fbdac729a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fdf expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.655757:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655767:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655775:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655786:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655791:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655795:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655880:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655890:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 331 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.655897:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 46 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.655903:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.655928:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 46 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.655963:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 46 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.655974:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466438528:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.656773:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 331 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.656783:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 331 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.656792:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466438656:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.656815:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.659705:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463842176:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8070us (8534us total) trans 21474840651 rc 0/0 00000100:00100000:3.0:1746147190.659715:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1574 00002000:00100000:3.0:1746147190.659724:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3858432->4194303) req@ffff880132e12680 x1830967463842176/t21474840651(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.659732:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463842176 ext(3858432->4194303) 00010000:00010000:3.0:1746147190.659740:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 35 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.659750:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 35 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.659756:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147190.660801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.661084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.661110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.661126:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842944 00000100:00100000:0.0:1746147190.661131:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842944 00000100:00100000:3.0:1746147190.661189:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842560 00000100:00100000:3.0:1746147190.661192:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842560 00002000:00100000:3.0:1746147190.661215:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3567616->4194303) req@ffff880132e13100 x1830967463842560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.661221:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967463842560 ext(3567616->4194303) 00002000:00010000:3.0:1746147190.661225:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13100 00000100:00100000:3.0:1746147190.661236:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4601 00000100:00100000:3.0:1746147190.661241:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463842560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.661450:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466438528:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.661458:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466438656:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.661481:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147190.662398:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4189 00000100:00100000:0.0:1746147190.662407:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+332:7641:x1830967463842944:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147190.662545:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+333:7641:x1830967463842944:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 140us (1434us total) trans 8589944307 rc 0/0 00000100:00100000:0.0:1746147190.662551:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4189 00000100:00100000:2.0:1746147190.662717:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463842688 00000100:00100000:2.0:1746147190.662722:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463842688 00010000:00010000:2.0:1746147190.662741:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 47 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.662767:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5902 00000100:00100000:2.0:1746147190.662772:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+47:1956:x1830967463842688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.662780:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.662785:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 47 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.662792:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 47 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.662807:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8000/0xb4b2209fbdac7270 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fbc expref: 47 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.662819:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147190.662824:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.662832:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.662837:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147190.662841:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.662860:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+46:1956:x1830967463842688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 88us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.662864:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5902 00000100:00100000:0.0:1746147190.666875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.666895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.667197:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843072 00000100:00100000:2.0:1746147190.667205:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843072 00000100:00100000:1.0:1746147190.667245:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843200 00000100:00100000:2.0:1746147190.667249:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11878 00000100:00100000:1.0:1746147190.667249:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843200 00000100:00100000:2.0:1746147190.667255:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29048:x1830967463843072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.667267:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 36 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.667269:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.667279:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fe6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.667285:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5903 00000100:00100000:1.0:1746147190.667289:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463843200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.667298:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.667301:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147190.667301:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.667304:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 37 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.667312:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 37 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.667314:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 37 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.667321:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d200, rc 0) 00010000:00010000:1.0:1746147190.667323:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 37 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.667336:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac724d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa0 expref: 37 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.667349:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.667350:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147190.667351:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29048:x1830967463843072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 97us (484us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147190.667355:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.667356:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11878 00010000:00010000:1.0:1746147190.667361:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.667366:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.667368:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.667437:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.667893:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463842560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6650us (7093us total) trans 0 rc 626688/626688 00000100:00100000:3.0:1746147190.667901:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4601 00002000:00100000:3.0:1746147190.667910:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3567616->4194303) req@ffff880132e13100 x1830967463842560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.667918:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967463842560 ext(3567616->4194303) 00002000:00010000:3.0:1746147190.667921:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13100 00010000:00010000:1.0:1746147190.667979:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.668005:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.668015:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466438784:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147190.668061:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.668069:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466438912:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147190.668086:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.668220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.668317:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843328 00000100:00100000:0.0:1746147190.668321:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843328 00010000:00010000:0.0:1746147190.668336:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 333 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.668353:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5904 00000100:00100000:0.0:1746147190.668358:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+333:1957:x1830967463843328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.668365:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.668369:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 333 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.668376:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 333 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.668388:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9e7e00/0xb4b2209fbdac722a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f84 expref: 333 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.668400:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147190.668404:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.668413:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.668419:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.668442:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.668460:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+332:1957:x1830967463843328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.668465:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5904 00010000:00010000:1.0:1746147190.668742:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.668750:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147190.668781:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00000004:00200000:1.0:1746147190.668784:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147190.668797:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.668804:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.668812:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.668817:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669240:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669245:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcf9000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147190.669248:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669254:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669262:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147190.669264:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147190.669267:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669271:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9000/0xb4b2209fbdac72a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669279:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669284:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669288:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669291:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcf9200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147190.669293:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669297:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669305:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:1.0:1746147190.669307:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147190.669309:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669313:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9200/0xb4b2209fbdac72a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.669337:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8e00/0xb4b2209fbdac729a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.669349:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 29 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.669354:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.669356:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147190.669358:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcf9400, rc 0) 00000100:00100000:1.0:1746147190.669636:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+29:29054:x1830967463842304:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 13953us (14076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.669642:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10551 00000100:00100000:0.0:1746147190.674860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.675189:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466438784:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147190.675200:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466438912:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147190.675219:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147190.675261:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463843200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7969us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.675269:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5903 00000100:00100000:0.0:1746147190.675379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.675441:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843456 00000100:00100000:2.0:1746147190.675447:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843456 00000100:00100000:2.0:1746147190.675476:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11879 00000100:00100000:2.0:1746147190.675481:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463843456:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147190.675494:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.675506:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6fed expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.675525:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.675527:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.675534:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.675548:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.675556:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ce00, rc 0) 00000100:00100000:2.0:1746147190.675589:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463843456:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 108us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.675595:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11879 00000100:00100000:3.0:1746147190.675649:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843712 00000100:00100000:3.0:1746147190.675653:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843712 00002000:00100000:3.0:1746147190.675675:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880132e10700 x1830967463843712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.675683:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10700 with x1830967463843712 ext(2097152->3145727) 00002000:00010000:3.0:1746147190.675687:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10700 00000100:00100000:3.0:1746147190.675702:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4602 00000100:00100000:3.0:1746147190.675706:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463843712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.676822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.676967:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843840 00000100:00100000:3.0:1746147190.676971:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843840 00000100:00100000:3.0:1746147190.676999:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11880 00000100:00100000:3.0:1746147190.677005:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463843840:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.677015:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.677025:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ff4 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.677041:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.677042:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.677048:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.677058:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.677066:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9f200, rc 0) 00000100:00100000:3.0:1746147190.677088:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463843840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.677092:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11880 00000100:00100000:0.0:1746147190.677731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.677810:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463843968 00000100:00100000:3.0:1746147190.677814:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463843968 00000100:00100000:3.0:1746147190.677831:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11881 00000100:00100000:3.0:1746147190.677835:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463843968:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147190.677843:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.677852:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9f400/0xb4b2209fbdac72cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e6ffb expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.677882:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439040:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147190.677923:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.680286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.680367:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463844224 00000100:00100000:2.0:1746147190.680375:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463844224 00002000:00100000:2.0:1746147190.680405:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880132e11180 x1830967463844224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.680419:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967463844224 ext(3145728->4194303) 00002000:00010000:2.0:1746147190.680424:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:2.0:1746147190.680449:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4603 00000100:00100000:2.0:1746147190.680457:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463844224:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147190.688323:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439040:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.688355:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9f400/0xb4b2209fbdac72cb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ffb expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.688367:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9f400/0xb4b2209fbdac72cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ffb expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.688380:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9f400, rc 0) 00000100:00100000:2.0:1746147190.688736:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463843968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 10897us (11003us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.688744:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11881 00000100:00100000:3.0:1746147190.689183:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463843712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13474us (13802us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.689192:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4602 00002000:00100000:3.0:1746147190.689200:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff880132e10700 x1830967463843712/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.689208:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10700 with x1830967463843712 ext(2097152->3145727) 00002000:00010000:3.0:1746147190.689212:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e10700 00000100:00100000:2.0:1746147190.691914:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463844224:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11451us (11630us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.691925:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4603 00002000:00100000:2.0:1746147190.691933:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880132e11180 x1830967463844224/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.691960:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11180 with x1830967463844224 ext(3145728->4194303) 00002000:00010000:2.0:1746147190.691965:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11180 00000100:00100000:1.0:1746147190.695444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.695472:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463844480 00000100:00100000:1.0:1746147190.695479:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463844480 00000100:00100000:1.0:1746147190.695511:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10552 00000100:00100000:1.0:1746147190.695517:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+29:29054:x1830967463844480:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147190.695531:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.695544:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9c00/0xb4b2209fbdac72d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7002 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.695629:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.695641:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.695648:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.695671:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.695680:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 30 pid: 14049 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.695690:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466439168:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.695744:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.696166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.696226:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463844608 00000100:00100000:2.0:1746147190.696231:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463844608 00000100:00100000:2.0:1746147190.696252:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11882 00000100:00100000:2.0:1746147190.696257:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29051:x1830967463844608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.696265:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.696276:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7009 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.696290:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.696292:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.696297:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.696307:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.696314:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5cc00, rc 0) 00000100:00100000:2.0:1746147190.696350:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29051:x1830967463844608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.696356:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11882 00000100:00100000:0.0:1746147190.703136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.703200:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463844736 00000100:00100000:2.0:1746147190.703208:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463844736 00000100:00100000:2.0:1746147190.703254:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11883 00000100:00100000:2.0:1746147190.703261:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463844736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.703278:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.703293:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ca00/0xb4b2209fbdac72e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7010 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.703334:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466439296:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147190.703393:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.703819:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466439168:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147190.703841:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147190.705693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.705811:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463844864 00000100:00100000:1.0:1746147190.705817:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463844864 00000100:00100000:2.0:1746147190.705826:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466439296:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.705844:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 31 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.705849:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ca00/0xb4b2209fbdac72e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7010 expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.705861:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ca00/0xb4b2209fbdac72e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7010 expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.705874:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ca00, rc 0) 00000100:00100000:2.0:1746147190.705912:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463844736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2651us (2783us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.705919:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11883 00000100:00100000:1.0:1746147190.706405:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5905 00000100:00100000:1.0:1746147190.706413:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+31:1956:x1830967463844864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.706426:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147190.706432:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 31 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.706442:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 31 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.706457:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9400/0xb4b2209fbdac72af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fdf expref: 31 pid: 14049 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.706481:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.706485:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.706494:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.706499:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.706517:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147190.706534:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+30:1956:x1830967463844864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 122us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147190.706817:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5905 00010000:00010000:1.0:1746147190.706856:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.706862:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147190.706879:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:1.0:1746147190.707003:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9c00/0xb4b2209fbdac72d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7002 expref: 31 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.707014:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7002 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.707019:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.707022:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147190.707023:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcf9600, rc 0) 00000100:00100000:1.0:1746147190.707516:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+30:29054:x1830967463844480:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 11997us (12077us total) trans 8589944308 rc 0/0 00000100:00100000:1.0:1746147190.707522:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10552 00000100:00100000:2.0:1746147190.711126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.711126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.711177:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463845632 00000100:00100000:1.0:1746147190.711184:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463845632 00000100:00100000:2.0:1746147190.711198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.711221:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10553 00000100:00100000:1.0:1746147190.711228:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+30:29054:x1830967463845632:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147190.711247:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.711250:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147190.711269:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9600/0xb4b2209fbdac72d9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7002 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.711281:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.711286:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147190.711295:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8a00/0xb4b2209fbdac72f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7017 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.711325:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463845120 00000100:00100000:3.0:1746147190.711329:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463845120 00002000:00100000:3.0:1746147190.711352:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ecee300 x1830967463845120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.711362:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967463845120 ext(2097152->3145727) 00010000:00010000:1.0:1746147190.711363:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00002000:00010000:3.0:1746147190.711366:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecee300 00010000:00010000:1.0:1746147190.711374:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147190.711383:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463845376 00010000:00010000:1.0:1746147190.711383:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147190.711386:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463845376 00010000:00010000:1.0:1746147190.711392:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00002000:00100000:3.0:1746147190.711397:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ecedc00 x1830967463845376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147190.711397:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.711402:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00002000:00100000:3.0:1746147190.711403:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedc00 with x1830967463845376 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.711405:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecedc00 00010000:00010000:1.0:1746147190.711406:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcf9800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147190.711409:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.711415:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147190.711420:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4604 00010000:00010000:1.0:1746147190.711421:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147190.711423:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1746147190.711425:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463845120:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147190.711425:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.711432:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf9800/0xb4b2209fbdac72fc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147190.711450:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8a00/0xb4b2209fbdac72f5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7017 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.711456:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcf8a00/0xb4b2209fbdac72f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7017 expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.711462:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcf8a00, rc 0) 00000100:00100000:1.0:1746147190.711480:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4605 00000100:00100000:1.0:1746147190.711485:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463845376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147190.711589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.711917:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463845888 00000100:00100000:2.0:1746147190.711921:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463845888 00002000:00100000:2.0:1746147190.711958:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880132e12d80 x1830967463845888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.711964:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463845888 ext(4194304->4927487) 00002000:00010000:2.0:1746147190.711967:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:2.0:1746147190.711983:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4606 00000100:00100000:2.0:1746147190.711988:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463845888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.712896:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+29:29054:x1830967463845632:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 1665us (1768us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.712902:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10553 00000100:00100000:0.0:1746147190.723194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.723461:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463845376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11973us (12260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147190.723470:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4605 00000100:00100000:2.0:1746147190.723478:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846144 00002000:00100000:1.0:1746147190.723480:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ecedc00 x1830967463845376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147190.723485:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846144 00002000:00100000:1.0:1746147190.723489:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecedc00 with x1830967463845376 ext(3145728->4194303) 00002000:00010000:1.0:1746147190.723493:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ecedc00 00000100:00100000:2.0:1746147190.723514:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4190 00000100:00100000:2.0:1746147190.723520:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+29:29054:x1830967463846144:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147190.723920:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60817ea3-97af-43a7-ab2a-b628d12800db+30:29054:x1830967463846144:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 398us (731us total) trans 8589944309 rc 0/0 00000100:00100000:2.0:1746147190.723926:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4190 00000100:00100000:3.0:1746147190.729196:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463845120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17764us (18070us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147190.729196:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463845888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17201us (17599us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147190.729205:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4604 00002000:00100000:3.0:1746147190.729308:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ecee300 x1830967463845120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.729317:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecee300 with x1830967463845120 ext(2097152->3145727) 00002000:00010000:3.0:1746147190.729323:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecee300 00000100:00100000:2.0:1746147190.729751:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4606 00002000:00100000:2.0:1746147190.729762:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff880132e12d80 x1830967463845888/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.729769:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463845888 ext(4194304->4927487) 00002000:00010000:2.0:1746147190.729774:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:0.0:1746147190.735999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.736110:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846272 00000100:00100000:2.0:1746147190.736118:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846272 00000100:00100000:2.0:1746147190.736200:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11884 00000100:00100000:2.0:1746147190.736209:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463846272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.736349:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.736365:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac7303 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e701e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.736414:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466439424:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147190.736974:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.739990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.740221:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846400 00000100:00100000:3.0:1746147190.740230:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846400 00000100:00100000:3.0:1746147190.740287:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11885 00000100:00100000:3.0:1746147190.740297:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29051:x1830967463846400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.740316:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.740333:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7025 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.740361:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 44 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.740368:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147190.740370:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147190.740373:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.740404:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 44 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.740416:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 44 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.740427:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439552:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147190.740533:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.741289:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466439424:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.741317:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac7303 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e701e expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.741328:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac7303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e701e expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147190.741363:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5c800, rc 0) 00000100:00100000:3.0:1746147190.741440:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463846272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5229us (5447us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147190.741448:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11884 00000100:00100000:0.0:1746147190.743985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.744009:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439552:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147190.744031:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.744044:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9fc00, rc 0) 00000100:00100000:2.0:1746147190.744065:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846528 00000100:00100000:2.0:1746147190.744071:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846528 00002000:00100000:2.0:1746147190.744106:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3567615) req@ffff88008e977480 x1830967463846528/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147190.744114:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967463846528 ext(3145728->3567615) 00010000:00010000:2.0:1746147190.744122:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.744133:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 43 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:2.0:1746147190.744139:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e977480 00000100:00100000:2.0:1746147190.744164:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1575 00000100:00100000:2.0:1746147190.744173:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967463846528:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147190.744177:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29051:x1830967463846400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3882us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.744184:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11885 00000100:00100000:0.0:1746147190.744315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.744383:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846656 00000100:00100000:3.0:1746147190.744386:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846656 00000100:00100000:3.0:1746147190.744403:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11886 00000100:00100000:3.0:1746147190.744408:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463846656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147190.744415:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147190.744425:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fa00/0xb4b2209fbdac7311 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e702c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.744462:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439680:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147190.744676:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.749732:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439680:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147190.749759:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fa00/0xb4b2209fbdac7311 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e702c expref: 46 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.749772:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fa00/0xb4b2209fbdac7311 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e702c expref: 46 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.750308:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9fa00, rc 0) 00000100:00100000:0.0:1746147190.750354:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967463846656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5944us (6037us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147190.750362:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11886 00000100:00100000:3.0:1746147190.750719:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967463846528:12345-192.168.203.36@tcp:4:cat.0 Request processed in 6545us (6780us total) trans 17179873242 rc 0/0 00000100:00100000:3.0:1746147190.750728:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1575 00002000:00100000:3.0:1746147190.750738:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3567615) req@ffff88008e977480 x1830967463846528/t17179873242(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.750751:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977480 with x1830967463846528 ext(3145728->3567615) 00010000:00010000:3.0:1746147190.750758:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.750769:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.750774:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e977480 00000100:00100000:0.0:1746147190.763707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.763759:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463846784 00000100:00100000:1.0:1746147190.763767:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463846784 00010000:00010000:1.0:1746147190.763804:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00000100:00100000:1.0:1746147190.763839:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5906 00000100:00100000:1.0:1746147190.763846:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1958:x1830967463846784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147190.763859:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147190.763876:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.763886:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.763909:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d72ca00/0xb4b2209fbdac7262 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fb5 expref: 45 pid: 8480 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.764459:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.764461:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147190.764468:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.764476:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147190.764504:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.764513:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466439808:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147190.764607:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.782115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.782187:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847040 00000100:00100000:3.0:1746147190.782194:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847040 00002000:00100000:3.0:1746147190.782226:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012eced500 x1830967463847040/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.782234:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967463847040 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.782239:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:3.0:1746147190.782255:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4607 00000100:00100000:3.0:1746147190.782260:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463847040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147190.782567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.782759:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847296 00000100:00100000:0.0:1746147190.782763:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847296 00000100:00100000:0.0:1746147190.782793:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10554 00000100:00100000:0.0:1746147190.782798:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+332:29058:x1830967463847296:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147190.782812:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147190.782825:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48800/0xb4b2209fbdac7318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7033 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.782893:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.782905:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.782913:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147190.782920:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147190.783011:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48800/0xb4b2209fbdac7318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 335 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.783027:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 334 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.783039:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147190.783041:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147190.783043:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48200, rc 0) 00000100:00100000:0.0:1746147190.783553:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+334:29058:x1830967463847296:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 753us (985us total) trans 8589944310 rc 0/0 00000100:00100000:0.0:1746147190.783559:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10554 00000100:00100000:2.0:1746147190.785344:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466439808:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.785360:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.785389:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967463846784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 21543us (21688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.785398:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5906 00000100:00100000:3.0:1746147190.795504:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463847040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13231us (13384us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147190.795515:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4607 00002000:00100000:3.0:1746147190.795527:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012eced500 x1830967463847040/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.795536:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eced500 with x1830967463847040 ext(3145728->4194303) 00002000:00010000:3.0:1746147190.795541:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012eced500 00000100:00100000:0.0:1746147190.808145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.809997:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847552 00000100:00100000:3.0:1746147190.810008:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847552 00002000:00100000:3.0:1746147190.810051:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e977100 x1830967463847552/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.810061:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977100 with x1830967463847552 ext(4194304->4927487) 00002000:00010000:3.0:1746147190.810066:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977100 00000100:00100000:3.0:1746147190.810104:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4608 00000100:00100000:3.0:1746147190.810113:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463847552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147190.822203:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463847552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12083us (14059us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746147190.822213:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4608 00002000:00100000:3.0:1746147190.822225:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4927487) req@ffff88008e977100 x1830967463847552/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/440 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.822233:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e977100 with x1830967463847552 ext(4194304->4927487) 00002000:00010000:3.0:1746147190.822239:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e977100 00000100:00100000:0.0:1746147190.833505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.833524:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847680 00000100:00100000:0.0:1746147190.833530:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847680 00000100:00100000:0.0:1746147190.833562:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11887 00000100:00100000:0.0:1746147190.833568:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29053:x1830967463847680:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147190.833590:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147190.833603:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e703a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833626:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833633:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833639:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833643:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147190.833645:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147190.833648:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833668:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833677:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.833686:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439936:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147190.833744:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833750:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.833756:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440064:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147190.833772:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.833778:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 43 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.833784:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440192:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.833795:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147190.839389:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147190.839515:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466439936:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.839591:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440064:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147190.839600:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440192:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147190.839604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.839616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147190.839623:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.839637:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48e00, rc 0) 00000100:00100000:1.0:1746147190.839644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.839657:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847936 00000100:00100000:3.0:1746147190.839663:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847936 00000100:00100000:0.0:1746147190.839672:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29053:x1830967463847680:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6103us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.839679:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11887 00010000:00010000:3.0:1746147190.839685:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.839701:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463847808 00000100:00100000:3.0:1746147190.839703:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463847808 00010000:00010000:3.0:1746147190.839710:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.839720:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848064 00000100:00100000:3.0:1746147190.839723:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848064 00010000:00010000:3.0:1746147190.839729:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.839741:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5907 00000100:00100000:0.0:1746147190.839746:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5908 00000100:00100000:3.0:1746147190.839747:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463847936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147190.839752:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463847808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.839756:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.839759:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.839772:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.839772:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839780:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.839788:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839805:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac728c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd1 expref: 44 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:0.0:1746147190.839809:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fc00/0xb4b2209fbdac730a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7025 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839813:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147190.839817:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.839829:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463847936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.839833:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463847808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.839835:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5907 00000100:00100000:0.0:1746147190.839839:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5908 00000100:00100000:3.0:1746147190.839846:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5909 00000100:00100000:3.0:1746147190.839850:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463848064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.839857:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.839864:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 26 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839876:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 26 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839886:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac72e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7009 expref: 26 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.839893:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.839895:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.839901:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.839907:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.839930:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.839954:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466440320:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147190.839991:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.842409:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466440320:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147190.842425:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.842649:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463848064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2796us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.842657:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5909 00000100:00100000:0.0:1746147190.842865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.843028:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848320 00000100:00100000:3.0:1746147190.843034:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848320 00002000:00100000:3.0:1746147190.843061:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2895872->2899967) req@ffff88008e976680 x1830967463848320/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.843074:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967463848320 ext(2895872->2899967) 00002000:00010000:3.0:1746147190.843078:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:3.0:1746147190.843093:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4609 00000100:00100000:3.0:1746147190.843099:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463848320:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147190.843203:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463848320:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 104us (338us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147190.843209:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4609 00002000:00100000:3.0:1746147190.843214:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2895872->2899967) req@ffff88008e976680 x1830967463848320/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.843221:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976680 with x1830967463848320 ext(2895872->2899967) 00002000:00010000:3.0:1746147190.843223:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e976680 00000100:00100000:2.0:1746147190.847201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.847225:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848448 00000100:00100000:2.0:1746147190.847232:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848448 00000100:00100000:2.0:1746147190.847261:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11888 00000100:00100000:2.0:1746147190.847267:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29053:x1830967463848448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.847283:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.847296:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7041 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847316:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847323:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.847330:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847335:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.847337:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147190.847340:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3145728->3919871] (req 3145728->3919871) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847363:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 34 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847373:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 34 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.847383:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.847462:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.847474:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 12 pid: 8481 timeout: 677 lvb_type: 1 00000100:00100000:2.0:1746147190.847481:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.847509:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.847517:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.847524:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440704:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.847540:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.852296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.852463:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.852475:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.852492:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848576 00000100:00100000:2.0:1746147190.852496:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848576 00010000:00010000:2.0:1746147190.852522:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 677 lvb_type: 1 00000100:00100000:2.0:1746147190.852553:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5910 00000100:00100000:2.0:1746147190.852560:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463848576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.852569:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.852597:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.852607:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.852623:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac72c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ff4 expref: 13 pid: 8481 timeout: 677 lvb_type: 1 00010000:00010000:2.0:1746147190.852634:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.852663:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463848576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.852669:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5910 00000100:00100000:2.0:1746147190.852910:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466440704:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.852935:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->3919871] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.852961:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569200, rc 0) 00000100:00100000:2.0:1746147190.852980:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29053:x1830967463848448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5711us (5783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.852986:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11888 00000100:00100000:1.0:1746147190.853451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.853509:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848704 00000100:00100000:2.0:1746147190.853513:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848704 00010000:00010000:2.0:1746147190.853526:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.853540:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5911 00000100:00100000:2.0:1746147190.853545:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463848704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147190.853551:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147190.853560:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.853567:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.853589:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0xb4b2209fbdac72b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fe6 expref: 35 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:2.0:1746147190.853597:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147190.853615:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463848704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.853620:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5911 00000100:00100000:2.0:1746147190.856177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.856241:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463848832 00000100:00100000:3.0:1746147190.856248:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463848832 00010000:00010000:3.0:1746147190.856271:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.856293:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5912 00000100:00100000:3.0:1746147190.856300:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463848832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.856309:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.856324:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.856334:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.856349:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5dc00/0xb4b2209fbdac7293 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fd8 expref: 29 pid: 4445 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.856359:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.856361:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.856370:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.856382:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.856408:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 28 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.856418:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466440832:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147190.856697:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.857758:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466440832:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.857773:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.857797:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463848832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1497us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.857805:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5912 00000001:00080000:3.0:1746147190.858482:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944310 is committed 00000001:00080000:3.0:1746147190.858494:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944275 is committed 00000001:00080000:3.0:1746147190.858498:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944263 is committed 00000001:00080000:3.0:1746147190.858519:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944308 is committed 00000001:00080000:3.0:1746147190.858523:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944306 is committed 00000001:00080000:3.0:1746147190.858547:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944309 is committed 00000100:00100000:0.0:1746147190.863163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.863305:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849088 00000100:00100000:1.0:1746147190.863313:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849088 00002000:00100000:1.0:1746147190.863348:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3915776->3919871) req@ffff88008e976a00 x1830967463849088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.863356:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967463849088 ext(3915776->3919871) 00002000:00010000:1.0:1746147190.863360:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e976a00 00000100:00100000:1.0:1746147190.863389:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4610 00000100:00100000:1.0:1746147190.863396:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463849088:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147190.863840:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463849088:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 442us (681us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147190.863846:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4610 00002000:00100000:1.0:1746147190.863851:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (3915776->3919871) req@ffff88008e976a00 x1830967463849088/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.863858:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e976a00 with x1830967463849088 ext(3915776->3919871) 00002000:00010000:1.0:1746147190.863860:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e976a00 00000100:00100000:0.0:1746147190.866196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.866266:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849344 00000100:00100000:2.0:1746147190.866273:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849344 00000100:00100000:2.0:1746147190.866307:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4191 00000100:00100000:2.0:1746147190.866313:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29053:x1830967463849344:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147190.867010:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29053:x1830967463849344:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 695us (817us total) trans 8589944311 rc 0/0 00000100:00100000:2.0:1746147190.867017:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4191 00000100:00100000:0.0:1746147190.904988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.905056:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849472 00000100:00100000:2.0:1746147190.905064:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849472 00000100:00100000:2.0:1746147190.905101:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11889 00000100:00100000:2.0:1746147190.905109:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29058:x1830967463849472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.905125:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.905140:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7048 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.905165:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.905171:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.905173:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.905175:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 44 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.905198:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.905208:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 24 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.905219:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440960:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.906416:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.907111:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466440960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.907130:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 44 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.907144:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6a400, rc 0) 00000100:00100000:2.0:1746147190.907173:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+44:29058:x1830967463849472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2065us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.907180:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11889 00000100:00100000:0.0:1746147190.908258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147190.908509:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849600 00000100:00100000:1.0:1746147190.908526:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849600 00002000:00100000:1.0:1746147190.908568:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2895872->3145727) req@ffff88008e974380 x1830967463849600/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.908587:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974380 with x1830967463849600 ext(2895872->3145727) 00010000:00010000:1.0:1746147190.908597:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 25 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.908610:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 25 pid: 8481 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.908617:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e974380 00000100:00100000:1.0:1746147190.908645:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1576 00000100:00100000:1.0:1746147190.908653:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463849600:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147190.913621:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463849600:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 4959us (5361us total) trans 17179873243 rc 0/0 00000100:00100000:1.0:1746147190.913633:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1576 00002000:00100000:1.0:1746147190.913645:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (2895872->3145727) req@ffff88008e974380 x1830967463849600/t17179873243(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.913655:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974380 with x1830967463849600 ext(2895872->3145727) 00010000:00010000:1.0:1746147190.913666:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:1.0:1746147190.913681:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00002000:00010000:1.0:1746147190.913688:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e974380 00000100:00100000:0.0:1746147190.915857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.916126:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849728 00000100:00100000:3.0:1746147190.916136:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849728 00010000:00010000:3.0:1746147190.916171:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.916216:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5913 00000100:00100000:3.0:1746147190.916224:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463849728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.916235:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.916259:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.916269:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.916287:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f48e00/0xb4b2209fbdac732d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e703a expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.916316:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.916318:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.916324:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.916331:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.916605:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.916617:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466441088:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147190.917242:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.919906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.919999:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466441088:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.920016:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.920050:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463849728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3827us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.920059:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5913 00000100:00100000:1.0:1746147190.920269:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463849984 00000100:00100000:1.0:1746147190.920275:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463849984 00002000:00100000:1.0:1746147190.920301:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (4161536->4165631) req@ffff88008e974e00 x1830967463849984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.920313:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967463849984 ext(4161536->4165631) 00002000:00010000:1.0:1746147190.920317:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:1.0:1746147190.920329:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4611 00000100:00100000:1.0:1746147190.920334:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463849984:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147190.920438:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463849984:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 104us (539us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147190.920443:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4611 00002000:00100000:1.0:1746147190.920447:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (4161536->4165631) req@ffff88008e974e00 x1830967463849984/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147190.920453:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e974e00 with x1830967463849984 ext(4161536->4165631) 00002000:00010000:1.0:1746147190.920455:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e974e00 00000100:00100000:0.0:1746147190.923553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.923709:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850112 00000100:00100000:2.0:1746147190.923716:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850112 00000100:00100000:2.0:1746147190.923755:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11890 00000100:00100000:2.0:1746147190.923761:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:29058:x1830967463850112:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.923774:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.923787:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e704f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.923809:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.923816:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.923817:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.923820:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.923840:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.923848:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 27 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.923857:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441216:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.923926:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.929415:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441216:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.929451:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.929470:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6b200, rc 0) 00000100:00100000:2.0:1746147190.929525:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29058:x1830967463850112:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5762us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.929533:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11890 00000100:00100000:0.0:1746147190.929874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.929977:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850240 00000100:00100000:3.0:1746147190.929986:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850240 00002000:00100000:3.0:1746147190.930024:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3919871) req@ffff88009e584380 x1830967463850240/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.930033:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967463850240 ext(3145728->3919871) 00010000:00010000:3.0:1746147190.930040:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.930052:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 28 pid: 8481 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.930058:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e584380 00000100:00100000:3.0:1746147190.930092:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1577 00000100:00100000:3.0:1746147190.930098:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463850240:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147190.943732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.943779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.944084:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463850240:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 13983us (14209us total) trans 21474840652 rc 0/0 00000100:00100000:3.0:1746147190.944093:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1577 00002000:00100000:3.0:1746147190.944103:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->3919871) req@ffff88009e584380 x1830967463850240/t21474840652(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.944111:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e584380 with x1830967463850240 ext(3145728->3919871) 00010000:00010000:3.0:1746147190.944119:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.944135:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.944141:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e584380 00000100:00100000:2.0:1746147190.944219:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850368 00000100:00100000:2.0:1746147190.944225:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850368 00000100:00100000:1.0:1746147190.944227:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850496 00000100:00100000:1.0:1746147190.944230:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850496 00000100:00100000:2.0:1746147190.944253:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11891 00000100:00100000:2.0:1746147190.944259:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463850368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.944270:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.944281:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6ae00/0xb4b2209fbdac7349 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7056 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.944315:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441344:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147190.944355:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.944444:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11892 00000100:00100000:1.0:1746147190.944450:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463850496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147190.944457:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.944467:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d72d400/0xb4b2209fbdac7350 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e705d expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147190.944490:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466441472:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147190.944514:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.947531:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441344:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.947556:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6ae00/0xb4b2209fbdac7349 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7056 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.947568:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6ae00/0xb4b2209fbdac7349 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7056 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.947599:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6ae00, rc 0) 00000100:00100000:2.0:1746147190.947643:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463850368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3383us (3917us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.947650:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11891 00000100:00100000:0.0:1746147190.947786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.947849:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850624 00000100:00100000:3.0:1746147190.947854:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850624 00010000:00010000:3.0:1746147190.947874:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147190.947892:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5914 00000100:00100000:3.0:1746147190.947898:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463850624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147190.947908:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147190.947916:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.947924:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.947959:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7041 expref: 30 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.947971:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.947972:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147190.947977:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.947988:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147190.948009:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147190.948019:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466441600:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147190.948137:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466441472:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.948152:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d72d400/0xb4b2209fbdac7350 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e705d expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.948161:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d72d400/0xb4b2209fbdac7350 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e705d expref: 27 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.948171:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d72d400, rc 0) 00000100:00100000:3.0:1746147190.948679:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147190.949287:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463850496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4834us (5504us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.949294:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11892 00000100:00100000:3.0:1746147190.954608:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466441600:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147190.954626:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147190.954674:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463850624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6774us (6886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147190.954684:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5914 00000100:00100000:0.0:1746147190.961449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.961493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.961690:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850752 00000100:00100000:2.0:1746147190.961698:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850752 00000100:00100000:1.0:1746147190.961749:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11893 00000100:00100000:1.0:1746147190.961759:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463850752:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147190.961763:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463850880 00000100:00100000:2.0:1746147190.961767:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463850880 00010000:00010000:1.0:1746147190.961774:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147190.961787:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac7357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7064 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.961820:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11894 00000100:00100000:2.0:1746147190.961826:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463850880:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147190.961830:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466441728:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.961834:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.961843:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa6b400/0xb4b2209fbdac735e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e706b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.961866:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466441856:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147190.961985:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.962408:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00002000:00010000:1.0:1746147190.963382:0:4445:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size: 4926336 -> 4945696 00000100:00100000:1.0:1746147190.963401:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466441728:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147190.963420:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac7357 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7064 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.963432:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491e400/0xb4b2209fbdac7357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7064 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147190.963445:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491e400, rc 0) 00000100:00100000:1.0:1746147190.963483:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463850752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1725us (2039us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147190.963490:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11893 00000100:00100000:2.0:1746147190.964621:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466441856:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147190.964639:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa6b400/0xb4b2209fbdac735e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e706b expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.964649:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6b400/0xb4b2209fbdac735e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e706b expref: 27 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.964671:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6b400, rc 0) 00000100:00100000:2.0:1746147190.964704:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463850880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2878us (3210us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147190.964710:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11894 00000100:00100000:0.0:1746147190.969853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.969967:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851008 00000100:00100000:2.0:1746147190.969975:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851008 00000100:00100000:2.0:1746147190.970020:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11895 00000100:00100000:2.0:1746147190.970027:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29065:x1830967463851008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147190.970043:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147190.970146:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7072 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.970176:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.970183:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.970184:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147190.970187:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.970212:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.970222:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 34 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:2.0:1746147190.970232:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441984:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147190.971186:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147190.977824:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466441984:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147190.977850:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 30 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147190.977871:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6b000, rc 0) 00000100:00100000:2.0:1746147190.977908:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29065:x1830967463851008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7880us (8061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147190.977916:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11895 00000100:00100000:0.0:1746147190.978205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147190.978435:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851136 00000100:00100000:3.0:1746147190.978441:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851136 00002000:00100000:3.0:1746147190.978468:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4945695) req@ffff88009e586680 x1830967463851136/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.978476:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586680 with x1830967463851136 ext(4194304->4945695) 00010000:00010000:3.0:1746147190.978482:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 35 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147190.978493:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 35 pid: 8481 timeout: 677 lvb_type: 0 00002000:00010000:3.0:1746147190.978503:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e586680 00000100:00100000:3.0:1746147190.978522:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1578 00000100:00100000:3.0:1746147190.978528:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463851136:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147190.988459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147190.988933:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851264 00000100:00100000:0.0:1746147190.988955:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851264 00000100:00100000:0.0:1746147190.989003:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11896 00000100:00100000:0.0:1746147190.989011:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463851264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147190.989026:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147190.989039:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f49200/0xb4b2209fbdac736c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7079 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.989083:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466442112:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147190.989153:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147190.994418:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463851136:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 15882us (16205us total) trans 21474840653 rc 0/0 00000100:00100000:3.0:1746147190.994430:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1578 00002000:00100000:3.0:1746147190.994439:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4945695) req@ffff88009e586680 x1830967463851136/t21474840653(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:566/0 lens 488/448 e 0 to 0 dl 1746147201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147190.994448:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e586680 with x1830967463851136 ext(4194304->4945695) 00010000:00010000:3.0:1746147190.994525:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 39 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.994532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147190.994541:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466442112:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147190.994550:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 39 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:0.0:1746147190.994552:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851520 00002000:00010000:3.0:1746147190.994557:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e586680 00000100:00100000:0.0:1746147190.994557:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851520 00010000:00010000:2.0:1746147190.994564:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f49200/0xb4b2209fbdac736c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7079 expref: 39 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147190.994588:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f49200/0xb4b2209fbdac736c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7079 expref: 38 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147190.994598:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10555 00000100:00100000:0.0:1746147190.994605:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29069:x1830967463851520:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147190.994607:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49200, rc 0) 00010000:00010000:0.0:1746147190.994622:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147190.994632:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463851264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5622us (6179us total) trans 0 rc 301/301 00010000:00010000:0.0:1746147190.994634:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49800/0xb4b2209fbdac7373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7080 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147190.994637:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11896 00010000:00010000:0.0:1746147190.994695:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.994703:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147190.994709:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147190.994715:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9120640 00010000:00010000:0.0:1746147190.994780:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49800/0xb4b2209fbdac7373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.994789:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.994794:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147190.994795:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147190.994797:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48c00, rc 0) 00000100:00100000:0.0:1746147190.994811:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29069:x1830967463851520:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 209us (282us total) trans 8589944312 rc 0/0 00000100:00100000:0.0:1746147190.994815:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10555 00000100:00100000:0.0:1746147191.000472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.000722:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851648 00000100:00100000:3.0:1746147191.000729:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851648 00010000:00010000:3.0:1746147191.000762:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 37 pid: 8481 timeout: 677 lvb_type: 0 00000100:00100000:3.0:1746147191.000790:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5915 00000100:00100000:3.0:1746147191.000796:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463851648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.000809:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.000827:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 37 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147191.000836:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 37 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147191.000854:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b200/0xb4b2209fbdac7342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e704f expref: 37 pid: 8481 timeout: 677 lvb_type: 0 00010000:00010000:3.0:1746147191.000878:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.000879:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.000885:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.000892:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.000915:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.000924:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466442240:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.001493:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.003272:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466442240:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.003290:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.003321:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463851648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2525us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.003329:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5915 00000100:00100000:0.0:1746147191.008821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.009013:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463851904 00000100:00100000:3.0:1746147191.009021:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463851904 00002000:00100000:3.0:1746147191.009071:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80fb80 x1830967463851904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.009080:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80fb80 with x1830967463851904 ext(2097152->3145727) 00002000:00010000:3.0:1746147191.009085:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80fb80 00000100:00100000:3.0:1746147191.009114:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4612 00000100:00100000:3.0:1746147191.009121:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463851904:12345-192.168.203.36@tcp:3:cat.0 00000100:00080000:0.0:1746147191.009178:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147191.017827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.017959:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463852032 00000100:00100000:2.0:1746147191.017967:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463852032 00000100:00100000:2.0:1746147191.018002:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11897 00000100:00100000:2.0:1746147191.018008:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29071:x1830967463852032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.018023:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.018036:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7087 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.018061:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.018062:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.018068:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.018081:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 37 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.018088:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6b400, rc 0) 00000100:00100000:2.0:1746147191.018123:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:29071:x1830967463852032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.018128:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11897 00000100:00100000:2.0:1746147191.020059:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463851904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10933us (11238us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.020068:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4612 00002000:00100000:2.0:1746147191.020076:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80fb80 x1830967463851904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.020084:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80fb80 with x1830967463851904 ext(2097152->3145727) 00002000:00010000:2.0:1746147191.020096:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80fb80 00000100:00100000:0.0:1746147191.026377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.026443:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463852160 00000100:00100000:1.0:1746147191.026451:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463852160 00000100:00100000:1.0:1746147191.026506:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11898 00000100:00100000:1.0:1746147191.026513:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29065:x1830967463852160:12345-192.168.203.36@tcp:101:cat.0 00000100:00080000:0.0:1746147191.026520:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147191.026527:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.026540:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e708e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.026563:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.026579:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.026581:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.026585:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.026610:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.026620:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 43 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.026631:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466442368:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.026712:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.029288:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466442368:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.029314:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.029328:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f600, rc 0) 00000100:00100000:1.0:1746147191.029412:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29065:x1830967463852160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2898us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.029419:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11898 00000100:00100000:0.0:1746147191.030101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.030371:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463852288 00000100:00100000:2.0:1746147191.030378:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463852288 00002000:00100000:2.0:1746147191.030410:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (4161536->4194303) req@ffff88009a80d880 x1830967463852288/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.030418:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d880 with x1830967463852288 ext(4161536->4194303) 00010000:00010000:2.0:1746147191.030424:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 44 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.030437:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 44 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.030443:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80d880 00000100:00100000:2.0:1746147191.030470:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1579 00000100:00100000:2.0:1746147191.030476:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1957:x1830967463852288:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147191.034707:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463852288:12345-192.168.203.36@tcp:4:cat.0 Request processed in 4223us (4598us total) trans 17179873244 rc 0/0 00000100:00100000:2.0:1746147191.034716:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1579 00002000:00100000:2.0:1746147191.034725:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (4161536->4194303) req@ffff88009a80d880 x1830967463852288/t17179873244(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.034733:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d880 with x1830967463852288 ext(4161536->4194303) 00010000:00010000:2.0:1746147191.034741:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.034753:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.034760:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80d880 00000100:00100000:0.0:1746147191.058728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.058771:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.058800:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463852416 00000100:00100000:1.0:1746147191.058807:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463852416 00000100:00100000:0.0:1746147191.058816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.058830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.058837:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463852672 00000100:00100000:2.0:1746147191.058841:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463852672 00000100:00100000:0.0:1746147191.058853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147191.058867:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80c000 x1830967463852672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.058875:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c000 with x1830967463852672 ext(2097152->3145727) 00002000:00010000:2.0:1746147191.058880:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c000 00000100:00100000:0.0:1746147191.058884:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853056 00000100:00100000:0.0:1746147191.058887:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853056 00002000:00100000:0.0:1746147191.058904:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80dc00 x1830967463853056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.058912:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80dc00 with x1830967463853056 ext(2097152->3145727) 00010000:00010000:0.0:1746147191.058918:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.058930:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:0.0:1746147191.058959:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80dc00 00000100:00100000:1.0:1746147191.059633:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11899 00000100:00100000:1.0:1746147191.059641:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29069:x1830967463852416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.059652:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.059667:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7095 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.059689:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.059693:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853184 00000100:00100000:2.0:1746147191.059696:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853184 00010000:00010000:1.0:1746147191.059696:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.059702:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746147191.059708:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4161535) req@ffff88009a80c380 x1830967463853184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147191.059712:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.059714:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746147191.059715:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c380 with x1830967463853184 ext(3145728->4161535) 00010000:00010000:1.0:1746147191.059717:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1073152->1683455] (req 1073152->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.059719:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.059727:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.059731:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80c380 00010000:00010000:1.0:1746147191.059740:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.059748:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 37 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.059757:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442496:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.059779:0:21473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853312 00000100:00100000:0.0:1746147191.059783:0:21473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853312 00002000:00100000:0.0:1746147191.059801:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009a80ce00 x1830967463853312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.059808:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ce00 with x1830967463853312 ext(3145728->4194303) 00002000:00010000:0.0:1746147191.059812:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80ce00 00000100:00100000:2.0:1746147191.059816:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1580 00010000:00010000:1.0:1746147191.059819:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147191.059822:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967463853056:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147191.059827:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 11 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.059829:0:21473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1581 00000100:00100000:1.0:1746147191.059834:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442624:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.059835:0:21473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967463853184:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:1.0:1746147191.059855:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.059861:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.059871:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442752:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.059883:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.059987:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4613 00000100:00100000:1.0:1746147191.059992:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463852672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.060152:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4614 00000100:00100000:3.0:1746147191.060158:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463853312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.065137:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442496:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.065170:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442624:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.065180:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466442752:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.065185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.065209:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1073152->1683455] (req 1073152->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.065224:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491f800, rc 0) 00000100:00100000:2.0:1746147191.065259:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29069:x1830967463852416:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5619us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.065269:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11899 00000100:00100000:1.0:1746147191.065347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.065366:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853568 00000100:00100000:2.0:1746147191.065372:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853568 00010000:00010000:2.0:1746147191.065410:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.065425:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853696 00000100:00100000:2.0:1746147191.065427:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853696 00010000:00010000:2.0:1746147191.065435:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.065446:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5916 00000100:00100000:2.0:1746147191.065451:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463853568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.065460:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147191.065468:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5917 00010000:00010000:2.0:1746147191.065475:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.065476:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463853696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1746147191.065482:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746147191.065483:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.065483:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.065499:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f49600/0xb4b2209fbdac71ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f3e expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.065500:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.065509:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.066815:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeba00/0xb4b2209fbdac70c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e7a expref: 31 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.066838:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.066869:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463853696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1393us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.066874:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5917 00010000:00010000:2.0:1746147191.066927:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.066983:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463853568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1530us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.066991:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5916 00000100:00100000:0.0:1746147191.070661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.070729:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463853824 00000100:00100000:2.0:1746147191.071535:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463853824 00010000:00010000:2.0:1746147191.071577:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 41 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.071615:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5918 00000100:00100000:2.0:1746147191.071622:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463853824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.071633:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.071651:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 41 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.071660:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 41 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.071678:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4afa00/0xb4b2209fbdac7119 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6ec0 expref: 41 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.071691:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.071692:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.071699:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.071706:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.071734:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.071745:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466442880:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.072205:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.072256:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463852672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12262us (13482us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147191.072264:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4613 00002000:00100000:1.0:1746147191.072272:0:8486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009a80c000 x1830967463852672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.072280:0:8486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c000 with x1830967463852672 ext(2097152->3145727) 00002000:00010000:1.0:1746147191.072284:0:8486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80c000 00000100:00100000:2.0:1746147191.079177:0:21473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1956:x1830967463853184:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19334us (20337us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746147191.079186:0:21473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1581 00002000:00100000:2.0:1746147191.079195:0:21473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4161535) req@ffff88009a80c380 x1830967463853184/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.079203:0:21473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80c380 with x1830967463853184 ext(3145728->4161535) 00010000:00010000:2.0:1746147191.079212:0:21473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 48 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.079223:0:21473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 48 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.079229:0:21473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80c380 00000100:00100000:2.0:1746147191.080584:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466442880:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.080600:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.080755:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463853824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9132us (10099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.080764:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5918 00000100:00100000:3.0:1746147191.080791:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463853312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20631us (21935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.080799:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4614 00002000:00100000:3.0:1746147191.080808:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009a80ce00 x1830967463853312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.080816:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80ce00 with x1830967463853312 ext(3145728->4194303) 00002000:00010000:3.0:1746147191.080821:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80ce00 00000100:00100000:0.0:1746147191.081454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.081492:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463854080 00000100:00100000:3.0:1746147191.081497:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463854080 00002000:00100000:3.0:1746147191.081522:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1073152->1077247) req@ffff88009a80e680 x1830967463854080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.081529:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e680 with x1830967463854080 ext(1073152->1077247) 00002000:00010000:3.0:1746147191.081532:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80e680 00000100:00100000:3.0:1746147191.081545:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4615 00000100:00100000:3.0:1746147191.081549:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463854080:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147191.081663:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463854080:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 112us (209us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147191.081667:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4615 00002000:00100000:3.0:1746147191.081671:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1073152->1077247) req@ffff88009a80e680 x1830967463854080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.081677:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e680 with x1830967463854080 ext(1073152->1077247) 00002000:00010000:3.0:1746147191.081680:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80e680 00000100:00100000:2.0:1746147191.081838:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463853056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22015us (23020us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.081845:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1580 00002000:00100000:2.0:1746147191.081851:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80dc00 x1830967463853056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.081858:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80dc00 with x1830967463853056 ext(2097152->3145727) 00010000:00010000:2.0:1746147191.081864:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.081875:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 46 pid: 8481 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.081881:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a80dc00 00000100:00100000:0.0:1746147191.084054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.084139:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463854336 00000100:00100000:2.0:1746147191.084147:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463854336 00002000:00100000:2.0:1746147191.084178:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009a80d180 x1830967463854336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.084186:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d180 with x1830967463854336 ext(4194304->4947967) 00002000:00010000:2.0:1746147191.084190:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80d180 00000100:00100000:2.0:1746147191.084219:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4616 00000100:00100000:2.0:1746147191.084225:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463854336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.084889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.087314:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463854464 00000100:00100000:3.0:1746147191.087324:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463854464 00000100:00100000:3.0:1746147191.087362:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11900 00000100:00100000:3.0:1746147191.087369:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+46:29071:x1830967463854464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.087382:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.087396:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e709c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.087416:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.087420:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 47 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.087430:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 47 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.087438:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d607600, rc 0) 00000100:00100000:3.0:1746147191.087487:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:29071:x1830967463854464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (2600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.087492:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11900 00000100:00100000:1.0:1746147191.090954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.090975:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463854720 00000100:00100000:1.0:1746147191.090979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.090984:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463854720 00010000:00010000:2.0:1746147191.091017:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.091041:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5919 00000100:00100000:2.0:1746147191.091048:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1959:x1830967463854720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.091061:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.091077:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.091087:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.091104:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac733b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7048 expref: 47 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.091117:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.091119:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.091125:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.091131:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.091137:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.091138:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.091140:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 46 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.091145:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 46 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.091165:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 46 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.091179:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466443008:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.091247:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463854848 00000100:00100000:3.0:1746147191.091251:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463854848 00002000:00100000:3.0:1746147191.091274:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1679360->1683455) req@ffff88009b6b9f80 x1830967463854848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.091283:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9f80 with x1830967463854848 ext(1679360->1683455) 00002000:00010000:3.0:1746147191.091287:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b9f80 00000100:00100000:3.0:1746147191.091304:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4617 00000100:00100000:3.0:1746147191.091310:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463854848:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:2.0:1746147191.091554:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.091555:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463854848:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 243us (573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147191.091561:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4617 00000100:00100000:2.0:1746147191.091562:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466443136:192.168.203.36@tcp:105: 00002000:00100000:3.0:1746147191.091567:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1679360->1683455) req@ffff88009b6b9f80 x1830967463854848/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.091582:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9f80 with x1830967463854848 ext(1679360->1683455) 00002000:00010000:3.0:1746147191.091585:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b6b9f80 00000100:00100000:2.0:1746147191.091594:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.092044:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463854336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7819us (8000us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746147191.092049:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4616 00002000:00100000:2.0:1746147191.092053:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009a80d180 x1830967463854336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.092058:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d180 with x1830967463854336 ext(4194304->4947967) 00002000:00010000:2.0:1746147191.092060:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a80d180 00000100:00100000:2.0:1746147191.097308:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466443008:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.097681:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466443136:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.097697:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.097749:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1959:x1830967463854720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6700us (6809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.097758:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5919 00000100:00100000:0.0:1746147191.098612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.098644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.098710:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463855104 00000100:00100000:2.0:1746147191.098716:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463855104 00002000:00100000:2.0:1746147191.098743:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80f480 x1830967463855104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.098757:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f480 with x1830967463855104 ext(2097152->3145727) 00002000:00010000:2.0:1746147191.098762:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f480 00000100:00100000:2.0:1746147191.098774:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463855232 00000100:00100000:2.0:1746147191.098776:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463855232 00002000:00100000:2.0:1746147191.098786:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009a80e300 x1830967463855232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.098792:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463855232 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.098794:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:2.0:1746147191.098815:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4618 00000100:00100000:2.0:1746147191.098822:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1959:x1830967463855104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.098828:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4619 00000100:00100000:3.0:1746147191.098836:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1958:x1830967463855232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.103237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.103266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.103290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.103304:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463855744 00000100:00100000:0.0:1746147191.103310:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463855744 00002000:00100000:0.0:1746147191.103338:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80d500 x1830967463855744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.103346:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d500 with x1830967463855744 ext(2097152->3145727) 00002000:00010000:0.0:1746147191.103350:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80d500 00000100:00100000:0.0:1746147191.103360:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463855872 00000100:00100000:0.0:1746147191.103362:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463855872 00002000:00100000:0.0:1746147191.103368:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4faea00 x1830967463855872/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.103374:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faea00 with x1830967463855872 ext(3145728->4194303) 00002000:00010000:0.0:1746147191.103376:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faea00 00000100:00100000:0.0:1746147191.103381:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463856128 00000100:00100000:0.0:1746147191.103382:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463856128 00002000:00100000:0.0:1746147191.103390:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a4fae300 x1830967463856128/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.103395:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967463856128 ext(3145728->4194303) 00002000:00010000:0.0:1746147191.103398:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:0.0:1746147191.103419:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4620 00000100:00100000:0.0:1746147191.103424:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463855744:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147191.104404:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4621 00000100:00100000:0.0:1746147191.104411:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463855872:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147191.105335:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4622 00000100:00100000:0.0:1746147191.105341:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463856128:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147191.122855:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1959:x1830967463855104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24026us (24238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.122864:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4618 00002000:00100000:3.0:1746147191.122873:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80f480 x1830967463855104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.122881:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f480 with x1830967463855104 ext(2097152->3145727) 00002000:00010000:3.0:1746147191.122885:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f480 00000100:00100000:3.0:1746147191.123780:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1958:x1830967463855232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24944us (25133us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.123786:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4619 00002000:00100000:3.0:1746147191.123792:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009a80e300 x1830967463855232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.123799:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80e300 with x1830967463855232 ext(3145728->4194303) 00002000:00010000:3.0:1746147191.123803:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80e300 00000100:00100000:2.0:1746147191.127609:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463855744:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 24176us (24374us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.127621:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4620 00002000:00100000:2.0:1746147191.127630:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009a80d500 x1830967463855744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.127638:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80d500 with x1830967463855744 ext(2097152->3145727) 00002000:00010000:2.0:1746147191.127643:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80d500 00000100:00100000:1.0:1746147191.128442:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463855872:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 24030us (25172us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147191.128448:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4621 00002000:00100000:1.0:1746147191.128453:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4faea00 x1830967463855872/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.128460:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faea00 with x1830967463855872 ext(3145728->4194303) 00002000:00010000:1.0:1746147191.128463:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faea00 00000100:00100000:2.0:1746147191.131948:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463856128:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 26587us (28636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.131960:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4622 00002000:00100000:2.0:1746147191.131969:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a4fae300 x1830967463856128/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.131982:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fae300 with x1830967463856128 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.131987:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fae300 00000100:00100000:0.0:1746147191.137797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.137852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.137865:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463856384 00000100:00100000:2.0:1746147191.137877:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463856384 00002000:00100000:2.0:1746147191.137910:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a4fac700 x1830967463856384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.137917:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac700 with x1830967463856384 ext(4194304->4947967) 00002000:00010000:2.0:1746147191.137920:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac700 00000100:00100000:2.0:1746147191.139019:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4623 00000100:00100000:2.0:1746147191.139028:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463856384:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147191.139296:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463856512 00000100:00100000:1.0:1746147191.139301:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463856512 00000100:00100000:1.0:1746147191.139333:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11901 00000100:00100000:1.0:1746147191.139337:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463856512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.139345:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.139357:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9de00/0xb4b2209fbdac73a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70a3 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.139398:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466443264:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.139470:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.142506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.142525:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463856640 00000100:00100000:0.0:1746147191.142531:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463856640 00000100:00100000:0.0:1746147191.142588:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10556 00000100:00100000:0.0:1746147191.142595:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+6:29075:x1830967463856640:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147191.142613:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.142625:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278c00/0xb4b2209fbdac73ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70aa expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.142670:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142680:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142690:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142699:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142704:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142708:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142793:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142802:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.142808:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.142813:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147191.142835:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.142843:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.142850:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466443392:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147191.142917:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.142924:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.142931:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466443520:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.142986:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbc780 going to sleep for 11 seconds 00000100:00080000:1.0:1746147191.143135:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:1.0:1746147191.143166:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147189 -> 1746147190 00002000:00010000:1.0:1746147191.143169:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147189 -> 1746147190 00002000:00010000:1.0:1746147191.143170:0:8481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147189 -> 1746147190 00000100:00100000:1.0:1746147191.143184:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466443264:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.143202:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9de00/0xb4b2209fbdac73a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70a3 expref: 37 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.143211:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9de00/0xb4b2209fbdac73a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70a3 expref: 37 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.143222:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9de00, rc 0) 00000100:00100000:1.0:1746147191.143246:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463856512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3907us (5393us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.143252:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11901 00000100:00100000:0.0:1746147191.147463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.147489:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466443392:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.147499:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466443520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.147523:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147191.147530:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463856896 00000100:00100000:3.0:1746147191.147540:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463856896 00000100:00100000:3.0:1746147191.147592:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4192 00000100:00100000:3.0:1746147191.147599:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:19601:x1830967463856896:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147191.147960:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:19601:x1830967463856896:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 360us (503us total) trans 8589944313 rc 0/0 00000100:00100000:3.0:1746147191.147966:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4192 00000100:00100000:0.0:1746147191.148620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.148823:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857024 00000100:00100000:3.0:1746147191.148828:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857024 00010000:00010000:3.0:1746147191.148844:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.148869:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5920 00000100:00100000:3.0:1746147191.148875:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967463857024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.148883:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.148887:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.148895:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.148911:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48200/0xb4b2209fbdac731f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7033 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.148921:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.148924:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.148931:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.148951:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.148956:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.148975:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967463857024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.148980:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5920 00000100:00100000:0.0:1746147191.149039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.149320:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857152 00000100:00100000:1.0:1746147191.149324:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857152 00000100:00100000:1.0:1746147191.149345:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11902 00000100:00100000:1.0:1746147191.149350:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463857152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.149359:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.149369:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9dc00/0xb4b2209fbdac73c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70b1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.149403:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466443648:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.149452:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.149740:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463856384:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10712us (11948us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746147191.149747:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4623 00002000:00100000:2.0:1746147191.149754:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a4fac700 x1830967463856384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 753664/753664 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.149761:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac700 with x1830967463856384 ext(4194304->4947967) 00002000:00010000:2.0:1746147191.149765:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac700 00000100:00100000:0.0:1746147191.156378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.157158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.157175:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857280 00000100:00100000:1.0:1746147191.157183:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857280 00000100:00100000:1.0:1746147191.157216:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11903 00000100:00100000:1.0:1746147191.157222:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+46:29073:x1830967463857280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.157238:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.157250:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70b8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.157272:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466443648:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.157273:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.157280:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.157285:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.157292:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9dc00/0xb4b2209fbdac73c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b1 expref: 37 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.157294:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.157296:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.157299:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1576960->2097151] (req 1576960->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 47 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.157301:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9dc00/0xb4b2209fbdac73c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b1 expref: 37 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.157313:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9dc00, rc 0) 00010000:00010000:1.0:1746147191.157319:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.157327:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.157336:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466443776:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.157341:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463857152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7992us (8303us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.157347:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11902 00000100:00100000:3.0:1746147191.157411:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857408 00000100:00100000:3.0:1746147191.157414:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857408 00010000:00010000:3.0:1746147191.157435:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 14 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.157453:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5921 00000100:00100000:3.0:1746147191.157462:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463857408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.157470:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.157475:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 14 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.157482:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 14 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.157495:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48c00/0xb4b2209fbdac737a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7080 expref: 14 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.157520:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.157525:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157533:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157539:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157553:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.157582:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463857408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.157587:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5921 00010000:00010000:1.0:1746147191.157623:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 9 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.157632:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 9 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.157640:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466443904:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.157648:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157655:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.157670:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.157677:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 26 pid: 4444 timeout: 678 lvb_type: 0 00000004:00200000:3.0:1746147191.157686:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:3.0:1746147191.157690:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746147191.157690:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466444032:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.157706:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e209c0 going to sleep for 11 seconds 00000004:00010000:3.0:1746147191.157707:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157715:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157721:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157727:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157731:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157736:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6278a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.157739:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157743:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157751:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147191.157753:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.157756:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157760:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278a00/0xb4b2209fbdac73b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157769:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157778:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157782:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157786:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6278400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.157788:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157792:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157797:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3f6800) 00010000:00010000:3.0:1746147191.157799:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.157801:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157805:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278400/0xb4b2209fbdac73b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.157830:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278c00/0xb4b2209fbdac73ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.157839:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 7 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.157844:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.157846:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147191.157848:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6278600, rc 0) 00000100:00100000:3.0:1746147191.157868:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:29075:x1830967463856640:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 15273us (15367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.157873:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10556 00000100:00100000:1.0:1746147191.159617:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466443776:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.159628:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466443904:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.159635:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466444032:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.159653:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1576960->2097151] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 47 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.159666:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9d400, rc 0) 00000100:00100000:1.0:1746147191.160117:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+47:29073:x1830967463857280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2893us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.160125:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11903 00000100:00100000:0.0:1746147191.160814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.162115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.162287:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857536 00000100:00100000:3.0:1746147191.162293:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857536 00010000:00010000:3.0:1746147191.162335:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 10 pid: 8480 timeout: 678 lvb_type: 1 00000100:00080000:1.0:1746147191.162337:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147191.162365:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857664 00000100:00100000:3.0:1746147191.162368:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857664 00000100:00100000:0.0:1746147191.162372:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5922 00010000:00010000:3.0:1746147191.162377:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.162380:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463857536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147191.162390:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5923 00010000:00010000:0.0:1746147191.162390:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147191.162393:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967463857664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.162398:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.162406:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.162406:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 10 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.162414:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.162528:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 10 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.162550:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491fc00/0xb4b2209fbdac7001 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6dee expref: 47 pid: 8481 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.162552:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea19400/0xb4b2209fbdac706a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e2d expref: 10 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.162561:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.162600:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463857664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.162605:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5923 00010000:00010000:0.0:1746147191.162612:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.162626:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463857536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 247us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.162631:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5922 00000100:00100000:0.0:1746147191.162898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.162930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.162962:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857920 00000100:00100000:2.0:1746147191.162966:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857920 00010000:00010000:2.0:1746147191.162978:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 27 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.162992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.162998:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5924 00000100:00100000:2.0:1746147191.163003:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463857920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147191.163006:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463857792 00000100:00100000:0.0:1746147191.163008:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463857792 00010000:00010000:2.0:1746147191.163010:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.163018:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 27 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.163026:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 27 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.163034:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858048 00000100:00100000:0.0:1746147191.163035:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858048 00010000:00010000:2.0:1746147191.163037:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d65800/0xb4b2209fbdac6ff3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6de0 expref: 27 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.163047:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11904 00010000:00010000:2.0:1746147191.163051:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147191.163051:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463857792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.163053:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.163059:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 46 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.163061:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.163066:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 46 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.163068:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac73d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70bf expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.163091:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 47 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.163094:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f451880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466444160:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.163099:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466444288:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147191.163133:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4fbcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.163140:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11905 00000100:00100000:3.0:1746147191.163146:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463858048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.163153:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.163160:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d607200/0xb4b2209fbdac73dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70c6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.163181:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466444416:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.163217:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.163313:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.164890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.164918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.165386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.166181:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858304 00000100:00100000:1.0:1746147191.166181:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858560 00000100:00100000:2.0:1746147191.166189:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858304 00000100:00100000:1.0:1746147191.166189:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858560 00000100:00100000:1.0:1746147191.166220:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858176 00000100:00100000:1.0:1746147191.166222:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858176 00000100:00100000:0.0:1746147191.166312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:0.0:1746147191.166584:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147189 -> 1746147190 00002000:00010000:0.0:1746147191.166587:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147189 -> 1746147190 00002000:00010000:0.0:1746147191.166589:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147189 -> 1746147190 00000100:00100000:0.0:1746147191.166604:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f451880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466444160:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147191.166623:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac73d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70bf expref: 47 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.166634:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac73d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70bf expref: 47 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.166644:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6278200, rc 0) 00000100:00100000:0.0:1746147191.166671:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463857792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3619us (3774us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147191.166677:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11904 00000100:00100000:2.0:1746147191.166870:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858432 00000100:00100000:2.0:1746147191.166874:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858432 00000100:00100000:2.0:1746147191.166894:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11906 00000100:00100000:2.0:1746147191.166899:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463858560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.166911:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.166921:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70e2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.166935:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.166950:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.166958:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.166973:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.166981:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64e00, rc 0) 00000100:00100000:2.0:1746147191.166996:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463858560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 97us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.167001:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11906 00000100:00100000:2.0:1746147191.167011:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11907 00000100:00100000:2.0:1746147191.167016:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463858304:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.167022:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.167029:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac73ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70d4 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.167055:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466444544:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.167086:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.167097:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11908 00000100:00100000:2.0:1746147191.167102:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463858176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.167107:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.167112:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e811400/0xb4b2209fbdac73f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70cd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.167128:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466444672:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.167143:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.167164:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11909 00000100:00100000:2.0:1746147191.167169:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463858432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.167174:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.167179:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70db expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.167188:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.167189:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.167193:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.167202:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.167208:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009491ea00, rc 0) 00000100:00100000:2.0:1746147191.167220:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463858432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 51us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.167224:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11909 00000100:00100000:3.0:1746147191.168421:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466444288:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.168433:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.168451:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463857920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5448us (5521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.168459:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5924 00000100:00100000:0.0:1746147191.168539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.168648:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463858816 00000100:00100000:2.0:1746147191.168652:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463858816 00002000:00100000:2.0:1746147191.168672:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1576960->1581055) req@ffff88009f451880 x1830967463858816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.168679:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451880 with x1830967463858816 ext(1576960->1581055) 00002000:00010000:2.0:1746147191.168683:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451880 00000100:00100000:2.0:1746147191.168694:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4624 00000100:00100000:2.0:1746147191.168698:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463858816:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.169100:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466444416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.169117:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d607200/0xb4b2209fbdac73dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.169126:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d607200/0xb4b2209fbdac73dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70c6 expref: 37 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.169134:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d607200, rc 0) 00000100:00100000:2.0:1746147191.169277:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463858816:12345-192.168.203.36@tcp:3:cat.0 Request processed in 577us (737us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147191.169284:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4624 00002000:00100000:2.0:1746147191.169289:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1576960->1581055) req@ffff88009f451880 x1830967463858816/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147191.169290:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463858048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6145us (6299us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.169295:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11905 00002000:00100000:2.0:1746147191.169295:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451880 with x1830967463858816 ext(1576960->1581055) 00002000:00010000:2.0:1746147191.169298:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f451880 00000100:00100000:2.0:1746147191.171493:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466444672:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.171516:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e811400/0xb4b2209fbdac73f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70cd expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.171527:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e811400/0xb4b2209fbdac73f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70cd expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.171536:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e811400, rc 0) 00000100:00100000:2.0:1746147191.171563:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463858176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4460us (6178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.171582:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11908 00000100:00100000:3.0:1746147191.171613:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466444544:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.171627:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac73ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70d4 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.171635:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac73ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70d4 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.171642:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65e00, rc 0) 00000100:00100000:3.0:1746147191.171655:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463858304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4639us (6769us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.171659:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11907 00000100:00100000:0.0:1746147191.174794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.174971:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859072 00000100:00100000:3.0:1746147191.174978:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859072 00000100:00100000:3.0:1746147191.175017:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10557 00000100:00100000:3.0:1746147191.175023:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+7:29075:x1830967463859072:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.175036:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.175049:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607400/0xb4b2209fbdac73ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70e9 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.175117:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.175129:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.175135:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.175158:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.175167:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 8 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.175177:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466444800:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.175246:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.177314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.177358:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859200 00000100:00100000:3.0:1746147191.177364:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859200 00000100:00100000:3.0:1746147191.177392:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11910 00000100:00100000:3.0:1746147191.177398:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+46:29073:x1830967463859200:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147191.177403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147191.177408:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.177422:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70f0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.177442:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.177449:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.177455:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.177460:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.177462:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.177464:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 47 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.177466:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466444800:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.177482:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.177482:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.177491:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.178646:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466444928:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.178730:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 9 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.178739:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 9 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.178872:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445056:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.178900:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 25 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.178907:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 25 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.178915:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445184:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.178927:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.179085:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859328 00000100:00100000:3.0:1746147191.179089:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859328 00010000:00010000:3.0:1746147191.179109:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.179125:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5925 00000100:00100000:3.0:1746147191.179130:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463859328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.179138:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.179143:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.179151:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.179166:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278600/0xb4b2209fbdac73c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70aa expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.179181:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.179185:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.179192:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.179197:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.179220:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.179249:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:1959:x1830967463859328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.179254:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5925 00010000:00010000:2.0:1746147191.179449:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.179455:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147191.179470:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147191.179567:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607400/0xb4b2209fbdac73ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.179591:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.179597:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.179599:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147191.179601:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d607000, rc 0) 00000100:00100000:2.0:1746147191.179634:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463859072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4611us (4845us total) trans 8589944314 rc 0/0 00000100:00100000:2.0:1746147191.179640:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10557 00000100:00100000:3.0:1746147191.181506:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466444928:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.182378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.182426:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859456 00000100:00100000:2.0:1746147191.182431:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859456 00000100:00100000:3.0:1746147191.182435:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445056:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.182460:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10558 00000100:00100000:2.0:1746147191.182467:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463859456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.182483:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.182496:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65200/0xb4b2209fbdac741b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70f7 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.182553:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.182565:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.182587:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.182610:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.182618:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.182627:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466445312:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.182700:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.183769:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445184:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.183796:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 47 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.183808:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6a400, rc 0) 00000100:00100000:3.0:1746147191.183845:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+47:29073:x1830967463859200:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6446us (6534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.183851:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11910 00000100:00100000:0.0:1746147191.183933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.184007:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859712 00000100:00100000:2.0:1746147191.184010:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859712 00000100:00100000:0.0:1746147191.184014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.184027:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.184037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.184042:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859584 00000100:00100000:2.0:1746147191.184043:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859584 00010000:00010000:2.0:1746147191.184051:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.184061:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859840 00000100:00100000:2.0:1746147191.184063:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859840 00000100:00100000:0.0:1746147191.184064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.184070:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 26 pid: 4444 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.184074:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463859968 00000100:00100000:0.0:1746147191.184076:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463859968 00000100:00100000:2.0:1746147191.184079:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5926 00000100:00100000:2.0:1746147191.184083:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463859712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.184085:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 10 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184092:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147191.184095:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5927 00000100:00100000:0.0:1746147191.184100:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967463859584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.184105:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.184106:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.184110:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184115:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.184210:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5928 00000100:00100000:3.0:1746147191.184216:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463859840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.184222:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.184396:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.184411:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbe800/0xb4b2209fbdac70be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e73 expref: 47 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184490:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49400/0xb4b2209fbdac71b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f37 expref: 10 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.184499:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 26 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184499:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147191.184505:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 26 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.184515:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cbf200/0xb4b2209fbdac70a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6e65 expref: 26 pid: 4444 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.184613:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.184615:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.184620:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 46 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.184659:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967463859712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 575us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.184664:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5926 00000100:00100000:2.0:1746147191.184695:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5929 00000100:00100000:2.0:1746147191.184700:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463859968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.184706:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.184710:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 10 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184718:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 10 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.184728:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.184732:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184738:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184743:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184757:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.184774:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463859968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 73us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.184779:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5929 00010000:00010000:2.0:1746147191.184807:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7406 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e9 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.184816:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466445312:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.184828:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184834:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184838:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147191.184865:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:2.0:1746147191.184868:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147191.184878:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.184900:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65200/0xb4b2209fbdac741b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f7 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.184909:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f7 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.184914:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.184916:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147191.184918:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64200, rc 0) 00000100:00100000:2.0:1746147191.184953:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463859456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2470us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.184959:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10558 00010000:00010000:3.0:1746147191.185752:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 46 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.185782:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.185800:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463859584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1699us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.185806:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5927 00010000:00010000:3.0:1746147191.186016:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 45 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.186027:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466445440:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.186075:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.190187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.190221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.190275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.190344:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463860096 00000100:00100000:3.0:1746147191.190351:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463860096 00000100:00100000:3.0:1746147191.190394:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463860352 00000100:00100000:3.0:1746147191.190396:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463860352 00000100:00100000:3.0:1746147191.190407:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463860224 00000100:00100000:3.0:1746147191.190408:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463860224 00000100:00100000:3.0:1746147191.190419:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11911 00000100:00100000:3.0:1746147191.190424:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463860096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.190436:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.190449:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49800/0xb4b2209fbdac7429 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e70fe expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.190486:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466445568:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.190515:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11912 00000100:00100000:1.0:1746147191.190521:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463860352:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147191.190527:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.190535:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac7430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e710c expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.190540:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.190555:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11913 00000100:00100000:3.0:1746147191.190559:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463860224:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147191.190561:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466445696:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.190564:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.190580:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49e00/0xb4b2209fbdac7437 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7105 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.190595:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.190598:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445824:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.190613:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.191704:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466445440:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.191741:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.191774:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463859840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7558us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.191782:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5928 00000100:00100000:0.0:1746147191.192783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.192895:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463860608 00000100:00100000:2.0:1746147191.192900:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463860608 00002000:00100000:2.0:1746147191.192924:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1114112->1118207) req@ffff88009f450000 x1830967463860608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.192932:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450000 with x1830967463860608 ext(1114112->1118207) 00002000:00010000:2.0:1746147191.192952:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450000 00000100:00100000:2.0:1746147191.193261:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4625 00000100:00100000:2.0:1746147191.193268:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463860608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.193324:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466445568:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.193347:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f49800/0xb4b2209fbdac7429 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70fe expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.193358:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49800/0xb4b2209fbdac7429 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70fe expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.193367:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49800, rc 0) 00000100:00100000:3.0:1746147191.193396:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463860096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2971us (3214us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.193402:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11911 00000100:00100000:2.0:1746147191.193550:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1957:x1830967463860608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 282us (768us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147191.193555:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4625 00002000:00100000:2.0:1746147191.193560:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1114112->1118207) req@ffff88009f450000 x1830967463860608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147191.193563:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466445696:192.168.203.36@tcp:106: 00002000:00100000:2.0:1746147191.193566:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450000 with x1830967463860608 ext(1114112->1118207) 00002000:00010000:2.0:1746147191.193581:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f450000 00010000:00010000:0.0:1746147191.193590:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac7430 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e710c expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.193599:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac7430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e710c expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.193606:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9c000, rc 0) 00000100:00100000:0.0:1746147191.193964:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463860352:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3441us (3740us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147191.193969:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11912 00002000:00010000:3.0:1746147191.194815:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147189 -> 1746147190 00002000:00010000:3.0:1746147191.194819:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147189 -> 1746147190 00002000:00010000:3.0:1746147191.194821:0:8478:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147189 -> 1746147190 00000100:00100000:3.0:1746147191.194829:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466445824:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.194843:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f49e00/0xb4b2209fbdac7437 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7105 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.194851:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49e00/0xb4b2209fbdac7437 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7105 expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.194857:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49e00, rc 0) 00000100:00100000:3.0:1746147191.194877:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463860224:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4318us (4603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.194882:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11913 00000100:00100000:0.0:1746147191.195476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.195550:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463860864 00000100:00100000:1.0:1746147191.195555:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463860864 00000100:00100000:1.0:1746147191.195597:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4193 00000100:00100000:1.0:1746147191.195603:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29073:x1830967463860864:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147191.196081:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29073:x1830967463860864:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 477us (605us total) trans 8589944315 rc 0/0 00000100:00100000:1.0:1746147191.196087:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4193 00000100:00100000:0.0:1746147191.196515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.196684:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861120 00000100:00100000:2.0:1746147191.196688:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861120 00000100:00100000:2.0:1746147191.196709:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10559 00000100:00100000:2.0:1746147191.196714:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463861120:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.196724:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.196737:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac743e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7113 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.196787:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.196798:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.196806:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147191.196815:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147191.196871:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac743e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.196882:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.196889:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.196891:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147191.196893:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65800, rc 0) 00000100:00100000:2.0:1746147191.196927:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463861120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 212us (412us total) trans 8589944316 rc 0/0 00000100:00100000:2.0:1746147191.196932:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10559 00000100:00100000:2.0:1746147191.200207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.200306:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861248 00000100:00100000:2.0:1746147191.200312:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861248 00000100:00100000:2.0:1746147191.200333:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861504 00000100:00100000:2.0:1746147191.200334:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861504 00000100:00100000:2.0:1746147191.200342:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861760 00000100:00100000:2.0:1746147191.200343:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861760 00000100:00100000:2.0:1746147191.200349:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861376 00000100:00100000:2.0:1746147191.200351:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861376 00000100:00100000:2.0:1746147191.200357:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861632 00000100:00100000:2.0:1746147191.200358:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861632 00000100:00100000:2.0:1746147191.200362:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463861888 00000100:00100000:2.0:1746147191.200363:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463861888 00000100:00100000:2.0:1746147191.200370:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11914 00000100:00100000:2.0:1746147191.200376:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463861248:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147191.200403:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200416:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200424:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.200429:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.200438:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.200440:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.200442:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200466:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 29 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.200476:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 29 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.200486:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466445952:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.200545:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.200552:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 14 pid: 8481 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.200558:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466446080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.200590:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200597:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 35 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.200608:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466446208:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.200624:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.200642:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11915 00000100:00100000:2.0:1746147191.200647:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463861504:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147191.200664:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200673:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 45 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200678:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.200679:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.200681:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200694:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 45 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200701:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 45 pid: 8478 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.200707:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466446336:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.200724:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.200737:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11916 00000100:00100000:2.0:1746147191.200741:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463861760:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147191.200755:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200763:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200768:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.200774:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200778:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.200779:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.200781:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200796:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.200803:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.200810:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466446464:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.200860:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11917 00000100:00100000:1.0:1746147191.200866:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463861376:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147191.200881:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.200889:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 45 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.200894:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.200895:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.200896:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.200908:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 45 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.200918:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 45 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.200924:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466446592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.200969:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e20840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.200989:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11918 00000100:00100000:1.0:1746147191.200994:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463861632:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147191.201007:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.201016:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.201020:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.201021:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.201022:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.201070:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11919 00000100:00100000:3.0:1746147191.201077:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463861888:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147191.201092:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201100:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201105:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.201110:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 45 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201121:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.201123:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.201125:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201138:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 45 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201144:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 45 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.201152:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446720:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.201176:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 11 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.201187:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 11 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.201194:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446848:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.201215:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.201222:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 24 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.201227:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446976:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.201239:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147191.201282:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.201290:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 29 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.201297:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466447104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.201311:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e209c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147191.202730:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.202744:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 14 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.202752:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466447232:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.202783:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.202790:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 29 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.202797:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466447360:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.202810:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.203103:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446720:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.203110:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446848:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.207464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.207499:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466446592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.207517:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.207744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.207762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.207773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.207782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.207797:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862016 00000100:00100000:0.0:1746147191.207802:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862016 00010000:00010000:0.0:1746147191.207823:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.207840:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862144 00000100:00100000:0.0:1746147191.207841:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862144 00010000:00010000:0.0:1746147191.207848:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 15 pid: 8481 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.207857:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862656 00000100:00100000:0.0:1746147191.207858:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862656 00010000:00010000:0.0:1746147191.207864:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.207874:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5930 00000100:00100000:0.0:1746147191.207879:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463862016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.207888:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.207903:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.207911:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.208179:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466445952:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.208189:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466446080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.208196:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466446208:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.208215:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.208232:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862400 00000100:00100000:2.0:1746147191.208235:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862400 00002000:00100000:2.0:1746147191.208255:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1576960->2097151) req@ffff88009f451500 x1830967463862400/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.208262:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463862400 ext(1576960->2097151) 00010000:00010000:2.0:1746147191.208268:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 46 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.208276:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 46 pid: 4445 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.208281:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f451500 00000100:00100000:2.0:1746147191.208292:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862272 00000100:00100000:2.0:1746147191.208294:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862272 00002000:00100000:2.0:1746147191.208303:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1118207) req@ffff88009ef7f100 x1830967463862272/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.208309:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f100 with x1830967463862272 ext(1048576->1118207) 00010000:00010000:2.0:1746147191.208313:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 47 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.208319:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 47 pid: 8478 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.208323:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7f100 00000100:00100000:2.0:1746147191.208332:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1582 00000100:00100000:2.0:1746147191.208336:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1956:x1830967463862400:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:0.0:1746147191.208711:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d64e00/0xb4b2209fbdac73e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70e2 expref: 12 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.208735:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.208771:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463862016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 891us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.208777:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5930 00000100:00100000:0.0:1746147191.208792:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5931 00000100:00100000:0.0:1746147191.208796:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463862144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.208803:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147191.209071:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466446336:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.209085:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.209106:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 15 pid: 8481 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.209108:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466446976:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147191.209115:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 15 pid: 8481 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.209126:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac72bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fed expref: 15 pid: 8481 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.209131:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.209133:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.209147:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463862144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 351us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.209153:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5932 00000100:00100000:3.0:1746147191.209159:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463862656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.209166:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.209176:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.209179:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466447104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.209183:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.209188:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.209194:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d50d600/0xb4b2209fbdac7246 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6f99 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.209204:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.209220:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463862656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.209221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.209385:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862528 00000100:00100000:2.0:1746147191.209388:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862528 00010000:00010000:2.0:1746147191.209398:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 30 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.209481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.209529:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5931 00000100:00100000:3.0:1746147191.209535:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5932 00000100:00100000:0.0:1746147191.209546:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862784 00000100:00100000:0.0:1746147191.209548:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862784 00000100:00100000:3.0:1746147191.209560:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1583 00002000:00100000:0.0:1746147191.209564:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1073152->1683455) req@ffff88009b6b9880 x1830967463862784/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147191.209566:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1956:x1830967463862272:12345-192.168.203.36@tcp:4:cat.0 00002000:00100000:0.0:1746147191.209579:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967463862784 ext(1073152->1683455) 00010000:00010000:0.0:1746147191.209583:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 31 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.209590:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 31 pid: 4445 timeout: 678 lvb_type: 0 00002000:00010000:0.0:1746147191.209595:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:0.0:1746147191.209609:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1584 00000100:00100000:0.0:1746147191.209614:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463862784:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147191.209969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.210024:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863168 00000100:00100000:3.0:1746147191.210027:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863168 00010000:00010000:3.0:1746147191.210039:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 25 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.210053:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5933 00000100:00100000:3.0:1746147191.210058:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463863168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.210064:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.210073:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 25 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.210080:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 25 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.210091:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491f600/0xb4b2209fbdac738f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e708e expref: 25 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.210098:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.210116:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463863168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.210121:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5933 00000100:00100000:2.0:1746147191.210221:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5934 00000100:00100000:2.0:1746147191.210228:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463862528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.210235:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.210243:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 31 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.210251:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 31 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.210262:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9e7a00/0xb4b2209fbdac7254 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6fa7 expref: 31 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.210270:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.210271:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.210274:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.210281:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.210296:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.211378:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463862528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 85us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.211389:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5934 00000100:00100000:2.0:1746147191.211461:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466446464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.211470:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466447232:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.211478:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466447360:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.211496:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211512:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211518:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211535:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211541:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211547:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211553:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d607000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.211556:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211561:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211584:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.211595:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d607000/0xb4b2209fbdac7453 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.211735:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463861248:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 11358us (11533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.211742:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11914 00000100:00100000:1.0:1746147191.213458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.214084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.214098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.214117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.215271:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463862912 00000100:00100000:2.0:1746147191.215279:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463862912 00010000:00010000:2.0:1746147191.215307:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 50 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.215328:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863296 00000100:00100000:2.0:1746147191.215330:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863296 00010000:00010000:2.0:1746147191.215340:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 31 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.215350:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863040 00000100:00100000:2.0:1746147191.215351:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863040 00010000:00010000:2.0:1746147191.215358:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 13 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.215365:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863424 00000100:00100000:2.0:1746147191.215366:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863424 00010000:00010000:2.0:1746147191.215373:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.215383:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5935 00000100:00100000:2.0:1746147191.215390:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463862912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.215399:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.215414:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 50 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215423:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 50 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215439:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d607600/0xb4b2209fbdac739d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e709c expref: 50 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215449:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.215451:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.215455:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215461:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215482:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.215517:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967463862912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 127us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215523:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5935 00000100:00100000:2.0:1746147191.215535:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5936 00000100:00100000:2.0:1746147191.215540:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463863296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.215546:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.215556:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 31 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215564:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 31 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215588:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7365 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7072 expref: 31 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215596:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.215611:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463863296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215616:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5936 00000100:00100000:2.0:1746147191.215624:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5937 00000100:00100000:2.0:1746147191.215628:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463863040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.215634:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.215640:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 13 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.215646:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 13 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.215655:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491ea00/0xb4b2209fbdac73f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70db expref: 13 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.215662:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.215674:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463863040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215681:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5937 00000100:00100000:2.0:1746147191.215689:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5938 00000100:00100000:2.0:1746147191.215693:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463863424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.215698:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.215704:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215712:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215721:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac7388 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7087 expref: 35 pid: 8481 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.215727:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.215728:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.215731:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215736:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215748:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.215761:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463863424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215765:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5938 00010000:00010000:2.0:1746147191.215782:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215790:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215804:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215810:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215816:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215820:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efdd200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.215823:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215829:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215837:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215841:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efdd200/0xb4b2209fbdac7461 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.215871:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463861760:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15130us (15621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215878:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11916 00010000:00010000:2.0:1746147191.215896:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215903:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215912:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215918:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215923:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215927:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099f48000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.215930:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215948:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215956:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.215961:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.215991:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463861888:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14914us (15699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.215995:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11919 00000100:00100000:3.0:1746147191.216930:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463862400:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8590us (9183us total) trans 17179873245 rc 0/0 00000100:00100000:3.0:1746147191.216954:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1582 00002000:00100000:3.0:1746147191.216963:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41c:0x0] (1576960->2097151) req@ffff88009f451500 x1830967463862400/t17179873245(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.216972:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f451500 with x1830967463862400 ext(1576960->2097151) 00010000:00010000:3.0:1746147191.216978:0:21471:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.216988:0:21471:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.217000:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f451500 00000100:00100000:2.0:1746147191.218868:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463862272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9296us (11098us total) trans 17179873246 rc 0/0 00000100:00100000:2.0:1746147191.218876:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1583 00002000:00100000:2.0:1746147191.218882:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1118207) req@ffff88009ef7f100 x1830967463862272/t17179873246(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.218890:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7f100 with x1830967463862272 ext(1048576->1118207) 00010000:00010000:2.0:1746147191.218898:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 49 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.218907:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 49 pid: 8478 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.218912:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef7f100 00000100:00100000:0.0:1746147191.224960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.225108:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863552 00000100:00100000:3.0:1746147191.225116:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863552 00010000:00010000:3.0:1746147191.225144:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.225164:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5939 00000100:00100000:3.0:1746147191.225169:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967463863552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.225178:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.225193:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.225203:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.225220:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9d400/0xb4b2209fbdac73ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70b8 expref: 49 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.225230:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.225231:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.225235:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.225242:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.225260:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.225286:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967463863552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.225291:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5939 00010000:00010000:0.0:1746147191.225973:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.225982:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.225998:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226004:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226011:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226017:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd9ce00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147191.226020:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226026:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226035:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.226041:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9ce00/0xb4b2209fbdac7468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.226095:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463861376:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 25228us (25832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.226102:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11917 00000100:00100000:0.0:1746147191.228030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.228079:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863680 00000100:00100000:3.0:1746147191.228087:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863680 00010000:00010000:3.0:1746147191.228109:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 48 pid: 8478 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.228139:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5940 00000100:00100000:3.0:1746147191.228144:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967463863680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.228154:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.228168:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 48 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.228176:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 48 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.228191:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa6a400/0xb4b2209fbdac740d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f0 expref: 48 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.228202:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.228203:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.228207:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228218:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228233:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.228268:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+47:1957:x1830967463863680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.228273:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5940 00010000:00010000:3.0:1746147191.228309:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228315:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228329:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228335:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228341:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228347:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009491fa00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147191.228350:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228360:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228369:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.228374:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009491fa00/0xb4b2209fbdac745a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.228406:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+8:1959:x1830967463861504:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 27758us (28169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.228411:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11915 00000100:00100000:2.0:1746147191.231469:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463862784:12345-192.168.203.36@tcp:4:cat.0 Request processed in 21849us (21981us total) trans 21474840654 rc 0/0 00000100:00100000:2.0:1746147191.231480:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1584 00002000:00100000:2.0:1746147191.231489:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1073152->1683455) req@ffff88009b6b9880 x1830967463862784/t21474840654(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.231497:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6b9880 with x1830967463862784 ext(1073152->1683455) 00010000:00010000:2.0:1746147191.231506:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.231518:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.231524:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b6b9880 00000100:00100000:0.0:1746147191.234488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.234553:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463863808 00000100:00100000:2.0:1746147191.234561:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463863808 00010000:00010000:2.0:1746147191.234595:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.234668:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5941 00000100:00100000:2.0:1746147191.234675:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463863808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.234688:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.234705:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.234715:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.234733:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009491f800/0xb4b2209fbdac7396 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7095 expref: 30 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.234745:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.234746:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.234750:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.234761:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.234874:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147191.235115:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235124:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235141:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235148:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235154:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235159:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd9d600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147191.235162:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235169:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235177:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.235182:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac746f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.235258:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463863808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 582us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.235264:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5941 00000100:00100000:1.0:1746147191.235879:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463861632:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 34882us (35605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.235887:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11918 00000100:00100000:0.0:1746147191.240022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.240073:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864064 00000100:00100000:2.0:1746147191.240084:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864064 00000100:00100000:2.0:1746147191.240131:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10560 00000100:00100000:2.0:1746147191.240138:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463864064:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147191.240485:0:23726:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.240506:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d64200/0xb4b2209fbdac7422 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e70f7 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240523:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.240527:0:23726:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147191.240549:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.240559:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240566:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240586:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240593:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240598:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240604:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240609:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 9/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.240635:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.240645:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.240655:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447488:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.242265:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.242276:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.242286:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.242342:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.242350:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.242357:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.242378:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.242385:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.242391:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.242410:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.242416:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.242433:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466448000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.242672:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.242680:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 12 pid: 14125 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.242688:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466448128:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.242711:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093807e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.244922:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447488:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.245316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.245399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.245623:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864192 00000100:00100000:3.0:1746147191.245630:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864192 00010000:00010000:3.0:1746147191.245656:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.245688:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864320 00000100:00100000:3.0:1746147191.245691:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864320 00010000:00010000:3.0:1746147191.245701:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 13 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.245716:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5942 00000100:00100000:1.0:1746147191.245725:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967463864192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.245735:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.245741:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.245752:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.245769:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea18c00/0xb4b2209fbdac6676 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6796 expref: 304 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.245800:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447616:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.246016:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.246020:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.246029:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.246062:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967463864192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 338us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.246411:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5943 00000100:00100000:3.0:1746147191.246419:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463864320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.246427:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.246432:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 13 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.246441:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 13 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.246453:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e9dd200/0xb4b2209fbdac65f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6750 expref: 13 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.246475:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.246479:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.246485:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.246504:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463864320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 87us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.246559:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5942 00000100:00100000:3.0:1746147191.246768:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5943 00000100:00100000:2.0:1746147191.247487:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.247494:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466447872:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.247499:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466448000:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.247504:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466448128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.247530:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147191.250468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.250499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.250525:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864960 00000100:00100000:0.0:1746147191.250528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.250533:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864960 00010000:00010000:3.0:1746147191.250561:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 12 pid: 14125 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.250597:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864704 00000100:00100000:3.0:1746147191.250600:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864704 00010000:00010000:3.0:1746147191.250612:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.250616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.251471:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864576 00000100:00100000:1.0:1746147191.251475:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864576 00000100:00100000:1.0:1746147191.251510:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4194 00000100:00100000:1.0:1746147191.251516:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:19602:x1830967463864576:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147191.251557:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463864832 00000100:00100000:3.0:1746147191.251564:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463864832 00000100:00100000:0.0:1746147191.251582:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5944 00000100:00100000:0.0:1746147191.251589:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463864960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.251597:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 14 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.251602:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.251608:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 14 pid: 14125 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.251617:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 14 pid: 14125 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.251623:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5945 00000100:00100000:3.0:1746147191.251629:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1957:x1830967463864704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.251633:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216600/0xb4b2209fbdac651f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66b6 expref: 14 pid: 14125 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.251636:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.251649:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147191.251654:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147191.251661:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.251690:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463864960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.251696:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5944 00000100:00100000:0.0:1746147191.251712:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5946 00000100:00100000:0.0:1746147191.251716:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463864832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.251722:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.251725:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.251732:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.251740:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.251741:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb63a00/0xb4b2209fbdac6526 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66bd expref: 12 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.251751:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.251763:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac652d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e66c4 expref: 303 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.251763:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147191.251765:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147191.251770:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147191.251772:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.251776:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.251780:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.251781:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463864832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.251786:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5946 00000100:00100000:3.0:1746147191.251799:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:1957:x1830967463864704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 170us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.251804:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5945 00000100:00100000:1.0:1746147191.252126:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:19602:x1830967463864576:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 610us (1597us total) trans 8589944317 rc 0/0 00000100:00100000:1.0:1746147191.252132:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4194 00000100:00100000:0.0:1746147191.254498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.254805:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865088 00000100:00100000:3.0:1746147191.254812:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865088 00010000:00010000:3.0:1746147191.254833:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 11 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.255064:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5947 00000100:00100000:3.0:1746147191.255071:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463865088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.255083:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.255087:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 11 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.255097:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 11 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.255112:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac6acf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e6a13 expref: 11 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.255122:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.255125:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.255132:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.255138:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.255158:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.255194:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463865088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 123us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.255200:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5947 00010000:00010000:0.0:1746147191.255266:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:0.0:1746147191.255273:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000040:00080000:0.0:1746147191.255808:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2915, 88 off242232 00000004:00080000:0.0:1746147191.255815:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578242877461ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255850:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2867, 88 off238008 00000004:00080000:0.0:1746147191.255854:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242916950ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255863:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2868, 88 off238096 00000004:00080000:0.0:1746147191.255866:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242928955ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255873:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2916, 88 off242320 00000004:00080000:0.0:1746147191.255875:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578242937996ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255881:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2917, 88 off242408 00000004:00080000:0.0:1746147191.255883:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578242945917ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255889:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2869, 88 off238184 00000004:00080000:0.0:1746147191.255891:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242954000ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255898:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2870, 88 off238272 00000004:00080000:0.0:1746147191.255900:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242963289ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255906:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2871, 88 off238360 00000004:00080000:0.0:1746147191.255908:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242971351ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255914:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2918, 88 off242496 00000004:00080000:0.0:1746147191.255916:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578242979097ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255922:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2872, 88 off238448 00000004:00080000:0.0:1746147191.255924:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578242986689ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255930:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2919, 88 off242584 00000004:00080000:0.0:1746147191.255932:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578242994494ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255965:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2873, 88 off238536 00000004:00080000:0.0:1746147191.255968:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578243031219ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147191.255977:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2920, 88 off242672 00000004:00080000:0.0:1746147191.255979:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578243041997ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255985:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2921, 88 off242760 00000004:00080000:0.0:1746147191.255987:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578243050304ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.255993:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2922, 88 off242848 00000004:00080000:0.0:1746147191.255997:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578243059586ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.256003:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2923, 88 off242936 00000004:00080000:0.0:1746147191.256005:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578243068254ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147191.256011:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2874, 88 off238624 00000004:00080000:0.0:1746147191.256014:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578243076949ns, next at 537465048041ns, rc = 0 00000004:00010000:1.0:1746147191.290932:0:23726:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ef7ed80 reply state ffff880134c1c000 transno 8589944318 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:1.0:1746147191.290959:0:23726:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147191.291043:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:29075:x1830967463864064:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 50902us (51108us total) trans 8589944318 rc 0/0 00000100:00100000:1.0:1746147191.291054:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10560 00000001:00080000:2.0:1746147191.291301:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944318 is committed 00000004:00080000:2.0:1746147191.291307:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:2.0:1746147191.291312:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2060 committed 00000004:00080000:2.0:1746147191.291317:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2059 committed 00000004:00080000:2.0:1746147191.291319:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2058 committed 00000004:00080000:2.0:1746147191.291320:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2057 committed 00000004:00080000:2.0:1746147191.291321:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:2.0:1746147191.291322:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2056 committed 00000004:00080000:2.0:1746147191.291324:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:2.0:1746147191.291325:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2055 committed 00000004:00080000:2.0:1746147191.291326:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00000004:00080000:2.0:1746147191.291327:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00000004:00080000:2.0:1746147191.291328:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:2.0:1746147191.291329:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2054 committed 00000004:00080000:2.0:1746147191.291330:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2053 committed 00000004:00080000:2.0:1746147191.291332:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00000004:00080000:2.0:1746147191.291333:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:2.0:1746147191.291334:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2052 committed 00000001:00080000:2.0:1746147191.291339:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944312 is committed 00000001:00080000:2.0:1746147191.291343:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944317 is committed 00000001:00080000:2.0:1746147191.291348:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944315 is committed 00010000:00010000:2.0:1746147191.291365:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291371:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291376:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291380:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d607200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.291382:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291387:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291399:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.291401:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147191.291403:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.291407:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607200/0xb4b2209fbdac747d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147191.291515:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291596:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291623:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291634:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291643:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466450176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291665:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746147191.291668:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291679:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291687:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291696:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291703:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291722:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291749:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291772:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291783:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291792:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291804:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291810:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291827:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746147191.291831:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291847:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.291855:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291860:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291869:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291875:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466450048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.291886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.291904:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448640 00000100:00100000:2.0:1746147191.291909:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448640 00000100:00100000:2.0:1746147191.291953:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449152 00000100:00100000:2.0:1746147191.291955:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449152 00000100:00100000:2.0:1746147191.291963:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449664 00000100:00100000:2.0:1746147191.291965:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449664 00000100:00100000:2.0:1746147191.291974:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466450176 00000100:00100000:2.0:1746147191.291975:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466450176 00000100:00100000:2.0:1746147191.291981:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448256 00000100:00100000:2.0:1746147191.291982:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448256 00000100:00100000:2.0:1746147191.291987:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448768 00000100:00100000:2.0:1746147191.291988:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448768 00000100:00100000:2.0:1746147191.291993:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449280 00000100:00100000:2.0:1746147191.291995:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449280 00000100:00100000:2.0:1746147191.292000:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449792 00000100:00100000:2.0:1746147191.292001:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449792 00000100:00100000:2.0:1746147191.292006:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448384 00000100:00100000:2.0:1746147191.292007:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448384 00000100:00100000:2.0:1746147191.292012:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448896 00000100:00100000:2.0:1746147191.292013:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448896 00000100:00100000:2.0:1746147191.292018:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449408 00000100:00100000:2.0:1746147191.292020:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449408 00000100:00100000:2.0:1746147191.292025:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449920 00000100:00100000:2.0:1746147191.292026:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449920 00000100:00100000:2.0:1746147191.292031:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466448512 00000100:00100000:2.0:1746147191.292032:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466448512 00000100:00100000:2.0:1746147191.292052:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449024 00000100:00100000:2.0:1746147191.292054:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449024 00000100:00100000:2.0:1746147191.292060:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466449536 00000100:00100000:2.0:1746147191.292062:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466449536 00000100:00100000:2.0:1746147191.292066:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466450048 00000100:00100000:2.0:1746147191.292068:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466450048 00000100:00100000:2.0:1746147191.292074:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11920 00000100:00100000:2.0:1746147191.292079:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466448640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.292238:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147191.292241:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.292243:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.292245:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.292246:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1746147191.292270:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466448640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (719us total) trans 17179873247 rc 0/0 00000100:00100000:2.0:1746147191.292274:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11920 00000100:00100000:2.0:1746147191.292284:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11921 00000100:00100000:2.0:1746147191.292288:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466449152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.292366:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.292368:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.292371:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.292372:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.292374:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1746147191.292391:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466449152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (779us total) trans 17179873248 rc 0/0 00000100:00100000:2.0:1746147191.292395:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11921 00000100:00100000:2.0:1746147191.292404:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11922 00000100:00100000:2.0:1746147191.292408:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466449664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.292503:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466449664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (867us total) trans 21474840655 rc 0/0 00000100:00100000:2.0:1746147191.292507:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11922 00000100:00100000:2.0:1746147191.292515:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11923 00000100:00100000:2.0:1746147191.292518:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466450176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147191.292586:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:2.0:1746147191.292588:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.292590:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.292591:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.292593:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:2.0:1746147191.292607:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466450176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (953us total) trans 21474840656 rc 0/0 00000100:00100000:2.0:1746147191.292611:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11923 00000100:00100000:2.0:1746147191.292623:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11924 00000100:00100000:2.0:1746147191.292626:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466448256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.292687:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466448256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1007us total) trans 17179873249 rc 0/0 00000100:00100000:2.0:1746147191.292692:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11924 00000100:00100000:2.0:1746147191.292702:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11925 00000100:00100000:2.0:1746147191.292705:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466448768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.292774:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466448768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1076us total) trans 17179873250 rc 0/0 00000100:00100000:2.0:1746147191.292778:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11925 00000100:00100000:2.0:1746147191.292786:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11926 00000100:00100000:2.0:1746147191.292790:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466449280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.292862:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466449280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1146us total) trans 21474840657 rc 0/0 00000100:00100000:2.0:1746147191.292867:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11926 00000100:00100000:2.0:1746147191.292875:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11927 00000100:00100000:2.0:1746147191.292879:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466449792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147191.292956:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.292958:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.292959:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.292961:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.292962:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147191.292979:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466449792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1243us total) trans 21474840658 rc 0/0 00000100:00100000:2.0:1746147191.292983:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11927 00000100:00100000:2.0:1746147191.292992:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11928 00000100:00100000:2.0:1746147191.292996:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466448384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.293074:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466448384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1311us total) trans 17179873251 rc 0/0 00000100:00100000:2.0:1746147191.293079:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11928 00000100:00100000:2.0:1746147191.293088:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11929 00000100:00100000:2.0:1746147191.293092:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466448896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147191.293179:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11930 00000100:00100000:1.0:1746147191.293185:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466449408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.293253:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11931 00000100:00100000:0.0:1746147191.293259:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466449920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147191.293270:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466449408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1465us total) trans 21474840659 rc 0/0 00000100:00100000:1.0:1746147191.293274:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11930 00000100:00100000:1.0:1746147191.293284:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11932 00000100:00100000:1.0:1746147191.293287:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466448512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147191.293333:0:17530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147191.293335:0:17530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147191.293337:0:17530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147191.293339:0:17530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:0.0:1746147191.293340:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1746147191.293353:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466448512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1511us total) trans 17179873252 rc 0/0 00000100:00100000:0.0:1746147191.293356:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466449920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1535us total) trans 21474840660 rc 0/0 00000100:00100000:1.0:1746147191.293358:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11932 00000100:00100000:0.0:1746147191.293360:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11931 00000100:00100000:1.0:1746147191.293367:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11933 00000100:00100000:1.0:1746147191.293370:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466449024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147191.293438:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:1.0:1746147191.293440:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147191.293441:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147191.293443:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:1.0:1746147191.293444:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:1.0:1746147191.293461:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466449024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1605us total) trans 17179873253 rc 0/0 00000100:00100000:0.0:1746147191.293500:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11934 00000100:00100000:1.0:1746147191.293503:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11933 00000100:00100000:0.0:1746147191.293505:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466449536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147191.293512:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11935 00000100:00100000:1.0:1746147191.293516:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1830967466450048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147191.293583:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147191.293586:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147191.293588:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147191.293588:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1830967466449536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1718us total) trans 21474840661 rc 0/0 00002000:00010000:1.0:1746147191.293589:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147191.293591:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1746147191.293593:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11934 00000100:00100000:1.0:1746147191.293610:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466450048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1723us total) trans 21474840662 rc 0/0 00000100:00100000:1.0:1746147191.293615:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11935 00000100:00080000:1.0:1746147191.293625:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147191.293628:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1746147191.293777:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.293780:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.293781:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.293783:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.293784:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147191.293802:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830967466448896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 710us (2018us total) trans 17179873254 rc 0/0 00000100:00100000:2.0:1746147191.293807:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11929 00000004:00080000:2.0:1746147191.293848:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585f80/2, rc 0, transno 17179873252 00000100:00100000:2.0:1746147191.294119:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.294130:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585180/2, rc 0, transno 17179873253 00000100:00100000:2.0:1746147191.294133:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.294140:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975500/2, rc 0, transno 21474840661 00000004:00080000:3.0:1746147191.294192:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e585500/2, rc 0, transno 17179873249 00000100:00100000:3.0:1746147191.294195:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147191.294201:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e586d80/2, rc 0, transno 17179873250 00000100:00100000:3.0:1746147191.294204:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147191.294209:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975f80/2, rc 0, transno 21474840657 00000100:00100000:2.0:1746147191.294903:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147191.294916:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f450380/2, rc 0, transno 21474840662 00000100:00100000:3.0:1746147191.294929:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449280:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147191.294957:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975180/2, rc 0, transno 21474840658 00000100:00100000:3.0:1746147191.294960:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147191.294967:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e587480/2, rc 0, transno 17179873247 00000100:00100000:3.0:1746147191.294970:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466448640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147191.294975:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e977b80/2, rc 0, transno 17179873248 00000100:00100000:3.0:1746147191.294977:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147191.294983:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e975880/2, rc 0, transno 21474840655 00000100:00100000:3.0:1746147191.294985:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466449664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147191.294990:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f452d80/2, rc 0, transno 21474840656 00000100:00100000:3.0:1746147191.294992:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466450176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.295108:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466450048:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147191.295119:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e584a80/2, rc 0, transno 17179873251 00000100:00100000:2.0:1746147191.295121:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.295127:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e586a00/2, rc 0, transno 17179873254 00000100:00100000:2.0:1746147191.295129:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466448896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.295135:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e974000/2, rc 0, transno 21474840659 00000100:00100000:2.0:1746147191.295137:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147191.295142:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e977800/2, rc 0, transno 21474840660 00000100:00100000:2.0:1746147191.295144:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466449920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147191.295959:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466450304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147191.295995:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.296607:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466450304 00000100:00100000:2.0:1746147191.296613:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466450304 00000100:00100000:2.0:1746147191.296881:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11936 00000100:00100000:2.0:1746147191.296888:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466450304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147191.297136:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:2.0:1746147191.297139:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.297141:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.297142:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.297144:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:2.0:1746147191.297183:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3296:x1830967466450304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (1186us total) trans 21474840663 rc 0/0 00000100:00100000:2.0:1746147191.297195:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11936 00000004:00080000:1.0:1746147191.297214:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef7d500/2, rc 0, transno 21474840663 00000100:00100000:1.0:1746147191.297218:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466450304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.297352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.297387:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865216 00000100:00100000:1.0:1746147191.297390:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865216 00000100:00100000:1.0:1746147191.297470:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10561 00000100:00100000:1.0:1746147191.297475:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+7:29075:x1830967463865216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147191.297488:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.297500:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e711a expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.297536:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.297699:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.297720:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.297722:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147191.297725:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9d200, rc 0) 00000100:00100000:1.0:1746147191.297786:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463865216:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 310us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.297791:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10561 00000100:00100000:2.0:1746147191.301775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.302196:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865344 00000100:00100000:1.0:1746147191.302204:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865344 00000100:00100000:1.0:1746147191.302238:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10562 00000100:00100000:1.0:1746147191.302243:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463865344:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147191.302257:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.302271:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c200/0xb4b2209fbdac748b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7121 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.302330:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.302341:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.302349:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147191.302367:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:1.0:1746147191.302370:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147191.302381:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.302399:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c200/0xb4b2209fbdac748b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 10 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.302428:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.302434:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.302437:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147191.302439:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9c400, rc 0) 00000100:00100000:1.0:1746147191.302479:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+9:29075:x1830967463865344:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 235us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.302484:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10562 00000100:00100000:0.0:1746147191.313018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.313049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.313873:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865472 00000100:00100000:2.0:1746147191.313880:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865472 00000100:00100000:0.0:1746147191.313882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.314314:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865728 00000100:00100000:2.0:1746147191.314317:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865728 00000100:00100000:0.0:1746147191.314317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.314329:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865984 00000100:00100000:2.0:1746147191.314331:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865984 00000100:00100000:0.0:1746147191.314331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.314339:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865600 00000100:00100000:2.0:1746147191.314340:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865600 00000100:00100000:2.0:1746147191.314348:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463865856 00000100:00100000:2.0:1746147191.314349:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463865856 00000100:00100000:2.0:1746147191.314358:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11937 00000100:00100000:2.0:1746147191.314369:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463865472:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.314383:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.314402:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7128 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.314408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1746147191.314422:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141776, atime: 0x68141775, ctime: 0x68141776, blocks: 0x7f7 00000100:00100000:0.0:1746147191.314422:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463866112 00000100:00100000:0.0:1746147191.314424:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463866112 00010000:00010000:2.0:1746147191.314435:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147191.314436:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11938 00010000:00010000:2.0:1746147191.314437:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147191.314440:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463865728:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.314443:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314446:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.314454:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7136 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.314459:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746147191.314465:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141776, atime: 0x68141775, ctime: 0x68141776, blocks: 0x821 00010000:00010000:2.0:1746147191.314467:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6312200, rc 0) 00010000:00010000:0.0:1746147191.314478:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314478:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314482:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314489:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314495:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6278c00, rc 0) 00000100:00100000:2.0:1746147191.314499:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463865472:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 131us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.314504:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11937 00000100:00100000:0.0:1746147191.314506:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463865728:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 66us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.314509:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11938 00000100:00100000:0.0:1746147191.314517:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11939 00000100:00100000:2.0:1746147191.314520:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11940 00000100:00100000:0.0:1746147191.314521:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463865984:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147191.314524:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463865600:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147191.314526:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.314527:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.314532:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7144 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.314533:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e712f expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147191.314542:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x68141776, atime: 0x68141776, ctime: 0x68141776, blocks: 0x821 00002000:00010000:0.0:1746147191.314542:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4945696, mtime: 0x68141776, atime: 0x68141776, ctime: 0x68141776, blocks: 0x15df 00010000:00010000:2.0:1746147191.314547:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314547:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.314548:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314548:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.314552:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314552:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314559:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.314564:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314579:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6279c00, rc 0) 00000100:00100000:0.0:1746147191.314597:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463865984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 72us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.314602:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11939 00000100:00100000:0.0:1746147191.314611:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11941 00000100:00100000:0.0:1746147191.314615:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463865856:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147191.314621:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.314627:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e713d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.314628:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11942 00000100:00100000:3.0:1746147191.314633:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463866112:12345-192.168.203.36@tcp:101:lfs.0 00002000:00010000:0.0:1746147191.314635:0:8480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x68141776, atime: 0x68141775, ctime: 0x68141776, blocks: 0x821 00010000:00010000:3.0:1746147191.314638:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.314641:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314642:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.314645:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e714b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.314646:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.314653:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 13 pid: 8480 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147191.314654:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141776, atime: 0x68141776, ctime: 0x68141776, blocks: 0x1029 00010000:00010000:3.0:1746147191.314659:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.314659:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6279e00, rc 0) 00010000:00010000:3.0:1746147191.314660:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.314664:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.314671:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147191.314671:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463865856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 56us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.314676:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11941 00010000:00010000:3.0:1746147191.314678:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49a00, rc 0) 00000100:00100000:3.0:1746147191.314689:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463866112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.314693:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11942 00010000:00010000:2.0:1746147191.314726:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6313800, rc 0) 00000100:00100000:2.0:1746147191.314740:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463865600:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 216us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.314747:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11940 00000100:00100000:0.0:1746147191.320750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.320842:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463866368 00000100:00100000:3.0:1746147191.320850:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463866368 00000100:00100000:3.0:1746147191.321339:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10563 00000100:00100000:3.0:1746147191.321346:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:29083:x1830967463866368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.321364:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.321378:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac74c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7152 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.321457:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321467:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321475:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321486:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321490:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321494:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321586:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321593:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321598:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147191.321604:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147191.321696:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321701:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321706:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321710:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb88e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.321713:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321718:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321726:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.321728:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147191.321731:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321735:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb88e00/0xb4b2209fbdac74d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321754:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321758:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321762:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321766:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099f49000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.321767:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321771:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321776:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147191.321777:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.321779:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321783:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac74ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321789:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321794:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321798:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321801:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013673fc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.321803:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321808:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321812:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13100) 00010000:00010000:3.0:1746147191.321814:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.321816:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321819:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013673fc00/0xb4b2209fbdac74d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.321845:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac74c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7152 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.321851:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac74c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7152 expref: 303 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.321856:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48600, rc 0) 00000100:00100000:3.0:1746147191.321893:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29083:x1830967463866368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 548us (1152us total) trans 8589944319 rc 301/301 00000100:00100000:3.0:1746147191.321899:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10563 00000100:00100000:2.0:1746147191.329009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.329009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.329062:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463866880 00000100:00100000:1.0:1746147191.329070:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463866880 00000100:00100000:2.0:1746147191.329169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.329201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.329310:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10564 00000100:00100000:1.0:1746147191.329318:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+6:29082:x1830967463866880:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.329337:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.329353:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c200/0xb4b2209fbdac74e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7159 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.329434:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329444:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329454:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329471:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329480:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329485:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329582:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329592:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.329599:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.329621:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.329632:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 8 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.329642:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450432:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.329711:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.329754:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463866624 00000100:00100000:3.0:1746147191.329759:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463866624 00000100:00100000:3.0:1746147191.329795:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463867136 00000100:00100000:3.0:1746147191.329797:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463867136 00000100:00100000:3.0:1746147191.329812:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463867392 00000100:00100000:3.0:1746147191.329814:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463867392 00000100:00100000:3.0:1746147191.329825:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4626 00000100:00100000:3.0:1746147191.329830:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463866624:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147191.329848:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.329857:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.329859:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.329862:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.329870:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.330992:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4627 00000100:00100000:0.0:1746147191.330997:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4628 00000100:00100000:2.0:1746147191.331000:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463867136:12345-192.168.203.36@tcp:3:lfs.0 00000100:00100000:0.0:1746147191.331003:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463867392:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147191.331017:0:25531:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.331017:0:21471:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.331024:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.331024:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.331026:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.331026:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.331029:0:25531:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.331029:0:21471:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.331036:0:25531:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.331036:0:21471:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.331999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.332713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.332727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.332739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.332760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.332777:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463867648 00000100:00100000:1.0:1746147191.332783:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463867648 00000100:00100000:1.0:1746147191.332813:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463867904 00000100:00100000:1.0:1746147191.332815:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463867904 00000100:00100000:1.0:1746147191.332825:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463868160 00000100:00100000:1.0:1746147191.332826:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463868160 00000100:00100000:1.0:1746147191.332836:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463868416 00000100:00100000:1.0:1746147191.332838:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463868416 00000100:00100000:1.0:1746147191.332845:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463868672 00000100:00100000:1.0:1746147191.332847:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463868672 00000100:00100000:1.0:1746147191.332858:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4629 00000100:00100000:1.0:1746147191.332863:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463867648:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147191.332883:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.332892:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.332894:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.332897:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.332905:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.332998:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4630 00000100:00100000:0.0:1746147191.333004:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463867904:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147191.333017:0:21209:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.333022:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.333023:0:21209:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.333026:0:21209:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.333032:0:21209:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.333343:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4631 00000100:00100000:3.0:1746147191.333349:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463868160:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147191.333362:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.333368:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.333369:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.333371:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.333377:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.333905:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4632 00000100:00100000:1.0:1746147191.333911:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:1957:x1830967463868416:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147191.333923:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.333929:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.333930:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.333933:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.333954:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.335050:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4633 00000100:00100000:3.0:1746147191.335057:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+17:1956:x1830967463868672:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147191.335077:0:31324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.335088:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.335089:0:31324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.335092:0:31324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.335099:0:31324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.338363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.338490:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463868928 00000100:00100000:1.0:1746147191.338499:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463868928 00000100:00100000:1.0:1746147191.338535:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4195 00000100:00100000:1.0:1746147191.338542:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29083:x1830967463868928:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147191.340337:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29083:x1830967463868928:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1791us (1977us total) trans 8589944320 rc 0/0 00000100:00100000:1.0:1746147191.340344:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4195 00000100:00100000:1.0:1746147191.340390:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e681180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450432:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.340406:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000100:00100000:0.0:1746147191.344113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.344906:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869056 00000100:00100000:2.0:1746147191.344915:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869056 00010000:00010000:2.0:1746147191.344963:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.344998:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5948 00000100:00100000:2.0:1746147191.345006:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463869056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.345018:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.345023:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.345038:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.345054:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d65800/0xb4b2209fbdac7445 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7113 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.345077:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.345081:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.345089:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.345095:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.345121:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147191.345177:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345183:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147191.345195:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147191.345281:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345287:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345292:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345297:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd9da00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.345300:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345306:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345313:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.345315:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147191.345318:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345323:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9da00/0xb4b2209fbdac74fb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345338:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345343:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345347:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345351:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd9c000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.345354:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345358:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345364:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147191.345366:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.345369:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345373:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c000/0xb4b2209fbdac74ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345381:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345385:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345389:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345393:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd9c600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.345395:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345399:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345404:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f349900) 00010000:00010000:1.0:1746147191.345405:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.345407:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345411:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c600/0xb4b2209fbdac74f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.345447:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c200/0xb4b2209fbdac74e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7159 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.345455:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c200/0xb4b2209fbdac74e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7159 expref: 8 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.345462:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9c200, rc 0) 00000100:00100000:2.0:1746147191.345558:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463869056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 552us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.345564:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5948 00000100:00100000:1.0:1746147191.345646:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29082:x1830967463866880:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 16329us (16639us total) trans 8589944321 rc 301/301 00000100:00100000:1.0:1746147191.345652:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10564 00010000:00010000:3.0:1746147191.352367:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352381:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352388:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352393:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa6b000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147191.352396:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352403:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352417:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.352422:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac7502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.352489:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1957:x1830967463866624:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 22654us (23483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.352497:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4626 00000100:00100000:0.0:1746147191.353459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.353520:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869440 00000100:00100000:1.0:1746147191.353529:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869440 00000100:00100000:1.0:1746147191.354119:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10565 00000100:00100000:1.0:1746147191.354128:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29085:x1830967463869440:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.354147:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.354164:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9d800/0xb4b2209fbdac7541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7167 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.354251:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354260:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354268:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354278:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354283:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354288:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354432:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354439:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354445:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147191.354718:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147191.354780:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354786:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354791:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354795:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b9da00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.354798:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354802:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354811:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.354814:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147191.354817:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354821:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9da00/0xb4b2209fbdac7556 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354839:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354843:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354846:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354850:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b9dc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.354852:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354855:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354860:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147191.354861:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.354863:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354866:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9dc00/0xb4b2209fbdac7548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354871:0:23726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354875:0:23726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354879:0:23726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354882:0:23726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b9de00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.354884:0:23726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354887:0:23726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354892:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f349300) 00010000:00010000:1.0:1746147191.354894:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.354895:0:23726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354899:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9de00/0xb4b2209fbdac754f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.354929:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9d800/0xb4b2209fbdac7541 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7167 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.354948:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b9d800/0xb4b2209fbdac7541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7167 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.354956:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b9d800, rc 0) 00000100:00100000:1.0:1746147191.354989:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29085:x1830967463869440:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 862us (1537us total) trans 8589944322 rc 301/301 00000100:00100000:1.0:1746147191.354995:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10565 00000100:00100000:0.0:1746147191.361030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.361095:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869184 00000100:00100000:1.0:1746147191.361106:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869184 00010000:00010000:1.0:1746147191.362733:0:8486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362746:0:8486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362757:0:8486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362763:0:8486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4678200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147191.362766:0:8486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362772:0:8486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362787:0:8486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.362792:0:8486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.362865:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463867648:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 29998us (30863us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147191.362874:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4629 00000100:00100000:1.0:1746147191.362951:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10566 00000100:00100000:1.0:1746147191.362957:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29083:x1830967463869184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.362971:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.362984:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9fa00/0xb4b2209fbdac7564 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7160 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.363045:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.363055:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.363062:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00000004:00200000:1.0:1746147191.363081:0:23726:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:1.0:1746147191.363084:0:23726:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147191.363095:0:23726:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.363111:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9fa00/0xb4b2209fbdac7564 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7160 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.363120:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7160 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.363126:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.363129:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147191.363130:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678c00, rc 0) 00000100:00100000:1.0:1746147191.363146:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:29083:x1830967463869184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 190us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.363151:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10566 00010000:00010000:2.0:1746147191.363630:0:21471:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363638:0:21471:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363644:0:21471:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363653:0:21471:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6279600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.363655:0:21471:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363661:0:21471:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363670:0:21471:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.363675:0:21471:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6279600/0xb4b2209fbdac7510 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.363712:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463867392:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 32709us (34511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.363718:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4628 00010000:00010000:3.0:1746147191.367737:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367750:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367758:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367764:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099f48600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147191.367767:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367773:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367788:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.367794:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f48600/0xb4b2209fbdac7525 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.367885:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463868160:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 34532us (35152us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.367897:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4631 00010000:00010000:2.0:1746147191.378850:0:25531:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378862:0:25531:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378867:0:25531:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378872:0:25531:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6312600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.378876:0:25531:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378879:0:31324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378882:0:25531:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378885:0:31324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378890:0:31324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378893:0:31324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099f49000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147191.378894:0:31324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378897:0:25531:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378899:0:31324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.378902:0:25531:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6312600/0xb4b2209fbdac7509 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378907:0:31324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.378911:0:31324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49000/0xb4b2209fbdac7533 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31324 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.379000:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463868672:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 43940us (46235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.379008:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4633 00000100:00100000:2.0:1746147191.379187:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463867136:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 48187us (50016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.379192:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4627 00010000:00010000:2.0:1746147191.383341:0:21209:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383356:0:21209:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383362:0:21209:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383368:0:21209:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6278800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147191.383371:0:21209:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383378:0:21209:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383395:0:21209:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.383400:0:21209:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6278800/0xb4b2209fbdac751e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21209 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.383471:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463867904:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 50461us (50752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.383480:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4630 00010000:00010000:0.0:1746147191.392080:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392094:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392102:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392108:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4678e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147191.392112:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392119:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392135:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.392141:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac752c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.392229:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463868416:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 58314us (59484us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147191.392238:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4632 00000100:00100000:0.0:1746147191.394122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.394174:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869696 00000100:00100000:3.0:1746147191.394181:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869696 00000100:00100000:3.0:1746147191.394231:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10567 00000100:00100000:3.0:1746147191.394238:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29088:x1830967463869696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.394256:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.394271:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac7572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e716e expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.394355:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394365:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394372:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394383:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394388:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394393:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394475:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394482:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394488:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147191.394497:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147191.394556:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394561:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394565:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394583:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4ae800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.394586:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394591:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394599:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.394601:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147191.394604:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394608:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7587 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394634:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394638:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394642:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394648:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099f49000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.394650:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394654:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394660:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147191.394662:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.394664:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394667:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f49000/0xb4b2209fbdac7579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394672:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394676:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394680:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394683:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f569200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147191.394685:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394688:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394693:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13000) 00010000:00010000:3.0:1746147191.394695:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147191.394697:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394700:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f569200/0xb4b2209fbdac7580 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.394726:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac7572 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e716e expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.394731:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48600/0xb4b2209fbdac7572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e716e expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.394737:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48600, rc 0) 00000100:00100000:3.0:1746147191.394782:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29088:x1830967463869696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 544us (665us total) trans 8589944323 rc 301/301 00000100:00100000:3.0:1746147191.394787:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10567 00000100:00100000:0.0:1746147191.395555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.395600:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869824 00000100:00100000:1.0:1746147191.395605:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869824 00000100:00100000:1.0:1746147191.395633:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10568 00000100:00100000:1.0:1746147191.395638:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+305:29085:x1830967463869824:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.395646:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.395652:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34c00/0xb4b2209fbdac7595 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7175 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.395677:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34c00/0xb4b2209fbdac7595 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7175 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.395685:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34c00/0xb4b2209fbdac7595 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7175 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.395695:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.395697:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147191.395699:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea34c00, rc 0) 00000100:00100000:1.0:1746147191.395725:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29085:x1830967463869824:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.395730:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10568 00000100:00100000:0.0:1746147191.397716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.397806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.397828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.397839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.397848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.397862:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463869952 00000100:00100000:0.0:1746147191.397862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.397869:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463869952 00000100:00100000:0.0:1746147191.397886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.397896:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870336 00000100:00100000:1.0:1746147191.397898:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870336 00000100:00100000:2.0:1746147191.397907:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870592 00000100:00100000:1.0:1746147191.397908:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870208 00000100:00100000:1.0:1746147191.397910:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870208 00000100:00100000:2.0:1746147191.397911:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870592 00000100:00100000:0.0:1746147191.398126:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870464 00000100:00100000:1.0:1746147191.398128:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870720 00000100:00100000:0.0:1746147191.398129:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870464 00000100:00100000:1.0:1746147191.398131:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870720 00000100:00100000:2.0:1746147191.398141:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11943 00000100:00100000:2.0:1746147191.398148:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463869952:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147191.398150:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11944 00000100:00100000:1.0:1746147191.398155:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463870336:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147191.398155:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11945 00000100:00100000:0.0:1746147191.398161:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463870208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.398162:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.398163:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.398169:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.398174:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e717c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.398174:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7191 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.398176:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e718a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.398189:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.398189:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.398189:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.398190:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.398191:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.398191:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.398196:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 51 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.398197:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 37 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.398197:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 51 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.398208:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 37 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.398208:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 51 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.398209:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 51 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.398216:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48d800, rc 0) 00010000:00010000:1.0:1746147191.398216:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea34400, rc 0) 00010000:00010000:0.0:1746147191.398216:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6278e00, rc 0) 00000100:00100000:2.0:1746147191.398246:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463869952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 99us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.398246:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967463870336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 89us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.398246:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967463870208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.398251:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11944 00000100:00100000:2.0:1746147191.398254:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11943 00000100:00100000:0.0:1746147191.398257:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11945 00000100:00100000:1.0:1746147191.398264:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11946 00000100:00100000:2.0:1746147191.398267:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11947 00000100:00100000:1.0:1746147191.398269:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463870592:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147191.398271:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11948 00000100:00100000:2.0:1746147191.398272:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463870720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.398274:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147191.398275:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463870464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.398279:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.398279:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e719f expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.398280:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.398284:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71a6 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.398285:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7198 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.398287:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.398288:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.398292:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.398292:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.398293:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.398294:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.398294:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.398297:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 50 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.398297:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.398300:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.398305:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 50 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.398305:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea34a00, rc 0) 00010000:00010000:0.0:1746147191.398305:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.398311:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48d600, rc 0) 00010000:00010000:0.0:1746147191.398311:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6279600, rc 0) 00000100:00100000:1.0:1746147191.398319:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463870592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.398322:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463870464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.398327:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967463870720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 54us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.398327:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11946 00000100:00100000:0.0:1746147191.398329:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11948 00000100:00100000:2.0:1746147191.398332:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11947 00000100:00100000:3.0:1746147191.398447:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870080 00000100:00100000:3.0:1746147191.398450:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870080 00000100:00100000:3.0:1746147191.398597:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10569 00000100:00100000:3.0:1746147191.398603:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29088:x1830967463870080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.398613:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.398622:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48a00/0xb4b2209fbdac75c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7183 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.398673:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.398682:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.398690:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:3.0:1746147191.398709:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:3.0:1746147191.398712:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147191.398723:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.398741:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f48a00/0xb4b2209fbdac75c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 10 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.398751:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 9 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.398757:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.398759:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147191.398761:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6a400, rc 0) 00000100:00100000:3.0:1746147191.398790:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+9:29088:x1830967463870080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 187us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.398794:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10569 00000100:00100000:0.0:1746147191.402836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.402882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.402932:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463870976 00000100:00100000:3.0:1746147191.402963:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463870976 00000100:00100000:3.0:1746147191.403008:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11949 00000100:00100000:3.0:1746147191.403015:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463870976:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.403030:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.403044:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71ad expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.403061:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.403063:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147191.403067:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871104 00010000:00010000:3.0:1746147191.403068:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147191.403071:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871104 00010000:00010000:3.0:1746147191.403079:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.403088:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6b000, rc 0) 00000100:00100000:1.0:1746147191.403096:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10570 00000100:00100000:1.0:1746147191.403102:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29085:x1830967463871104:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.403113:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.403115:0:23726:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:3.0:1746147191.403122:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463870976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.403127:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11949 00010000:00010000:1.0:1746147191.403131:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac756b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7160 expref: 306 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403151:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34c00/0xb4b2209fbdac7595 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7175 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403159:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.403163:0:23726:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147191.403175:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34000/0xb4b2209fbdac75db lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71b4 expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403211:0:23726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.403222:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403229:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403235:0:23726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403241:0:23726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.403292:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 8 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403302:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 8 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.403312:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450560:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.403374:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403381:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 7 pid: 23726 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.403388:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450688:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.403411:0:23726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 7 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.403418:0:23726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 7 pid: 23726 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.403425:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450816:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.403454:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.405717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.405747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.405778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.405791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.405828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.405837:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871232 00000100:00100000:1.0:1746147191.405845:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871232 00000100:00100000:1.0:1746147191.405871:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871360 00000100:00100000:1.0:1746147191.405873:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871360 00000100:00100000:1.0:1746147191.405883:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871488 00000100:00100000:1.0:1746147191.405884:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871488 00000100:00100000:1.0:1746147191.405892:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871616 00000100:00100000:1.0:1746147191.405894:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871616 00000100:00100000:3.0:1746147191.405899:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463871744 00000100:00100000:3.0:1746147191.405904:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463871744 00000100:00100000:1.0:1746147191.405905:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11950 00000100:00100000:1.0:1746147191.405911:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463871232:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147191.405916:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11951 00000100:00100000:2.0:1746147191.405923:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463871360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.405924:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147191.405929:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11952 00010000:00010000:2.0:1746147191.405930:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147191.405933:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463871488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.405952:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71bb expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.405953:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71c2 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.405954:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.405963:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71c9 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.405968:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.405970:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.405972:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.405972:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.405974:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.405974:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.405976:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.405978:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.405978:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.405989:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 32 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.405989:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.405989:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 28 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.405997:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa6a000, rc 0) 00010000:00010000:2.0:1746147191.405997:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48d000, rc 0) 00010000:00010000:1.0:1746147191.405997:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9fe00, rc 0) 00000100:00100000:1.0:1746147191.406038:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463871232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 127us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.406043:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11950 00000100:00100000:1.0:1746147191.406057:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11953 00000100:00100000:1.0:1746147191.406061:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463871616:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.406067:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.406074:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71d0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.406083:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.406085:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.406089:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147191.406090:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463871488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.406098:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11952 00010000:00010000:1.0:1746147191.406098:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 33 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.406104:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9f200, rc 0) 00000100:00100000:3.0:1746147191.406109:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11954 00000100:00100000:3.0:1746147191.406113:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463871744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.406119:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.406170:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71d7 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.406179:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.406180:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.406184:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.406191:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.406196:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae800, rc 0) 00000100:00100000:2.0:1746147191.406233:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463871360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 309us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.406237:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11951 00000100:00100000:1.0:1746147191.406328:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463871616:12345-192.168.203.36@tcp:101:cat.0 Request processed in 265us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.406334:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11953 00000100:00100000:3.0:1746147191.407063:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463871744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 928us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.407068:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11954 00000100:00100000:2.0:1746147191.409239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.409325:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872000 00000100:00100000:3.0:1746147191.409333:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872000 00000100:00100000:3.0:1746147191.409374:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10571 00000100:00100000:3.0:1746147191.409381:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463872000:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147191.409415:0:14049:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.409424:0:14049:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.409446:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.409450:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.409458:0:14049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.409462:0:14049:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147191.409489:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.409506:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.409511:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.409523:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.409529:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147191.409818:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450560:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.409829:0:23726:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from blocking AST (req@ffff8800929f4000 x1830967466450688) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.409838:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9c400/0xb4b2209fbdac7492 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7121 expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.409848:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450688:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.414108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.416286:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872128 00000100:00100000:2.0:1746147191.416298:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872128 00000100:00100000:0.0:1746147191.416315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.416335:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10572 00000100:00100000:2.0:1746147191.416343:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29083:x1830967463872128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.416358:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.416374:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71de expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.416421:0:14047:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 307 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.416431:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 307 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.416447:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.416450:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147191.416453:0:14047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.416459:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48cc00, rc 0) 00000100:00100000:1.0:1746147191.416480:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450816:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.416496:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:29083:x1830967463872128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 154us (2394us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147191.416499:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:2.0:1746147191.416502:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10572 00010000:00010000:1.0:1746147191.416502:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.416508:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.416513:0:23726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00000100:00100000:2.0:1746147191.416521:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872256 00000100:00100000:2.0:1746147191.416523:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872256 00010000:00010000:2.0:1746147191.416536:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.416551:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5949 00000100:00100000:2.0:1746147191.416556:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463872256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.416563:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.416584:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.416593:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.416608:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6a400/0xb4b2209fbdac75cd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7183 expref: 9 pid: 14049 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.416632:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.416636:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.416641:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.416645:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.416662:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463872256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.416667:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5949 00000100:00100000:0.0:1746147191.418755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.418798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.418903:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872384 00000100:00100000:2.0:1746147191.418908:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872384 00010000:00010000:2.0:1746147191.418929:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.419032:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872512 00000100:00100000:3.0:1746147191.419036:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872512 00000100:00100000:3.0:1746147191.419062:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10573 00000100:00100000:3.0:1746147191.419069:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29088:x1830967463872512:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.419082:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.419092:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71e5 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.419135:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.419144:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.419154:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147191.419157:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147191.419159:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:3.0:1746147191.419165:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d607c00, rc 0) 00000100:00100000:3.0:1746147191.419196:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:29088:x1830967463872512:12345-192.168.203.36@tcp:101:cat.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.419202:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10573 00000100:00100000:2.0:1746147191.420257:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5950 00000100:00100000:2.0:1746147191.420264:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:1957:x1830967463872384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.420274:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.420278:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.420288:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.420303:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d200/0xb4b2209fbdac7484 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e711a expref: 8 pid: 23726 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.420312:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.420316:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.420323:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.420327:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 23726 initiator: MDT0 00010000:00010000:2.0:1746147191.420334:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.420340:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 306 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.421790:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.421830:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+7:1957:x1830967463872384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1564us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.421837:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5950 00010000:00010000:1.0:1746147191.422148:0:23726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00010000:00010000:1.0:1746147191.422155:0:23726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23726 initiator: MDT0 00000040:00080000:1.0:1746147191.422620:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2924, 88 off243024 00000004:00080000:1.0:1746147191.422625:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409687277ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422686:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2875, 88 off238712 00000004:00080000:1.0:1746147191.422689:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409751471ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422699:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2876, 88 off238800 00000004:00080000:1.0:1746147191.422701:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409763814ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422707:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2925, 88 off243112 00000004:00080000:1.0:1746147191.422709:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409771683ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422717:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2926, 88 off243200 00000004:00080000:1.0:1746147191.422721:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409783433ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422729:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2877, 88 off238888 00000004:00080000:1.0:1746147191.422731:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409793871ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422737:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2878, 88 off238976 00000004:00080000:1.0:1746147191.422739:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409801561ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422744:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2879, 88 off239064 00000004:00080000:1.0:1746147191.422746:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409809183ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422752:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2927, 88 off243288 00000004:00080000:1.0:1746147191.422754:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409816964ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422762:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2880, 88 off239152 00000004:00080000:1.0:1746147191.422765:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409827579ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422770:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2928, 88 off243376 00000004:00080000:1.0:1746147191.422772:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409834598ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422780:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2881, 88 off239240 00000004:00080000:1.0:1746147191.422782:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409844514ns, next at 537465048041ns, rc = 0 00000040:00080000:1.0:1746147191.422787:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2929, 88 off243464 00000004:00080000:1.0:1746147191.422789:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409851606ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422804:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2930, 88 off243552 00000004:00080000:1.0:1746147191.422806:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409868657ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422811:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2931, 88 off243640 00000004:00080000:1.0:1746147191.422813:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409875806ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422818:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2932, 88 off243728 00000004:00080000:1.0:1746147191.422820:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578409882628ns, next at 537464818071ns, rc = 0 00000040:00080000:1.0:1746147191.422825:0:23726:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2882, 88 off239328 00000004:00080000:1.0:1746147191.422827:0:23726:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 578409890004ns, next at 537465048041ns, rc = 0 00010000:00010000:1.0:1746147191.464719:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71b4 expref: 308 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464733:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.464736:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147191.464739:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.464747:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.464752:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.464760:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464767:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464772:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464779:0:23726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464786:0:23726:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464791:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.464821:0:23726:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 8 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.464832:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450944:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.464929:0:23726:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.464951:0:23726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466451072:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.464980:0:23726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52dee40 going to sleep for 11 seconds 00000001:00080000:2.0:1746147191.465236:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944324 is committed 00000004:00080000:2.0:1746147191.465242:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00000004:00080000:2.0:1746147191.465248:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2069 committed 00000004:00080000:2.0:1746147191.465253:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2068 committed 00000004:00080000:2.0:1746147191.465255:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2067 committed 00000004:00080000:2.0:1746147191.465256:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2066 committed 00000004:00080000:2.0:1746147191.465257:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00000004:00080000:2.0:1746147191.465259:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2065 committed 00000004:00080000:2.0:1746147191.465260:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00000004:00080000:2.0:1746147191.465261:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2064 committed 00000004:00080000:2.0:1746147191.465263:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00000004:00080000:2.0:1746147191.465264:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:2.0:1746147191.465265:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:2.0:1746147191.465267:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2063 committed 00000004:00080000:2.0:1746147191.465282:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2062 committed 00000004:00080000:2.0:1746147191.465284:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:2.0:1746147191.465285:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:2.0:1746147191.465287:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2061 committed 00000001:00080000:2.0:1746147191.465296:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944321 is committed 00000001:00080000:2.0:1746147191.465302:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944323 is committed 00010000:00010000:3.0:1746147191.465431:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147191.465437:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00010000:3.0:1746147191.465577:0:14049:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099f6ad80 reply state ffff88013538b000 transno 8589944325 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147191.465584:0:14049:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147191.465640:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463872000:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 56259us (56404us total) trans 8589944325 rc 0/0 00000100:00100000:3.0:1746147191.465648:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10571 00000100:00100000:0.0:1746147191.466115:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.466148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.466166:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147191.466170:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.466186:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.466300:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466451840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.466319:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.466423:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466451456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147191.466556:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466451584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.466621:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.466684:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466452352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.466699:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.467301:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451200 00000100:00100000:3.0:1746147191.467307:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451200 00000100:00100000:3.0:1746147191.467356:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451328 00000100:00100000:3.0:1746147191.467357:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451328 00000100:00100000:3.0:1746147191.467366:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451840 00000100:00100000:3.0:1746147191.467368:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451840 00000100:00100000:3.0:1746147191.467375:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452352 00000100:00100000:3.0:1746147191.467376:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452352 00000100:00100000:3.0:1746147191.467386:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11955 00000100:00100000:3.0:1746147191.467391:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3293:x1830967466451200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147191.467513:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147191.467517:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.467519:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147189 -> 1746147189 00002000:00010000:3.0:1746147191.467520:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.467522:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:0.0:1746147191.467629:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11956 00000100:00100000:0.0:1746147191.467634:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967466451328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147191.467786:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147191.467788:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:0.0:1746147191.467790:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147189 -> 1746147189 00002000:00010000:0.0:1746147191.467792:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:0.0:1746147191.467793:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147191.467843:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11957 00000100:00100000:1.0:1746147191.467848:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466451840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147191.467911:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147191.467913:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147191.467915:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147191.467916:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:1.0:1746147191.467918:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147191.467984:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3293:x1830967466451200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 593us (1836us total) trans 21474840664 rc 0/0 00000100:00100000:3.0:1746147191.467990:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11955 00000100:00100000:3.0:1746147191.468000:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11958 00000100:00100000:3.0:1746147191.468003:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466452352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147191.468075:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147191.468077:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468079:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147189 -> 1746147189 00002000:00010000:3.0:1746147191.468080:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468082:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147191.468100:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466452352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1400us total) trans 17179873255 rc 0/0 00000100:00100000:3.0:1746147191.468108:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11958 00000100:00100000:3.0:1746147191.468157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.468190:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.468205:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466451968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147191.468221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.468230:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466452480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147191.468244:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.468255:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466452992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147191.468267:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147191.468284:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451456 00000100:00100000:3.0:1746147191.468286:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451456 00000100:00100000:3.0:1746147191.468295:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451968 00000100:00100000:3.0:1746147191.468296:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451968 00000100:00100000:3.0:1746147191.468301:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452480 00000100:00100000:3.0:1746147191.468302:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452480 00000100:00100000:3.0:1746147191.468306:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452992 00000100:00100000:3.0:1746147191.468307:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452992 00000100:00100000:3.0:1746147191.468313:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11959 00000100:00100000:3.0:1746147191.468317:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466451456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147191.468373:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4945696 -> 4945696 00002000:00010000:3.0:1746147191.468375:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468377:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468379:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468380:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5599 -> 5599 00000100:00100000:3.0:1746147191.468396:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466451456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (206us total) trans 21474840667 rc 0/0 00000100:00100000:3.0:1746147191.468403:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11959 00000100:00100000:3.0:1746147191.468410:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11960 00000100:00100000:3.0:1746147191.468414:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466451968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147191.468466:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147191.468468:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147191.468470:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147191.468472:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147191.468473:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1746147191.468489:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466451968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (267us total) trans 21474840668 rc 0/0 00000100:00100000:3.0:1746147191.468493:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11960 00000100:00100000:3.0:1746147191.468501:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11961 00000100:00100000:3.0:1746147191.468505:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967466452480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147191.468562:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147191.468564:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468566:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468576:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.468578:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147191.468594:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3295:x1830967466452480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (349us total) trans 17179873256 rc 0/0 00000100:00100000:3.0:1746147191.468598:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11961 00000100:00100000:3.0:1746147191.468606:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11962 00000100:00100000:3.0:1746147191.468610:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967466452992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147191.468661:0:6881:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:3.0:1746147191.468664:0:6881:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147191.468665:0:6881:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147191.468667:0:6881:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:3.0:1746147191.468668:0:6881:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x421:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:3.0:1746147191.468683:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3295:x1830967466452992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (414us total) trans 17179873257 rc 0/0 00000100:00100000:3.0:1746147191.468686:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11962 00000004:00080000:3.0:1746147191.468713:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcaa00/2, rc 0, transno 21474840667 00000100:00100000:3.0:1746147191.468720:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466451456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147191.468726:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edc8700/2, rc 0, transno 21474840668 00000100:00100000:3.0:1746147191.468729:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466451968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147191.468734:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0ce00/2, rc 0, transno 17179873256 00000100:00100000:3.0:1746147191.468737:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466452480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147191.468741:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0fb80/2, rc 0, transno 17179873257 00000100:00100000:3.0:1746147191.468743:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466452992:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.468980:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0c380/2, rc 0, transno 17179873255 00000100:00100000:2.0:1746147191.468984:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466452352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.468988:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466452864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.469004:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469016:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147191.469020:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466453248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.469034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469050:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452864 00000100:00100000:2.0:1746147191.469053:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452864 00000100:00100000:2.0:1746147191.469066:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466453248 00000100:00100000:2.0:1746147191.469068:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466453248 00000100:00100000:2.0:1746147191.469075:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11963 00000100:00100000:2.0:1746147191.469078:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466452864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.469149:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.469152:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.469153:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469155:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.469157:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x420:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147191.469176:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466452864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (171us total) trans 17179873258 rc 0/0 00000100:00100000:2.0:1746147191.469181:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11963 00000100:00100000:2.0:1746147191.469192:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11964 00000100:00100000:2.0:1746147191.469196:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830967466453248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147191.469260:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 4870144 -> 4870144 00002000:00010000:2.0:1746147191.469262:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.469263:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469264:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.469266:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1345 -> 1345 00000100:00100000:2.0:1746147191.469284:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830967466453248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (248us total) trans 21474840669 rc 0/0 00000100:00100000:2.0:1746147191.469288:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11964 00000100:00100000:2.0:1746147191.469308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469322:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466452096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147191.469336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469344:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466452608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.469353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469359:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466453120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147191.469368:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147191.469379:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451584 00000100:00100000:2.0:1746147191.469381:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451584 00000100:00100000:2.0:1746147191.469388:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452096 00000100:00100000:2.0:1746147191.469389:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452096 00000100:00100000:2.0:1746147191.469393:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452608 00000100:00100000:2.0:1746147191.469394:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452608 00000100:00100000:2.0:1746147191.469399:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466453120 00000100:00100000:2.0:1746147191.469400:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466453120 00000100:00100000:2.0:1746147191.469405:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11965 00000100:00100000:2.0:1746147191.469408:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466451584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.469465:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147191.469467:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:2.0:1746147191.469469:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:2.0:1746147191.469470:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147190 -> 1746147190 00002000:00010000:2.0:1746147191.469472:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147191.469488:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466451584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (180us total) trans 17179873259 rc 0/0 00000100:00100000:2.0:1746147191.469492:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11965 00000100:00100000:2.0:1746147191.469499:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11966 00000100:00100000:2.0:1746147191.469503:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830967466452096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147191.469553:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.469555:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.469556:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469558:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.469559:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:2.0:1746147191.469584:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830967466452096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (246us total) trans 21474840670 rc 0/0 00000100:00100000:2.0:1746147191.469588:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11966 00000100:00100000:2.0:1746147191.469595:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11967 00000100:00100000:2.0:1746147191.469598:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466452608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.469648:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147191.469650:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:2.0:1746147191.469652:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469653:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469655:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1746147191.469668:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466452608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (314us total) trans 17179873260 rc 0/0 00000100:00100000:2.0:1746147191.469672:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11967 00000100:00100000:2.0:1746147191.469678:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11968 00000100:00100000:2.0:1746147191.469681:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830967466453120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147191.469730:0:11147:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147191.469732:0:11147:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb mtime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.469734:0:11147:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147191.469735:0:11147:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb ctime from disk: 1746147176 -> 1746147176 00002000:00010000:2.0:1746147191.469737:0:11147:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x422:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1746147191.469750:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830967466453120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (380us total) trans 17179873261 rc 0/0 00000100:00100000:2.0:1746147191.469753:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11968 00000004:00080000:2.0:1746147191.469770:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0c000/2, rc 0, transno 17179873259 00000100:00100000:2.0:1746147191.469773:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466451584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.469778:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6571880/2, rc 0, transno 21474840670 00000100:00100000:2.0:1746147191.469780:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466452096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147191.469784:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0ea00/2, rc 0, transno 17179873260 00000100:00100000:2.0:1746147191.469786:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466452608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.469790:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0d880/2, rc 0, transno 17179873261 00000100:00100000:2.0:1746147191.469792:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466453120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147191.469802:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ecec380/2, rc 0, transno 21474840669 00000100:00100000:2.0:1746147191.469805:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466453248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147191.469810:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0df80/2, rc 0, transno 17179873258 00000100:00100000:2.0:1746147191.469812:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466452864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.469935:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466451328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2300us (3746us total) trans 21474840665 rc 0/0 00000100:00100000:0.0:1746147191.469953:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11956 00000100:00100000:0.0:1746147191.470052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.470064:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466452224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.470076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.470084:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466452736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.470093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147191.470104:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edc9c00/2, rc 0, transno 21474840665 00000100:00100000:0.0:1746147191.470107:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147191.470113:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcb480/2, rc 0, transno 21474840664 00000100:00100000:0.0:1746147191.470115:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.470125:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466451712 00000100:00100000:0.0:1746147191.470127:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466451712 00000100:00100000:0.0:1746147191.470138:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452224 00000100:00100000:0.0:1746147191.470139:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452224 00000100:00100000:0.0:1746147191.470145:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466452736 00000100:00100000:0.0:1746147191.470147:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466452736 00000100:00100000:0.0:1746147191.470153:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11969 00000100:00100000:0.0:1746147191.470157:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466451712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.470232:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967466451712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (179us total) trans 21474840671 rc 0/0 00000100:00100000:0.0:1746147191.470236:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11969 00000100:00100000:0.0:1746147191.470244:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11970 00000100:00100000:0.0:1746147191.470247:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1830967466452224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147191.470300:0:8480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1746147191.470302:0:8480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147191.470304:0:8480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147191.470305:0:8480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147191.470307:0:8480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 8259 -> 8259 00000100:00100000:0.0:1746147191.470321:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3293:x1830967466452224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (244us total) trans 21474840672 rc 0/0 00000100:00100000:0.0:1746147191.470325:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11970 00000100:00100000:0.0:1746147191.470334:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11971 00000100:00100000:0.0:1746147191.470337:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3293:x1830967466452736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.470400:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466452736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (306us total) trans 17179873262 rc 0/0 00000100:00100000:0.0:1746147191.470405:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11971 00000004:00080000:0.0:1746147191.470419:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edc8a80/2, rc 0, transno 21474840671 00000100:00100000:0.0:1746147191.470421:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466451712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147191.470425:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6571500/2, rc 0, transno 21474840672 00000100:00100000:0.0:1746147191.470427:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466452224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147191.470432:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5a0d500/2, rc 0, transno 17179873262 00000100:00100000:0.0:1746147191.470434:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466452736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147191.470495:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3294:x1830967466451840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2647us (4174us total) trans 21474840666 rc 0/0 00000100:00100000:1.0:1746147191.470500:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11957 00000100:00100000:1.0:1746147191.470513:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872640 00000100:00100000:1.0:1746147191.470515:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872640 00000100:00100000:1.0:1746147191.470530:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4196 00000100:00100000:1.0:1746147191.470534:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29088:x1830967463872640:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147191.470602:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29088:x1830967463872640:12345-192.168.203.36@tcp:49:cat.0 Request processed in 66us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.470606:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4196 00000100:00100000:1.0:1746147191.470672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.470767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.470778:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872768 00000100:00100000:1.0:1746147191.470781:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872768 00000100:00100000:1.0:1746147191.470794:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4197 00000100:00100000:1.0:1746147191.470797:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:29083:x1830967463872768:12345-192.168.203.36@tcp:49:cat.0 00000100:00100000:1.0:1746147191.470827:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:29083:x1830967463872768:12345-192.168.203.36@tcp:49:cat.0 Request processed in 30us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.470832:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4197 00000100:00100000:1.0:1746147191.470866:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466450944:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.470873:0:23726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:23726:1830967466451072:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.470894:0:23726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34000/0xb4b2209fbdac75db lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71b4 expref: 304 pid: 23726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746147191.470907:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71b4 expref: 303 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.470920:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea34600, rc 0) 00000100:00100000:1.0:1746147191.470932:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29085:x1830967463871104:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 67831us (68052us total) trans 8589944324 rc 0/0 00000100:00100000:1.0:1746147191.470952:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10570 00000100:00100000:1.0:1746147191.470961:0:23726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463872896 00000100:00100000:1.0:1746147191.470963:0:23726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463872896 00000100:00100000:1.0:1746147191.470975:0:23726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10574 00000100:00100000:1.0:1746147191.470979:0:23726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463872896:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147191.470988:0:23726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.470996:0:23726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edaca00/0xb4b2209fbdac7621 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71ec expref: -99 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.471017:0:23726:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edaca00/0xb4b2209fbdac7621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ec expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.471026:0:23726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edaca00/0xb4b2209fbdac7621 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ec expref: 9 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.471039:0:23726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.471042:0:23726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147191.471044:0:23726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edaca00, rc 0) 00000100:00100000:1.0:1746147191.471055:0:23726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:60817ea3-97af-43a7-ab2a-b628d12800db+9:29075:x1830967463872896:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.471059:0:23726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10574 00010000:00010000:2.0:1746147191.471433:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471439:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471444:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471448:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa6b400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.471451:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471456:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471463:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.471465:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147191.471467:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147191.471471:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa6b400/0xb4b2209fbdac760c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00000004:00080000:2.0:1746147191.471497:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcb100/2, rc 0, transno 21474840666 00000100:00100000:2.0:1746147191.471501:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466451840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.472764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.472824:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873024 00000100:00100000:3.0:1746147191.472828:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873024 00000100:00100000:3.0:1746147191.472855:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4198 00000100:00100000:3.0:1746147191.472860:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29082:x1830967463873024:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:3.0:1746147191.472920:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29082:x1830967463873024:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.472925:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4198 00000100:00100000:0.0:1746147191.476411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.476450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.476511:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873152 00000100:00100000:1.0:1746147191.476517:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873152 00000100:00100000:1.0:1746147191.476557:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4199 00000100:00100000:1.0:1746147191.476563:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29085:x1830967463873152:12345-192.168.203.36@tcp:49:multiop.0 00000100:00100000:1.0:1746147191.476659:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29085:x1830967463873152:12345-192.168.203.36@tcp:49:multiop.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.476665:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4199 00000100:00100000:2.0:1746147191.476724:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873280 00000100:00100000:2.0:1746147191.476728:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873280 00000100:00100000:2.0:1746147191.476748:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11972 00000100:00100000:2.0:1746147191.476753:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:29082:x1830967463873280:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147191.476762:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.476773:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71f3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.476792:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476799:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476805:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476810:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.476812:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.476814:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.476836:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476845:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 36 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.476854:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453376:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.476905:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476912:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 33 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.476918:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453504:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.476954:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 12 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.476962:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 12 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.476973:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453632:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.476996:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.479401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.479477:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873408 00000100:00100000:3.0:1746147191.479483:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873408 00000100:00100000:3.0:1746147191.479510:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11973 00000100:00100000:3.0:1746147191.479516:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:29075:x1830967463873408:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.479527:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.479538:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e71fa expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.479559:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.479566:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.479583:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.479588:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.479589:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.479592:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.479611:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.479618:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.479627:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012eceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466453760:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.482989:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 33 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.483004:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 33 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.483016:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466453888:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.484026:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453376:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.484035:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453504:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.484959:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 14 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.484972:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 14 pid: 4444 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.484982:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466454016:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.485950:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.485984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.486123:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463874304 00000100:00100000:0.0:1746147191.486129:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463874304 00002000:00100000:0.0:1746147191.486161:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d499180 x1830967463874304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.486170:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499180 with x1830967463874304 ext(0->1048575) 00010000:00010000:0.0:1746147191.486177:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 37 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.486193:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 37 pid: 11147 timeout: 678 lvb_type: 1 00002000:00010000:0.0:1746147191.486199:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d499180 00000100:00100000:0.0:1746147191.486212:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463874432 00000100:00100000:0.0:1746147191.486214:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463874432 00002000:00100000:0.0:1746147191.486225:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012d499880 x1830967463874432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.486231:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967463874432 ext(1048576->2097151) 00002000:00010000:0.0:1746147191.486234:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:0.0:1746147191.486240:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463874560 00000100:00100000:0.0:1746147191.486242:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463874560 00002000:00100000:0.0:1746147191.486248:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d49b480 x1830967463874560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.486253:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b480 with x1830967463874560 ext(1048576->2097151) 00002000:00010000:0.0:1746147191.486256:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b480 00000100:00100000:0.0:1746147191.486263:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1585 00000100:00100000:0.0:1746147191.486268:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463874304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.486582:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4634 00000100:00100000:2.0:1746147191.486589:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463874432:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.487619:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873792 00000100:00100000:1.0:1746147191.487626:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873792 00010000:00010000:1.0:1746147191.487645:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 15 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.487665:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873536 00000100:00100000:1.0:1746147191.487667:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873536 00010000:00010000:1.0:1746147191.487674:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 39 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.487683:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873920 00000100:00100000:1.0:1746147191.487685:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873920 00010000:00010000:1.0:1746147191.487692:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.487703:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5951 00000100:00100000:1.0:1746147191.487708:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463873792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.487715:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.487727:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 15 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.487736:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 15 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.487752:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.487906:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463873792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 193us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.487912:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5951 00000100:00100000:0.0:1746147191.487920:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4635 00000100:00100000:1.0:1746147191.487925:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5952 00000100:00100000:0.0:1746147191.487926:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1958:x1830967463874560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.487929:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463873536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.487949:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.487956:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 39 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.487963:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 39 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.487973:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279600/0xb4b2209fbdac75bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7198 expref: 39 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.487988:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.488000:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463873536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 70us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.488004:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5952 00000100:00100000:1.0:1746147191.488011:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5953 00000100:00100000:1.0:1746147191.488015:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1957:x1830967463873920:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.488019:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.488024:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.488030:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.488039:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6a000/0xb4b2209fbdac75f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c9 expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.488045:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.488046:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.488051:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.488058:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.488079:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 33 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.488088:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466454144:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.488116:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52dee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.488600:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012eceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466453760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.489009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.489027:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875200 00000100:00100000:3.0:1746147191.489031:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875200 00002000:00100000:3.0:1746147191.489068:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009a80df80 x1830967463875200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.489076:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80df80 with x1830967463875200 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.489079:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80df80 00000100:00100000:3.0:1746147191.489092:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4636 00000100:00100000:3.0:1746147191.489097:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463875200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.489739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.489804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.489822:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463873664 00000100:00100000:0.0:1746147191.489827:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463873664 00000100:00100000:0.0:1746147191.489846:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11974 00000100:00100000:0.0:1746147191.489851:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+54:29085:x1830967463873664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147191.489860:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.489873:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7201 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.489891:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.489898:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.489903:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 55 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.489908:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.489909:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.489912:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2322432->2338815] (req 2322432->2338815) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 55 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.489930:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 55 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.489954:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 55 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.489958:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875328 00000100:00100000:3.0:1746147191.489961:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875328 00000100:00100000:0.0:1746147191.489963:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f453480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454272:192.168.203.36@tcp:104: 00002000:00100000:3.0:1746147191.489974:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f452680 x1830967463875328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.489981:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452680 with x1830967463875328 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.489983:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f452680 00000100:00100000:3.0:1746147191.489991:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875072 00000100:00100000:3.0:1746147191.489993:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875072 00002000:00100000:3.0:1746147191.489999:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f450e00 x1830967463875072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.490005:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450e00 with x1830967463875072 ext(0->1048575) 00010000:00010000:0.0:1746147191.490009:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.490010:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.490016:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.490019:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.490022:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454400:192.168.203.36@tcp:104: 00002000:00010000:3.0:1746147191.490024:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f450e00 00000100:00100000:3.0:1746147191.490031:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1586 00000100:00100000:3.0:1746147191.490035:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463875072:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:0.0:1746147191.490044:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 10 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.490056:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 10 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.490064:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f451180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454528:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.490078:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.490516:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4637 00000100:00100000:2.0:1746147191.490523:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463875328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.491153:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ecef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466453888:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.491161:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a80ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466454016:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147191.491189:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.491199:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9c800, rc 0) 00000100:00100000:0.0:1746147191.491216:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:29075:x1830967463873408:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11700us (11820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.491221:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11973 00010000:00010000:2.0:1746147191.493294:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279e00/0xb4b2209fbdac74b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e713d expref: 13 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.493321:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466453632:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.493351:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.493430:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48ca00, rc 0) 00000100:00100000:2.0:1746147191.493450:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29082:x1830967463873280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 16696us (16998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.493457:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11972 00000100:00100000:0.0:1746147191.494350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.494373:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875584 00000100:00100000:0.0:1746147191.494380:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875584 00010000:00010000:0.0:1746147191.494401:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.494418:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5954 00000100:00100000:0.0:1746147191.494424:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463875584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.494435:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.494449:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.494459:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.494476:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312200/0xb4b2209fbdac7499 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7128 expref: 13 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.494509:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.494524:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463875584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.494529:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5954 00000100:00100000:0.0:1746147191.496110:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463874304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9835us (10082us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147191.496119:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1585 00002000:00100000:0.0:1746147191.496128:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88012d499180 x1830967463874304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.496142:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499180 with x1830967463874304 ext(0->1048575) 00010000:00010000:0.0:1746147191.496148:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.496158:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00002000:00010000:0.0:1746147191.496163:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d499180 00000100:00100000:0.0:1746147191.501297:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f453480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454272:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.501309:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454400:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.501316:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f451180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466454528:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147191.501876:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [2322432->2338815] (req 2322432->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 55 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.501896:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6278200, rc 0) 00000100:00100000:0.0:1746147191.501934:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+55:29085:x1830967463873664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12080us (15950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.501962:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11974 00000100:00100000:1.0:1746147191.503406:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1958:x1830967463874560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15473us (17351us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147191.503417:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4635 00002000:00100000:1.0:1746147191.503427:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012d49b480 x1830967463874560/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.503436:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d49b480 with x1830967463874560 ext(1048576->2097151) 00002000:00010000:1.0:1746147191.503440:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d49b480 00000100:00100000:1.0:1746147191.503480:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466454144:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.503493:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.503526:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1957:x1830967463873920:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 15510us (17453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.503532:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5953 00000100:00100000:0.0:1746147191.506017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.506507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.506522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.511412:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875840 00000100:00100000:0.0:1746147191.511422:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875840 00000100:00100000:2.0:1746147191.512072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.512236:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463875200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23136us (23225us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.512246:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4636 00002000:00100000:3.0:1746147191.512256:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009a80df80 x1830967463875200/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.512265:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80df80 with x1830967463875200 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.512270:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80df80 00000100:00100000:1.0:1746147191.512402:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875712 00000100:00100000:1.0:1746147191.512406:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875712 00010000:00010000:0.0:1746147191.512717:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.512750:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463875968 00000100:00100000:0.0:1746147191.512754:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463875968 00000100:00100000:3.0:1746147191.512775:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5955 00000100:00100000:3.0:1746147191.512783:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463875840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.512796:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147191.512809:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876096 00000100:00100000:2.0:1746147191.512812:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876096 00010000:00010000:3.0:1746147191.512814:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.512825:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.512835:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11975 00000100:00100000:2.0:1746147191.512840:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29082:x1830967463876096:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147191.512845:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae800/0xb4b2209fbdac7605 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d7 expref: 29 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.512851:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.512861:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147191.512862:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7208 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.512881:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147191.512888:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463875840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 106us (6876us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147191.512888:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 35 pid: 8478 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147191.512893:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5955 00010000:00010000:2.0:1746147191.512894:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.512900:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.512902:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.512904:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->2777087] (req 2097152->2777087) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.512920:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 53 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.512925:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.512950:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.512951:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5956 00000100:00100000:1.0:1746147191.512957:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967463875712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147191.512960:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454656:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.512963:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.512971:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 53 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.512979:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 53 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.512990:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d600/0xb4b2209fbdac75b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71a6 expref: 53 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.512999:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147191.513006:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 35 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.513013:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 35 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.513015:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967463875712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 58us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.513019:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5956 00000100:00100000:2.0:1746147191.513021:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.513045:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.513053:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.513064:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454912:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.513078:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746147191.513530:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 11 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:0.0:1746147191.513556:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5957 00000100:00100000:0.0:1746147191.513562:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463875968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.513576:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.513585:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 11 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.513592:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 11 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.513604:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac74bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e714b expref: 11 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.513619:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.513620:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.513626:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.513632:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.513650:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 51 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.513658:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f452300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466455040:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147191.513704:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.516247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.516584:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876224 00000100:00100000:3.0:1746147191.516590:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876224 00010000:00010000:3.0:1746147191.516616:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.516627:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1958:x1830967463874432:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30037us (30589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.516635:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4634 00002000:00100000:2.0:1746147191.516643:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012d499880 x1830967463874432/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147191.516650:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5958 00002000:00100000:2.0:1746147191.516651:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499880 with x1830967463874432 ext(1048576->2097151) 00002000:00010000:2.0:1746147191.516654:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499880 00000100:00100000:3.0:1746147191.516656:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463876224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.516667:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.516680:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.516690:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.516706:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d800/0xb4b2209fbdac759c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e717c expref: 36 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.516719:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.516735:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463876224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.516740:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5958 00000100:00100000:2.0:1746147191.517269:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463875328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26746us (27530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.517275:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4637 00002000:00100000:2.0:1746147191.517280:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88009f452680 x1830967463875328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.517287:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f452680 with x1830967463875328 ext(1048576->2097151) 00002000:00010000:2.0:1746147191.517291:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f452680 00000100:00100000:0.0:1746147191.517663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.517689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.517708:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876480 00000100:00100000:1.0:1746147191.517712:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876480 00010000:00010000:1.0:1746147191.517728:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 12 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.517743:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876352 00000100:00100000:1.0:1746147191.517745:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876352 00010000:00010000:1.0:1746147191.517753:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 36 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.517765:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5959 00000100:00100000:1.0:1746147191.517770:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463876480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.517777:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.517788:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 12 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.517800:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 12 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.517814:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.517834:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463876480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.517840:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5959 00000100:00100000:1.0:1746147191.517851:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5960 00000100:00100000:1.0:1746147191.517856:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1956:x1830967463876352:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.517862:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.517868:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 36 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.517876:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 36 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.517885:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.517898:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1956:x1830967463876352:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.517903:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5960 00000100:00100000:2.0:1746147191.518024:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454656:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.518034:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9f200/0xb4b2209fbdac75fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71d0 expref: 35 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.518047:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454784:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.518055:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6279c00/0xb4b2209fbdac74a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7144 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.518064:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466454912:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.518087:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->2777087] (req 2097152->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.518096:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6312400, rc 0) 00000100:00100000:2.0:1746147191.518113:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29082:x1830967463876096:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5272us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.518118:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11975 00000100:00100000:3.0:1746147191.518541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.518702:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876608 00000100:00100000:1.0:1746147191.518706:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876608 00010000:00010000:1.0:1746147191.518718:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.518747:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5961 00000100:00100000:1.0:1746147191.518753:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463876608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.518760:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.518768:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.518776:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.518787:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea34a00/0xb4b2209fbdac75b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e719f expref: 35 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.518795:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.518797:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.518802:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.518809:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.518831:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.518840:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466455168:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.518895:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.519772:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463875072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 29733us (29965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147191.519780:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1586 00002000:00100000:0.0:1746147191.519786:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f450e00 x1830967463875072/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.519793:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f450e00 with x1830967463875072 ext(0->1048575) 00010000:00010000:0.0:1746147191.519801:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 32 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:0.0:1746147191.519811:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 32 pid: 17548 timeout: 678 lvb_type: 1 00002000:00010000:0.0:1746147191.519816:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f450e00 00000100:00100000:2.0:1746147191.520556:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f452300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466455040:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.520580:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.520613:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f453480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463875968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7050us (14088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.520619:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5957 00000100:00100000:3.0:1746147191.525081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.525171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.525249:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876992 00000100:00100000:2.0:1746147191.525256:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876992 00000100:00100000:2.0:1746147191.525292:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11976 00000100:00100000:2.0:1746147191.525298:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29083:x1830967463876992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.525313:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.525326:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e720f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.525349:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.525360:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.525362:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746147191.525362:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463876864 00010000:00010000:2.0:1746147191.525365:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.525366:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463876864 00010000:00010000:2.0:1746147191.525389:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 31 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147191.525390:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2322432->2326527) req@ffff88009a80f100 x1830967463876864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147191.525397:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 31 pid: 17530 timeout: 678 lvb_type: 0 00002000:00100000:0.0:1746147191.525397:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f100 with x1830967463876864 ext(2322432->2326527) 00002000:00010000:0.0:1746147191.525400:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f100 00000100:00100000:2.0:1746147191.525408:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466455296:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.525413:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4638 00000100:00100000:0.0:1746147191.525417:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1959:x1830967463876864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.525461:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.525537:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1959:x1830967463876864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 118us (462us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147191.525543:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4638 00002000:00100000:0.0:1746147191.525548:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2322432->2326527) req@ffff88009a80f100 x1830967463876864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.525554:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a80f100 with x1830967463876864 ext(2322432->2326527) 00002000:00010000:0.0:1746147191.525557:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a80f100 00000100:00100000:1.0:1746147191.525807:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466455168:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.525820:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.525835:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463876608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7083us (7295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.525842:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5961 00000100:00100000:0.0:1746147191.527769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.527865:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466455296:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.527886:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.527898:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678e00, rc 0) 00000100:00100000:1.0:1746147191.528032:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463877120 00000100:00100000:1.0:1746147191.528037:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463877120 00002000:00100000:1.0:1746147191.528062:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1990656->2097151) req@ffff88012eceed80 x1830967463877120/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.528069:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967463877120 ext(1990656->2097151) 00010000:00010000:1.0:1746147191.528075:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 32 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.528084:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 32 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:1.0:1746147191.528089:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012eceed80 00000100:00100000:1.0:1746147191.528103:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1587 00000100:00100000:1.0:1746147191.528108:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463877120:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147191.528276:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29083:x1830967463876992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2977us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.528283:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11976 00000100:00100000:0.0:1746147191.528610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.528668:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463877376 00000100:00100000:3.0:1746147191.528672:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463877376 00002000:00100000:3.0:1746147191.528688:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2334720->2338815) req@ffff88012ecef100 x1830967463877376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.528695:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967463877376 ext(2334720->2338815) 00002000:00010000:3.0:1746147191.528698:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:3.0:1746147191.528718:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4639 00000100:00100000:3.0:1746147191.528722:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1959:x1830967463877376:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.529251:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1959:x1830967463877376:12345-192.168.203.36@tcp:3:cat.0 Request processed in 527us (640us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147191.529258:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4639 00002000:00100000:3.0:1746147191.529264:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2334720->2338815) req@ffff88012ecef100 x1830967463877376/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.529270:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecef100 with x1830967463877376 ext(2334720->2338815) 00002000:00010000:3.0:1746147191.529273:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ecef100 00000100:00100000:0.0:1746147191.534531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.534597:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.534758:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463877632 00000100:00100000:3.0:1746147191.534765:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463877632 00002000:00100000:3.0:1746147191.534794:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2772992->2777087) req@ffff880099f6a300 x1830967463877632/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.534802:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967463877632 ext(2772992->2777087) 00002000:00010000:3.0:1746147191.534806:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:3.0:1746147191.534824:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4640 00000100:00100000:3.0:1746147191.534830:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463877632:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.534951:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463877632:12345-192.168.203.36@tcp:3:cat.0 Request processed in 105us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147191.534957:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4640 00002000:00100000:3.0:1746147191.534962:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2772992->2777087) req@ffff880099f6a300 x1830967463877632/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.534969:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f6a300 with x1830967463877632 ext(2772992->2777087) 00002000:00010000:3.0:1746147191.534971:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f6a300 00000100:00100000:1.0:1746147191.535584:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463877120:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7474us (7817us total) trans 21474840673 rc 0/0 00000100:00100000:1.0:1746147191.535590:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1587 00002000:00100000:1.0:1746147191.535595:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1990656->2097151) req@ffff88012eceed80 x1830967463877120/t21474840673(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.535601:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012eceed80 with x1830967463877120 ext(1990656->2097151) 00010000:00010000:1.0:1746147191.535608:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.535619:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:1.0:1746147191.535624:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012eceed80 00000100:00100000:2.0:1746147191.535777:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463877888 00000100:00100000:2.0:1746147191.535781:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463877888 00000100:00100000:2.0:1746147191.535812:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4200 00000100:00100000:2.0:1746147191.535817:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29085:x1830967463877888:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147191.535927:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29085:x1830967463877888:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 108us (1328us total) trans 8589944326 rc 0/0 00000100:00100000:2.0:1746147191.535932:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4200 00000100:00100000:0.0:1746147191.537035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.537071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.537073:0:14051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878144 00000100:00100000:2.0:1746147191.537077:0:14051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878144 00000100:00100000:2.0:1746147191.537095:0:14051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4201 00000100:00100000:2.0:1746147191.537100:0:14051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29082:x1830967463878144:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147191.537199:0:14051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29082:x1830967463878144:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 98us (165us total) trans 8589944327 rc 0/0 00000100:00100000:2.0:1746147191.537205:0:14051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4201 00000100:00100000:3.0:1746147191.537254:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878400 00000100:00100000:3.0:1746147191.537261:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878400 00002000:00100000:3.0:1746147191.537281:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1990655) req@ffff8800a4fad180 x1830967463878400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.537288:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463878400 ext(1048576->1990655) 00010000:00010000:3.0:1746147191.537295:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.537303:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.537309:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4fad180 00000100:00100000:3.0:1746147191.537321:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1588 00000100:00100000:3.0:1746147191.537326:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1959:x1830967463878400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.544494:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1959:x1830967463878400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7159us (7414us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746147191.544504:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1588 00002000:00100000:3.0:1746147191.544513:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1990655) req@ffff8800a4fad180 x1830967463878400/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.544521:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fad180 with x1830967463878400 ext(1048576->1990655) 00010000:00010000:3.0:1746147191.544529:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.544540:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.544545:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4fad180 00000100:00100000:2.0:1746147191.544616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.544804:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878528 00000100:00100000:1.0:1746147191.544816:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878528 00010000:00010000:1.0:1746147191.544838:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.544857:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5962 00000100:00100000:1.0:1746147191.544863:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463878528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.544874:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.544892:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.544900:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.544927:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa6b000/0xb4b2209fbdac75d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ad expref: 34 pid: 17548 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.544953:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.544955:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.544960:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.544972:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.544995:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.545004:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466455424:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.545072:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ded80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.549289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.549310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.549311:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878656 00000100:00100000:2.0:1746147191.549320:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878656 00000100:00100000:2.0:1746147191.549356:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11977 00000100:00100000:2.0:1746147191.549363:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29088:x1830967463878656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.549379:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.549401:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7216 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.549420:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.549425:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.549436:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.549451:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9cac00, rc 0) 00000100:00100000:2.0:1746147191.549488:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+35:29088:x1830967463878656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.549493:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11977 00000100:00100000:3.0:1746147191.549836:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878784 00000100:00100000:3.0:1746147191.549841:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878784 00010000:00010000:3.0:1746147191.549855:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.549886:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5963 00000100:00100000:3.0:1746147191.549894:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1956:x1830967463878784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.549901:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147191.549915:0:7120:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147190 -> 1746147191 00002000:00010000:3.0:1746147191.549917:0:7120:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00010000:00010000:3.0:1746147191.549922:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.549931:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.549963:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71f3 expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.549976:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.549977:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.549982:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.549989:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.549995:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.549996:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.549998:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.550007:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.550029:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.550037:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466455552:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.550084:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.550090:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466455680:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.550103:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.550179:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466455424:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.550191:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.550205:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463878528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5343us (5591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.550210:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5962 00000100:00100000:1.0:1746147191.553209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.553288:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463878912 00000100:00100000:3.0:1746147191.553295:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463878912 00000100:00100000:3.0:1746147191.553463:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11978 00000100:00100000:3.0:1746147191.553811:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463878912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.553826:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.553840:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e721d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.553862:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.553870:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.553877:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 49 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.553883:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.553884:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.553887:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.553910:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 49 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.553919:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 49 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.553928:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466455808:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.554016:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 25 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.554024:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 25 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.554031:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466455936:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.554052:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.554100:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.554107:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456064:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.554124:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.555638:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466455552:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.555718:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466455680:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.555732:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.555770:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463878784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5874us (6457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.555778:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5963 00000100:00100000:0.0:1746147191.557194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.557489:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879424 00000100:00100000:3.0:1746147191.557496:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879424 00002000:00100000:3.0:1746147191.557530:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fac000 x1830967463879424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.557538:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967463879424 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.557542:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac000 00000100:00100000:3.0:1746147191.557578:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4641 00000100:00100000:3.0:1746147191.557585:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463879424:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.558509:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466455808:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.558519:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466455936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.558525:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456064:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.558552:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.558576:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9da00, rc 0) 00000100:00100000:2.0:1746147191.558612:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:29075:x1830967463878912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5143us (5408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.558619:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11978 00000100:00100000:0.0:1746147191.561011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.561037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.561060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.561131:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879552 00000100:00100000:2.0:1746147191.561139:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879552 00010000:00010000:2.0:1746147191.561168:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 50 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.561189:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879808 00000100:00100000:2.0:1746147191.561191:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879808 00010000:00010000:2.0:1746147191.561202:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.561222:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5964 00000100:00100000:2.0:1746147191.561229:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5965 00000100:00100000:3.0:1746147191.561231:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463879552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147191.561235:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463879808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.561244:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.561244:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.561260:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:3.0:1746147191.561262:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 50 pid: 6881 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.561269:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.561285:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6313800/0xb4b2209fbdac74ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e712f expref: 11 pid: 4444 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.561303:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147191.561330:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 50 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.561338:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463879808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 102us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147191.561341:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278e00/0xb4b2209fbdac75aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e718a expref: 50 pid: 6881 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.561344:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5965 00010000:00010000:3.0:1746147191.561354:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.561372:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967463879552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 143us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.561377:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5964 00000100:00100000:3.0:1746147191.561413:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879168 00000100:00100000:3.0:1746147191.561416:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879168 00002000:00100000:3.0:1746147191.561439:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fac380 x1830967463879168/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.561447:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967463879168 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.561451:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac380 00000100:00100000:3.0:1746147191.561467:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4642 00000100:00100000:3.0:1746147191.561472:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463879168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.564614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.565300:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879680 00000100:00100000:2.0:1746147191.565309:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879680 00010000:00010000:2.0:1746147191.565338:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 26 pid: 8478 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.565362:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5966 00000100:00100000:2.0:1746147191.565369:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463879680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.565381:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.565398:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 26 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.565409:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 26 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.565426:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9fe00/0xb4b2209fbdac75e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71bb expref: 26 pid: 8478 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.565452:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.565454:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.565460:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.565467:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.565496:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.565506:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466456192:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.565577:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.570257:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463879424:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12665us (13058us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.570267:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4641 00002000:00100000:3.0:1746147191.570276:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fac000 x1830967463879424/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.570290:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac000 with x1830967463879424 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.570295:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac000 00000100:00100000:3.0:1746147191.571233:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463879168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9759us (10226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.571239:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4642 00002000:00100000:3.0:1746147191.571245:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800a4fac380 x1830967463879168/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.571252:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4fac380 with x1830967463879168 ext(1048576->2097151) 00002000:00010000:3.0:1746147191.571255:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4fac380 00000100:00100000:0.0:1746147191.573062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.573122:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466456192:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.573141:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.573167:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463879680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7800us (8559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.573176:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5966 00000100:00100000:3.0:1746147191.573225:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463879936 00000100:00100000:3.0:1746147191.573230:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463879936 00000100:00100000:3.0:1746147191.573252:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11979 00000100:00100000:3.0:1746147191.573256:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463879936:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.573267:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.573279:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7224 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.573299:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573307:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573313:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 48 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573319:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.573321:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.573324:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.573347:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 48 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573357:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 48 pid: 4445 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.573367:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456320:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.573415:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 24 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573423:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 24 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.573430:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456448:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.573451:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.573458:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:3.0:1746147191.573469:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456576:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.573481:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.577264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.577798:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880192 00000100:00100000:3.0:1746147191.577805:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880192 00002000:00100000:3.0:1746147191.577838:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2777088->3145727) req@ffff88009ef7dc00 x1830967463880192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.577847:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7dc00 with x1830967463880192 ext(2777088->3145727) 00002000:00010000:3.0:1746147191.577851:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef7dc00 00000100:00100000:3.0:1746147191.577869:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4643 00000100:00100000:3.0:1746147191.577875:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463880192:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.581382:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456320:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.581394:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456448:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147191.581785:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466456576:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.581814:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.581829:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ce00, rc 0) 00000100:00100000:3.0:1746147191.581876:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:29075:x1830967463879936:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8618us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.581884:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11979 00000100:00100000:0.0:1746147191.583609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.583788:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880320 00000100:00100000:3.0:1746147191.583795:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880320 00000100:00100000:3.0:1746147191.583840:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11980 00000100:00100000:3.0:1746147191.583846:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29083:x1830967463880320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.583860:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.583872:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e722b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.583893:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.583899:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.583901:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.583903:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.583926:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.583951:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.583961:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466456704:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147191.584703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.585135:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.585188:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880448 00000100:00100000:2.0:1746147191.585192:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880448 00000100:00100000:0.0:1746147191.585196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.585213:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.585229:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880576 00000100:00100000:2.0:1746147191.585231:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880576 00010000:00010000:2.0:1746147191.585239:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 25 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.585251:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5967 00000100:00100000:0.0:1746147191.585252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.585257:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463880448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.585265:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.585281:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585289:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.585300:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880704 00010000:00010000:2.0:1746147191.585303:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278c00/0xb4b2209fbdac74a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7136 expref: 11 pid: 8480 timeout: 678 lvb_type: 1 00000100:00100000:1.0:1746147191.585303:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880704 00010000:00010000:1.0:1746147191.585315:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 49 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585316:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.585330:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5968 00000100:00100000:1.0:1746147191.585335:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463880576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147191.585337:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463880448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 80us (635us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147191.585341:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147191.585343:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5967 00010000:00010000:1.0:1746147191.585350:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 25 pid: 11147 timeout: 678 lvb_type: 1 00000100:00100000:2.0:1746147191.585355:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5969 00000100:00100000:2.0:1746147191.585360:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1956:x1830967463880704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.585362:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 25 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585367:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.585373:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d000/0xb4b2209fbdac75f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71c2 expref: 25 pid: 11147 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585374:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 49 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585381:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 49 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:1.0:1746147191.585386:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147191.585391:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea34400/0xb4b2209fbdac75a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7191 expref: 49 pid: 4445 timeout: 678 lvb_type: 1 00010000:00010000:2.0:1746147191.585398:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.585399:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147191.585402:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463880576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (206us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147191.585404:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.585407:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5968 00010000:00010000:2.0:1746147191.585410:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.585429:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 9 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.585437:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466456832:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.585475:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.588834:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463880192:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10951us (11570us total) trans 0 rc 368640/368640 00000100:00100000:3.0:1746147191.588843:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4643 00002000:00100000:3.0:1746147191.588852:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2777088->3145727) req@ffff88009ef7dc00 x1830967463880192/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.588865:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef7dc00 with x1830967463880192 ext(2777088->3145727) 00010000:00010000:3.0:1746147191.588874:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.588886:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.588892:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef7dc00 00000100:00100000:3.0:1746147191.589291:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466456704:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.589307:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 36 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.589319:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9d800, rc 0) 00000100:00100000:3.0:1746147191.589350:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29083:x1830967463880320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5504us (5745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.589356:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11980 00000100:00100000:2.0:1746147191.589527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.590330:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880832 00000100:00100000:3.0:1746147191.590336:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880832 00002000:00100000:3.0:1746147191.590359:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2777087) req@ffff880093d34a80 x1830967463880832/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.590365:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34a80 with x1830967463880832 ext(2097152->2777087) 00010000:00010000:3.0:1746147191.590370:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.590379:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 33 pid: 17548 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.590386:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093d34a80 00000100:00100000:3.0:1746147191.591615:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1589 00000100:00100000:3.0:1746147191.591623:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1957:x1830967463880832:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147191.592888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.592973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.593049:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466456832:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.593067:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.593098:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1956:x1830967463880704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7737us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.593105:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5969 00000100:00100000:2.0:1746147191.593131:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463880960 00000100:00100000:2.0:1746147191.593135:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463880960 00000100:00100000:2.0:1746147191.593152:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881088 00000100:00100000:2.0:1746147191.593154:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881088 00000100:00100000:2.0:1746147191.593170:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11981 00000100:00100000:2.0:1746147191.593174:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:29075:x1830967463880960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.593183:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.593196:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7232 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593216:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593223:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593228:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.593230:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.593233:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593255:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593263:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 33 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.593273:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466456960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.593314:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593321:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.593328:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466457088:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.593344:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.593357:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11982 00000100:00100000:2.0:1746147191.593362:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29088:x1830967463881088:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.593369:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.593377:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7239 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593389:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 47 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593395:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.593396:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.593398:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593413:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 47 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.593421:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 47 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.593428:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466457216:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.593448:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.600670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.602068:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466456960:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.602078:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466457088:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.602104:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.602118:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48ca00, rc 0) 00000100:00100000:2.0:1746147191.602159:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:29075:x1830967463880960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8983us (9271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.602166:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11981 00000100:00100000:0.0:1746147191.602613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.602651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.602682:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881344 00000100:00100000:0.0:1746147191.602686:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881344 00002000:00100000:0.0:1746147191.602713:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2322432->2338815) req@ffff8800929f4700 x1830967463881344/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 16872/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.602720:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4700 with x1830967463881344 ext(2322432->2338815) 00010000:00010000:0.0:1746147191.602727:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 48 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.602736:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 48 pid: 17548 timeout: 678 lvb_type: 0 00002000:00010000:0.0:1746147191.602742:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929f4700 00000100:00100000:0.0:1746147191.602757:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1590 00000100:00100000:0.0:1746147191.602763:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+48:1957:x1830967463881344:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147191.603041:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463881344:12345-192.168.203.36@tcp:4:cat.0 Request processed in 277us (2377us total) trans 17179873263 rc 0/0 00000100:00100000:0.0:1746147191.603046:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1590 00002000:00100000:0.0:1746147191.603051:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2322432->2338815) req@ffff8800929f4700 x1830967463881344/t17179873263(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 16872/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.603057:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4700 with x1830967463881344 ext(2322432->2338815) 00010000:00010000:0.0:1746147191.603062:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.603070:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00002000:00010000:0.0:1746147191.603075:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929f4700 00000100:00100000:1.0:1746147191.603134:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881216 00000100:00100000:1.0:1746147191.603137:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881216 00010000:00010000:1.0:1746147191.603153:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.603167:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881472 00000100:00100000:1.0:1746147191.603169:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881472 00010000:00010000:1.0:1746147191.603176:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.603189:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5970 00000100:00100000:1.0:1746147191.603194:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1957:x1830967463881216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.603201:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.603215:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603223:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603239:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9cac00/0xb4b2209fbdac764b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7216 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603251:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.603265:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1957:x1830967463881216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.603270:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5970 00000100:00100000:1.0:1746147191.603279:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5971 00000100:00100000:1.0:1746147191.603283:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463881472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.603288:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.603294:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603300:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603308:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7644 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e720f expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.603315:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.603317:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.603322:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.603329:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.603349:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.603358:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457344:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.603390:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.603604:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466457216:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.603618:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.603626:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48c200, rc 0) 00000100:00100000:2.0:1746147191.603643:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29088:x1830967463881088:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10280us (10671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.603648:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11982 00000100:00100000:3.0:1746147191.605544:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1957:x1830967463880832:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13915us (16012us total) trans 21474840674 rc 0/0 00000100:00100000:3.0:1746147191.605553:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1589 00002000:00100000:3.0:1746147191.605562:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2777087) req@ffff880093d34a80 x1830967463880832/t21474840674(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.605578:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34a80 with x1830967463880832 ext(2097152->2777087) 00010000:00010000:3.0:1746147191.605585:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.605595:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.605601:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093d34a80 00000100:00100000:0.0:1746147191.606023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.606193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.606365:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457344:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.606379:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.606398:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463881472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3114us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.606405:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5971 00000100:00100000:1.0:1746147191.606419:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881600 00000100:00100000:1.0:1746147191.606423:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881600 00010000:00010000:1.0:1746147191.606435:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.606450:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5972 00000100:00100000:1.0:1746147191.606455:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463881600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.606464:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147191.606476:0:16058:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147190 -> 1746147191 00002000:00010000:1.0:1746147191.606479:0:16058:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00010000:00010000:1.0:1746147191.606483:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.606491:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.606508:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6278200/0xb4b2209fbdac7636 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2338815) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7201 expref: 50 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.606518:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.606520:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.606526:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.606533:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.606555:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.606564:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466457472:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.606639:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.606999:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881728 00000100:00100000:3.0:1746147191.607003:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881728 00000100:00100000:1.0:1746147191.607536:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466457472:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.607544:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.608443:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11983 00000100:00100000:3.0:1746147191.608452:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:29075:x1830967463881728:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147191.608464:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.608476:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7240 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.608498:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.608503:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.608508:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147191.608511:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.608529:0:17548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.608539:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.608546:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edad000, rc 0) 00000100:00100000:1.0:1746147191.609481:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967463881600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3023us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.609488:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5972 00000100:00100000:0.0:1746147191.609739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.609825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.611379:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:29075:x1830967463881728:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2924us (5181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.611387:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11983 00000100:00100000:3.0:1746147191.611410:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882112 00000100:00100000:3.0:1746147191.611415:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882112 00002000:00100000:3.0:1746147191.611439:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937eed80 x1830967463882112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.611448:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eed80 with x1830967463882112 ext(2097152->3145727) 00002000:00010000:3.0:1746147191.611452:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eed80 00000100:00100000:3.0:1746147191.611463:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4644 00000100:00100000:3.0:1746147191.611468:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463882112:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.612130:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463881856 00000100:00100000:1.0:1746147191.612133:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463881856 00010000:00010000:1.0:1746147191.612149:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.612178:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5973 00000100:00100000:1.0:1746147191.612182:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463881856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.612189:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147191.612199:0:16058:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147190 -> 1746147191 00002000:00010000:1.0:1746147191.612202:0:16058:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00010000:00010000:1.0:1746147191.612206:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.612216:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.612233:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6312400/0xb4b2209fbdac763d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7208 expref: 34 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.612243:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.612245:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.612251:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.612258:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.612280:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.612289:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 34 pid: 17530 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.612298:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457728:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.612351:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.615653:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457728:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.615669:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.615702:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463881856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3518us (5963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.615710:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5973 00000100:00100000:3.0:1746147191.621457:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463882112:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9980us (11623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.621468:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4644 00002000:00100000:3.0:1746147191.621478:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937eed80 x1830967463882112/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.621487:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937eed80 with x1830967463882112 ext(2097152->3145727) 00002000:00010000:3.0:1746147191.621492:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937eed80 00000100:00100000:1.0:1746147191.622741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.622928:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882368 00000100:00100000:3.0:1746147191.622949:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882368 00002000:00100000:3.0:1746147191.622982:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f4380 x1830967463882368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.622990:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4380 with x1830967463882368 ext(2097152->3145727) 00010000:00010000:3.0:1746147191.622997:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.623010:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.623016:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f4380 00000100:00100000:3.0:1746147191.623031:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1591 00000100:00100000:3.0:1746147191.623037:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463882368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.636315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.636644:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882496 00000100:00100000:3.0:1746147191.636651:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882496 00000100:00100000:3.0:1746147191.636692:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11984 00000100:00100000:3.0:1746147191.636697:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+33:29088:x1830967463882496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.636710:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.636723:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7247 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.636742:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.636746:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.636751:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.636754:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.636781:0:17548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.636791:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.636799:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865800, rc 0) 00000100:00100000:2.0:1746147191.636865:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463882368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13827us (14126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.636874:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1591 00002000:00100000:2.0:1746147191.636881:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800929f4380 x1830967463882368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.636889:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929f4380 with x1830967463882368 ext(2097152->3145727) 00010000:00010000:2.0:1746147191.636895:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.636905:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.636911:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929f4380 00000100:00100000:3.0:1746147191.637144:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29088:x1830967463882496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 445us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.637150:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11984 00000100:00100000:0.0:1746147191.647408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.647463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.647537:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882624 00000100:00100000:2.0:1746147191.647545:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882624 00000100:00100000:1.0:1746147191.647637:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882752 00000100:00100000:1.0:1746147191.647642:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882752 00010000:00010000:1.0:1746147191.647662:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.647681:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5974 00000100:00100000:1.0:1746147191.647687:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463882752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.647698:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.647716:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.647727:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.647746:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9d800/0xb4b2209fbdac7660 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e722b expref: 35 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.647761:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.647762:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.647768:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.647775:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.647789:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11985 00000100:00100000:2.0:1746147191.647796:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+49:29083:x1830967463882624:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.647804:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.647809:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.647813:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 12 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.647821:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e724e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.647823:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457984:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.647847:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.647848:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.647853:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.647863:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.647875:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48000, rc 0) 00000100:00100000:1.0:1746147191.647880:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.647897:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+50:29083:x1830967463882624:12345-192.168.203.36@tcp:101:cat.0 Request processed in 101us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.647902:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11985 00000100:00100000:1.0:1746147191.652208:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466457984:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.652230:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.652278:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463882752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4589us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.652287:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5974 00000100:00100000:0.0:1746147191.654523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.654842:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463882880 00000100:00100000:2.0:1746147191.654849:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463882880 00000100:00100000:2.0:1746147191.654897:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11986 00000100:00100000:2.0:1746147191.654904:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463882880:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147191.654919:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.654964:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7255 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.654990:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.654998:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 49 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.655004:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.655006:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.655008:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.655035:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 49 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.655049:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 49 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.655060:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466458112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.655143:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.655151:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 24 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.655159:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466458240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.655249:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.659255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.659457:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883136 00000100:00100000:2.0:1746147191.659464:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883136 00002000:00100000:2.0:1746147191.659500:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937edc00 x1830967463883136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.659510:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edc00 with x1830967463883136 ext(2097152->3145727) 00010000:00010000:2.0:1746147191.659517:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.659528:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.659534:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937edc00 00000100:00100000:3.0:1746147191.659863:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466458240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.660027:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1592 00000100:00100000:2.0:1746147191.660035:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463883136:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147191.662250:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466458112:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.662278:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.662297:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49a00, rc 0) 00000100:00100000:3.0:1746147191.662324:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+11:29075:x1830967463882880:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7419us (7806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.662331:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11986 00000100:00100000:0.0:1746147191.663631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.664299:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883264 00000100:00100000:1.0:1746147191.664309:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883264 00010000:00010000:1.0:1746147191.664348:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.664377:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5975 00000100:00100000:1.0:1746147191.664385:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463883264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.664402:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.664424:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.664435:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.664458:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac766e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7239 expref: 25 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.664488:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.664529:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463883264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 145us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.664535:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5975 00000100:00100000:3.0:1746147191.673484:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463883136:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13444us (14229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147191.673495:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1592 00002000:00100000:3.0:1746147191.673504:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800937edc00 x1830967463883136/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.673512:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937edc00 with x1830967463883136 ext(2097152->3145727) 00010000:00010000:3.0:1746147191.673520:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.673532:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00002000:00010000:3.0:1746147191.673538:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937edc00 00000100:00100000:0.0:1746147191.677367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.677781:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883520 00000100:00100000:2.0:1746147191.677791:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883520 00000100:00100000:2.0:1746147191.677839:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10575 00000100:00100000:2.0:1746147191.677846:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29092:x1830967463883520:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147191.677870:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.677888:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e725c expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.678012:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678025:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678034:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678048:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678053:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678058:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678162:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678168:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678174:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147191.678182:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147191.678252:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678257:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678262:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678267:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e48dc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.678271:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678276:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678284:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.678286:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147191.678290:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678293:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48dc00/0xb4b2209fbdac76a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678319:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678324:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678331:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678335:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4678e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.678337:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678341:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678347:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147191.678349:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147191.678350:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678354:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678360:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678364:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678367:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678371:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e48c200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.678373:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678377:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678385:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48700) 00010000:00010000:2.0:1746147191.678387:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147191.678388:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.678392:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c200/0xb4b2209fbdac769f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.680318:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7691 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e725c expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.680330:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e725c expref: 10 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.680345:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678200, rc 0) 00000100:00100000:2.0:1746147191.680422:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+9:29092:x1830967463883520:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2574us (3064us total) trans 8589944328 rc 301/301 00000100:00100000:2.0:1746147191.680430:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10575 00000100:00100000:0.0:1746147191.683156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.683604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.683691:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883776 00000100:00100000:1.0:1746147191.683702:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883776 00010000:00010000:1.0:1746147191.683738:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.683770:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5976 00000100:00100000:1.0:1746147191.683778:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1958:x1830967463883776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.683795:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.683818:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.683829:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.683851:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac7683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e724e expref: 50 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.683860:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883648 00000100:00100000:3.0:1746147191.683870:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883648 00000100:00100000:3.0:1746147191.683918:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11987 00000100:00100000:3.0:1746147191.683924:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+34:29083:x1830967463883648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.683972:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.683987:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7263 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.684015:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147191.684020:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.684029:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.684038:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865a00, rc 0) 00000100:00100000:3.0:1746147191.684082:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29083:x1830967463883648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 158us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.684087:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11987 00010000:00010000:1.0:1746147191.684395:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.684398:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.684406:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.684415:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.684447:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.684459:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466458368:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.684535:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.687163:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466458368:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.687191:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.687250:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1958:x1830967463883776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3471us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.687262:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5976 00000100:00100000:0.0:1746147191.688267:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.688404:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463883904 00000100:00100000:0.0:1746147191.688410:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463883904 00000100:00100000:0.0:1746147191.688444:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884160 00000100:00100000:0.0:1746147191.688446:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884160 00000100:00100000:0.0:1746147191.688459:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884416 00000100:00100000:0.0:1746147191.688460:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884416 00000100:00100000:0.0:1746147191.688469:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884032 00000100:00100000:0.0:1746147191.688470:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884032 00000100:00100000:0.0:1746147191.688478:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884288 00000100:00100000:0.0:1746147191.688480:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884288 00000100:00100000:0.0:1746147191.688486:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884544 00000100:00100000:0.0:1746147191.688488:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884544 00000100:00100000:0.0:1746147191.688498:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11988 00000100:00100000:0.0:1746147191.688505:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463883904:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:0.0:1746147191.688717:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147191.688720:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:0.0:1746147191.688722:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147189 -> 1746147190 00002000:00010000:0.0:1746147191.688724:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00002000:00010000:0.0:1746147191.688726:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:0.0:1746147191.688758:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463883904:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 252us (491us total) trans 21474840675 rc 0/0 00000100:00100000:0.0:1746147191.688764:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11988 00000100:00100000:0.0:1746147191.688776:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11989 00000100:00100000:0.0:1746147191.688785:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463884160:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:3.0:1746147191.688877:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11990 00000100:00100000:3.0:1746147191.688885:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463884416:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147191.688984:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4945696 -> 4945696 00002000:00010000:3.0:1746147191.688987:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147191 -> 1746147190 00002000:00010000:3.0:1746147191.688988:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.688990:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147191 -> 1746147191 00002000:00010000:3.0:1746147191.688992:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5599 -> 5599 00000100:00100000:3.0:1746147191.689011:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463884416:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 128us (680us total) trans 21474840676 rc 0/0 00000100:00100000:3.0:1746147191.689016:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11990 00000100:00100000:3.0:1746147191.689027:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11991 00000100:00100000:3.0:1746147191.689031:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463884032:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147191.689116:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147191.689119:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.689120:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:3.0:1746147191.689122:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00002000:00010000:3.0:1746147191.689123:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147191.689138:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463884032:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 106us (785us total) trans 17179873264 rc 0/0 00000100:00100000:3.0:1746147191.689143:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11991 00000100:00100000:3.0:1746147191.689152:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11992 00000100:00100000:3.0:1746147191.689156:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463884288:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147191.689190:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11993 00000100:00100000:1.0:1746147191.689209:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463884544:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:3.0:1746147191.689215:0:17548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147191.689218:0:17548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147191 -> 1746147190 00002000:00010000:3.0:1746147191.689219:0:17548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147189 -> 1746147190 00002000:00010000:3.0:1746147191.689221:0:17548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147191 -> 1746147191 00002000:00010000:3.0:1746147191.689223:0:17548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147191.689238:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463884288:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 81us (870us total) trans 21474840677 rc 0/0 00000100:00100000:3.0:1746147191.689243:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11992 00002000:00010000:1.0:1746147191.689526:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147191.689529:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147191 -> 1746147190 00002000:00010000:1.0:1746147191.689531:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147190 -> 1746147190 00002000:00010000:1.0:1746147191.689533:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147191 -> 1746147191 00002000:00010000:1.0:1746147191.689534:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147191.689583:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463884544:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 381us (1195us total) trans 17179873265 rc 0/0 00000100:00100000:1.0:1746147191.689589:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11993 00002000:00010000:0.0:1746147191.689631:0:8478:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147191.689634:0:8478:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147190 -> 1746147190 00002000:00010000:0.0:1746147191.689636:0:8478:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147189 -> 1746147190 00002000:00010000:0.0:1746147191.689637:0:8478:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147190 -> 1746147191 00002000:00010000:0.0:1746147191.689639:0:8478:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147191.689657:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463884160:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 871us (1353us total) trans 17179873266 rc 0/0 00000100:00100000:0.0:1746147191.689661:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11989 00000100:00100000:2.0:1746147191.691161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.691290:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884672 00000100:00100000:1.0:1746147191.691298:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884672 00000100:00100000:2.0:1746147191.691319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147191.691325:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 16 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.691348:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5977 00000100:00100000:1.0:1746147191.691355:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+16:1956:x1830967463884672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.691365:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.691379:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 16 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.691390:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 16 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.691416:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edad000/0xb4b2209fbdac7675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7240 expref: 16 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.691477:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463884928 00000100:00100000:0.0:1746147191.691481:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463884928 00000100:00100000:0.0:1746147191.691505:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4202 00000100:00100000:0.0:1746147191.691509:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+8:29075:x1830967463884928:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1746147191.691680:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+9:29075:x1830967463884928:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 169us (360us total) trans 8589944329 rc 0/0 00000100:00100000:0.0:1746147191.691686:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4202 00010000:00010000:1.0:1746147191.691956:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.691958:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.691966:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.691973:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.691981:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.691982:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.691985:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.691991:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.692020:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.692032:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466458496:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.692101:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.692114:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466458624:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.692132:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.697212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.697238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.697322:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463885184 00000100:00100000:2.0:1746147191.697333:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463885184 00000100:00100000:1.0:1746147191.697345:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466458496:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.697355:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466458624:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.697378:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.697393:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4203 00000100:00100000:2.0:1746147191.697400:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:29075:x1830967463885184:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147191.697859:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463885440 00000100:00100000:3.0:1746147191.697865:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463885440 00000100:00100000:1.0:1746147191.697893:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463884672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6537us (6736us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147191.697900:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e134a80 x1830967463885440/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147191.697902:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5977 00002000:00100000:3.0:1746147191.697909:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463885440 ext(3145728->4194303) 00002000:00010000:3.0:1746147191.697913:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134a80 00000100:00100000:2.0:1746147191.697927:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:29075:x1830967463885184:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 526us (723us total) trans 8589944330 rc 0/0 00000100:00100000:3.0:1746147191.697932:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4645 00000100:00100000:2.0:1746147191.697934:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4203 00000100:00100000:3.0:1746147191.697957:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1958:x1830967463885440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.698660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.698866:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463885696 00000100:00100000:1.0:1746147191.698869:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463885696 00002000:00100000:1.0:1746147191.698886:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137480 x1830967463885696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147191.698893:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137480 with x1830967463885696 ext(3145728->4194303) 00002000:00010000:1.0:1746147191.698896:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137480 00000100:00100000:1.0:1746147191.698908:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4646 00000100:00100000:1.0:1746147191.698913:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463885696:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.710613:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463885696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11687us (11941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.710626:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4646 00002000:00100000:2.0:1746147191.710638:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e137480 x1830967463885696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.710647:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e137480 with x1830967463885696 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.710653:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e137480 00000100:00100000:2.0:1746147191.714373:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1958:x1830967463885440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16423us (17122us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.714385:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4645 00002000:00100000:2.0:1746147191.714397:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e134a80 x1830967463885440/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.714406:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134a80 with x1830967463885440 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.714411:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e134a80 00000100:00100000:0.0:1746147191.715663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.717352:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463885824 00000100:00100000:2.0:1746147191.717365:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463885824 00000100:00100000:2.0:1746147191.717422:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11994 00000100:00100000:2.0:1746147191.717430:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+49:29083:x1830967463885824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.717451:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.717470:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e726a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.717502:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.717513:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.717514:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147191.717517:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.717547:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.717559:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 13 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.717581:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466458752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.717694:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.717832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.717977:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463885952 00000100:00100000:0.0:1746147191.717982:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463885952 00000100:00100000:0.0:1746147191.718014:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11995 00000100:00100000:0.0:1746147191.718019:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29088:x1830967463885952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.718026:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.718033:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7271 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.718120:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147191.718124:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.718133:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 25 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.718143:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edace00, rc 0) 00000100:00100000:0.0:1746147191.718685:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29088:x1830967463885952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 664us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.718691:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11995 00000100:00100000:0.0:1746147191.721532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.721868:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886080 00000100:00100000:1.0:1746147191.721879:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886080 00010000:00010000:1.0:1746147191.721919:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 14 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.721982:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5978 00000100:00100000:1.0:1746147191.721990:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463886080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.722004:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.722026:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 14 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.722037:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 14 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.722060:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.722062:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.722064:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f49a00/0xb4b2209fbdac768a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7255 expref: 14 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.722070:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.722077:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.722082:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466458752:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.722084:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.722085:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.722088:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.722094:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.722110:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.722118:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48d800, rc 0) 00010000:00010000:1.0:1746147191.722120:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 24 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.722130:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466458880:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.722158:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+50:29083:x1830967463885824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4729us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.722164:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11994 00010000:00010000:1.0:1746147191.722183:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 49 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.722190:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466459008:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.722207:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.727924:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4fadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466458880:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147191.727962:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4faf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466459008:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.727989:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.728016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.728037:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463886080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6047us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.728048:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5978 00000100:00100000:2.0:1746147191.728057:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886336 00000100:00100000:2.0:1746147191.728066:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886336 00002000:00100000:2.0:1746147191.728112:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e134700 x1830967463886336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.728122:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134700 with x1830967463886336 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.728127:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134700 00000100:00100000:2.0:1746147191.728143:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4647 00000100:00100000:2.0:1746147191.728149:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463886336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.729205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.729310:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886592 00000100:00100000:0.0:1746147191.729315:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886592 00002000:00100000:0.0:1746147191.729335:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4faf480 x1830967463886592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.729343:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967463886592 ext(3145728->4194303) 00002000:00010000:0.0:1746147191.729347:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faf480 00000100:00100000:0.0:1746147191.729373:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4648 00000100:00100000:0.0:1746147191.729378:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967463886592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.738089:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463886336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9926us (10062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147191.738102:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4647 00002000:00100000:2.0:1746147191.738115:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e134700 x1830967463886336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.738124:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e134700 with x1830967463886336 ext(3145728->4194303) 00002000:00010000:2.0:1746147191.738130:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e134700 00000100:00100000:0.0:1746147191.741735:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967463886592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12344us (12519us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147191.741749:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4648 00002000:00100000:0.0:1746147191.741762:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4faf480 x1830967463886592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.741772:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4faf480 with x1830967463886592 ext(3145728->4194303) 00002000:00010000:0.0:1746147191.741778:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4faf480 00000100:00100000:0.0:1746147191.742290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.742354:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886720 00000100:00100000:2.0:1746147191.742362:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886720 00000100:00100000:2.0:1746147191.742397:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11996 00000100:00100000:2.0:1746147191.742406:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29092:x1830967463886720:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147191.742422:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.742439:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7278 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.742468:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.742481:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.742487:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.742488:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.742491:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.742865:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.742878:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 34 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.742890:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466459136:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.743483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.743541:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.743549:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.743557:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466459264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.743590:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.743636:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886848 00000100:00100000:0.0:1746147191.743640:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886848 00000100:00100000:0.0:1746147191.743663:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11997 00000100:00100000:0.0:1746147191.743668:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1958:x1830967463886848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.743677:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.743686:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac76d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e727f expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.743716:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466459392:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147191.743738:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.744289:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.744318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.744352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.744404:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463886976 00000100:00100000:3.0:1746147191.744409:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463886976 00000100:00100000:2.0:1746147191.744412:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887104 00000100:00100000:2.0:1746147191.744414:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887104 00000100:00100000:3.0:1746147191.744428:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887232 00000100:00100000:3.0:1746147191.744430:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887232 00000100:00100000:2.0:1746147191.744472:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11998 00000100:00100000:2.0:1746147191.744478:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463886976:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147191.744482:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11999 00000100:00100000:3.0:1746147191.744487:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463887104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.744487:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.744492:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.744498:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac76de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e728d expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.744498:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac76d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7286 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.744524:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466459520:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.744556:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.744587:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12000 00000100:00100000:3.0:1746147191.744593:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1958:x1830967463887232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.744599:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.744607:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865000/0xb4b2209fbdac76e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7294 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.744628:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466459648:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.744823:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.744878:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466459776:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.744895:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466459136:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.744902:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.745517:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466459264:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.745546:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.745559:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48d000, rc 0) 00000100:00100000:2.0:1746147191.745606:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+39:29092:x1830967463886720:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3200us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.745613:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11996 00000100:00100000:2.0:1746147191.746195:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466459392:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.746213:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac76d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e727f expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.746222:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edac000/0xb4b2209fbdac76d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e727f expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.746235:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edac000, rc 0) 00000100:00100000:2.0:1746147191.746258:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1958:x1830967463886848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2589us (2776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.746265:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11997 00000100:00100000:3.0:1746147191.746451:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466459520:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.746465:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac76de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e728d expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.746479:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac76de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e728d expref: 28 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.746500:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865600, rc 0) 00000100:00100000:3.0:1746147191.746531:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463887104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2044us (2212us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.746536:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11999 00000100:00100000:3.0:1746147191.746581:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466459648:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.746594:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f865000/0xb4b2209fbdac76e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7294 expref: 36 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.746602:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865000/0xb4b2209fbdac76e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7294 expref: 36 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.746608:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865000, rc 0) 00000100:00100000:3.0:1746147191.746628:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1958:x1830967463887232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2035us (2275us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.746633:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12000 00000100:00100000:0.0:1746147191.749417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.749910:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887360 00000100:00100000:1.0:1746147191.749921:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887360 00010000:00010000:1.0:1746147191.749985:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.750027:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5979 00000100:00100000:1.0:1746147191.750035:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463887360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.750049:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.750073:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750083:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750107:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865a00/0xb4b2209fbdac76b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7263 expref: 35 pid: 6881 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750135:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147191.750180:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463887360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 146us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.750186:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5979 00000100:00100000:1.0:1746147191.750230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.750363:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463888128 00000100:00100000:1.0:1746147191.750366:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463888128 00010000:00010000:1.0:1746147191.750377:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.750398:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5980 00000100:00100000:1.0:1746147191.750403:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1956:x1830967463888128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147191.750410:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147191.750419:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750428:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750440:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865800/0xb4b2209fbdac767c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7247 expref: 35 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:1.0:1746147191.750450:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.750451:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.750458:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.750466:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.750490:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887616 00000100:00100000:3.0:1746147191.750494:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887616 00010000:00010000:1.0:1746147191.750496:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 34 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.750508:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466459904:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.750513:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887872 00000100:00100000:3.0:1746147191.750515:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887872 00000100:00100000:3.0:1746147191.750525:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887488 00000100:00100000:3.0:1746147191.750526:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887488 00000100:00100000:3.0:1746147191.750536:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12001 00000100:00100000:3.0:1746147191.750541:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463887616:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.750555:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147191.750563:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147191.750576:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f865400/0xb4b2209fbdac76ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72a2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.750590:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463887744 00000100:00100000:1.0:1746147191.750593:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463887744 00000100:00100000:3.0:1746147191.750607:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466460032:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.750607:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463888000 00000100:00100000:1.0:1746147191.750609:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463888000 00000100:00100000:1.0:1746147191.750617:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12002 00000100:00100000:1.0:1746147191.750621:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463887872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.750628:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147191.750629:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147191.750635:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac76f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72b0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.750642:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12003 00000100:00100000:3.0:1746147191.750647:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463887488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.750651:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.750657:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864800/0xb4b2209fbdac76fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e729b expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.750660:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466460160:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.750673:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466460288:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.750682:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.750687:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.750698:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12004 00000100:00100000:1.0:1746147191.750703:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967463887744:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147191.750711:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12005 00000100:00100000:3.0:1746147191.750715:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463888000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.750721:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.750726:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864200/0xb4b2209fbdac7701 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72b7 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.750745:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466460416:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.750763:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.751169:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466459776:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.751194:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac76d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7286 expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.751204:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac76d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7286 expref: 26 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.751213:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678c00, rc 0) 00000100:00100000:2.0:1746147191.751237:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463886976:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6759us (6948us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.751242:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11998 00010000:00010000:1.0:1746147191.751923:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.751932:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e5ec00/0xb4b2209fbdac7708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72a9 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.751971:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466460544:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.752733:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.754897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.754924:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463888384 00000100:00100000:0.0:1746147191.754931:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463888384 00000100:00100000:3.0:1746147191.754978:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466460032:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.755001:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466459904:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.755010:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f865400/0xb4b2209fbdac76ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72a2 expref: 53 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.755020:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147191.755023:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f865400/0xb4b2209fbdac76ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72a2 expref: 53 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.755034:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865400, rc 0) 00002000:00100000:0.0:1746147191.755039:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2580480->2584575) req@ffff88008e135c00 x1830967463888384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.755049:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135c00 with x1830967463888384 ext(2580480->2584575) 00002000:00010000:0.0:1746147191.755054:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135c00 00000100:00100000:0.0:1746147191.755079:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4649 00000100:00100000:1.0:1746147191.755192:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466460160:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.755210:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac76f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72b0 expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.755220:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac76f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72b0 expref: 39 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.755228:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5f200, rc 0) 00000100:00100000:2.0:1746147191.755284:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1956:x1830967463888128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4878us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.755286:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1957:x1830967463887616:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4743us (5054us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.755293:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12001 00000100:00100000:2.0:1746147191.755295:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5980 00000100:00100000:0.0:1746147191.755310:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1956:x1830967463888384:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147191.755448:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463888384:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 362us (564us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147191.755454:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4649 00002000:00100000:0.0:1746147191.755459:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2580480->2584575) req@ffff88008e135c00 x1830967463888384/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.755466:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e135c00 with x1830967463888384 ext(2580480->2584575) 00002000:00010000:0.0:1746147191.755470:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e135c00 00000100:00100000:1.0:1746147191.755694:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463887872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5070us (5388us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.755701:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12002 00000100:00100000:1.0:1746147191.755761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.755924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.755952:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463888896 00000100:00100000:0.0:1746147191.755955:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463888896 00002000:00100000:0.0:1746147191.755969:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88008e136a00 x1830967463888896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.755977:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136a00 with x1830967463888896 ext(4194304->4947967) 00002000:00010000:0.0:1746147191.755979:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e136a00 00000100:00100000:0.0:1746147191.755991:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4650 00000100:00100000:0.0:1746147191.755996:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1957:x1830967463888896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.756002:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463888768 00000100:00100000:2.0:1746147191.756008:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463888768 00000100:00100000:3.0:1746147191.756014:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466460288:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.756029:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864800/0xb4b2209fbdac76fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e729b expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.756038:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f864800/0xb4b2209fbdac76fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e729b expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147191.756039:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10576 00000100:00100000:2.0:1746147191.756044:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29096:x1830967463888768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147191.756046:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864800, rc 0) 00010000:00010000:2.0:1746147191.756064:0:14047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147191.756066:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463887488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5418us (5747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.756072:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12003 00010000:00010000:2.0:1746147191.756078:0:14047:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278c00/0xb4b2209fbdac770f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72be expref: -99 pid: 14047 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147191.756102:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:3.0:1746147191.756105:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147190 -> 1746147191 00000100:00100000:3.0:1746147191.756116:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466460416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.756131:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864200/0xb4b2209fbdac7701 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72b7 expref: 35 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.756142:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f864200/0xb4b2209fbdac7701 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72b7 expref: 35 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.756149:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864200, rc 0) 00010000:00010000:2.0:1746147191.756164:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00000100:00100000:3.0:1746147191.756165:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463888000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5449us (5823us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.756169:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12005 00010000:00010000:2.0:1746147191.756174:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756182:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756191:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756196:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756201:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756285:0:14047:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756291:0:14047:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756296:0:14047:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14047 initiator: MDT0 00000004:00200000:2.0:1746147191.756303:0:14047:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147191.756365:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756371:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756379:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756383:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6279200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.756387:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756392:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756400:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147191.756402:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147191.756405:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756409:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279200/0xb4b2209fbdac7716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756419:0:14047:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756423:0:14047:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756427:0:14047:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756431:0:14047:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6278e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147191.756433:0:14047:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756437:0:14047:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756446:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48700) 00010000:00010000:2.0:1746147191.756448:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147191.756450:0:14047:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756454:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278e00/0xb4b2209fbdac771d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14047 initiator: MDT0 00010000:00010000:2.0:1746147191.756482:0:14047:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6278c00/0xb4b2209fbdac770f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 307 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.756491:0:14047:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 306 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.756497:0:14047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147191.756499:0:14047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147191.756501:0:14047:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6279a00, rc 0) 00000100:00100000:2.0:1746147191.756544:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29096:x1830967463888768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 499us (782us total) trans 8589944331 rc 0/0 00000100:00100000:2.0:1746147191.756549:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10576 00000100:00100000:1.0:1746147191.756786:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466460544:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.756805:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132e5ec00/0xb4b2209fbdac7708 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72a9 expref: 51 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.756813:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e5ec00/0xb4b2209fbdac7708 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72a9 expref: 51 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.756820:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5ec00, rc 0) 00000100:00100000:1.0:1746147191.756835:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463887744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6132us (6506us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.756845:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12004 00000100:00100000:3.0:1746147191.759623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.759647:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889024 00000100:00100000:1.0:1746147191.759654:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889024 00000100:00100000:1.0:1746147191.759709:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12006 00000100:00100000:1.0:1746147191.759717:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:29083:x1830967463889024:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.759735:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.759753:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72c5 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.759783:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.759791:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.759793:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.759796:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.759826:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 35 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.759839:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 35 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.759852:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466460672:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.759919:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.763775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.763775:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466460672:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.763808:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 35 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.763820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147191.763826:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5e800, rc 0) 00000100:00100000:3.0:1746147191.763844:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889280 00000100:00100000:2.0:1746147191.763864:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889152 00000100:00100000:1.0:1746147191.763874:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29083:x1830967463889024:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4157us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.763881:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889152 00000100:00100000:1.0:1746147191.763883:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12006 00000100:00100000:2.0:1746147191.763966:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12007 00000100:00100000:3.0:1746147191.763973:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889280 00000100:00100000:2.0:1746147191.763975:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29092:x1830967463889152:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147191.763992:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746147191.764009:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2580480->3145727) req@ffff8800936ded80 x1830967463889280/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147191.764009:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72cc expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147191.764017:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830967463889280 ext(2580480->3145727) 00010000:00010000:3.0:1746147191.764024:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.764036:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.764038:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 49 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147191.764042:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936ded80 00010000:00010000:2.0:1746147191.764046:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.764051:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.764053:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.764056:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2125823] (req 2097152->2125823) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.764063:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1593 00000100:00100000:3.0:1746147191.764069:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1958:x1830967463889280:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147191.764082:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.764090:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.764101:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466460800:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147191.764187:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 49 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.764195:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 49 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.764203:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466460928:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.764223:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.764763:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463888896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8765us (8837us total) trans 0 rc 753664/753664 00000100:00100000:0.0:1746147191.764770:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4650 00002000:00100000:0.0:1746147191.764776:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88008e136a00 x1830967463888896/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.765273:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e136a00 with x1830967463888896 ext(4194304->4947967) 00010000:00010000:0.0:1746147191.765281:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.765290:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 36 pid: 8480 timeout: 678 lvb_type: 0 00002000:00010000:0.0:1746147191.765296:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e136a00 00000100:00100000:2.0:1746147191.772043:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466460800:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147191.772337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.772357:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889408 00000100:00100000:2.0:1746147191.772362:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889408 00010000:00010000:2.0:1746147191.772389:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 27 pid: 8478 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.772464:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466460928:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147191.772489:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->2125823] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.772502:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678c00, rc 0) 00000100:00100000:3.0:1746147191.772538:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29092:x1830967463889152:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8565us (8776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.772545:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12007 00000100:00100000:2.0:1746147191.772657:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5981 00000100:00100000:2.0:1746147191.772665:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463889408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.772675:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.772693:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.772702:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.772721:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edace00/0xb4b2209fbdac76c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7271 expref: 26 pid: 8478 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.772734:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.772753:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463889408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.772758:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5981 00000100:00100000:3.0:1746147191.772968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.773968:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889536 00000100:00100000:2.0:1746147191.773973:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889536 00010000:00010000:2.0:1746147191.773991:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.774012:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5982 00000100:00100000:2.0:1746147191.774017:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1957:x1830967463889536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.774026:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.774038:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.774047:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.774061:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48d800/0xb4b2209fbdac76bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e726a expref: 50 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.774072:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.774074:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.774079:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.774087:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.774112:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.774123:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466461056:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.774196:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.775194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.775232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.775411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.775503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.775518:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889664 00000100:00100000:3.0:1746147191.775526:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889664 00000100:00100000:3.0:1746147191.775563:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889792 00000100:00100000:3.0:1746147191.775574:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889792 00000100:00100000:3.0:1746147191.775588:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463889920 00000100:00100000:3.0:1746147191.775590:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463889920 00000100:00100000:3.0:1746147191.775609:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12008 00000100:00100000:3.0:1746147191.775617:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463889664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.775634:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.775651:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7740 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72d3 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.775699:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466461184:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.775726:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12009 00000100:00100000:2.0:1746147191.775736:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463889792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147191.775748:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147191.775759:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147191.775759:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac7747 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72da expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.775778:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12010 00000100:00100000:3.0:1746147191.775784:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463889920:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147191.775790:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466461312:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.775792:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.775801:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac774e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72e1 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.775826:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466461440:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.775833:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.775855:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.775965:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890048 00000100:00100000:1.0:1746147191.775969:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890048 00000100:00100000:0.0:1746147191.775972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.775994:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890176 00000100:00100000:0.0:1746147191.775995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.775996:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890176 00000100:00100000:1.0:1746147191.776007:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890304 00000100:00100000:1.0:1746147191.776008:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890304 00000100:00100000:1.0:1746147191.776024:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12011 00000100:00100000:1.0:1746147191.776028:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1957:x1830967463890048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.776035:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147191.776041:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466461056:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147191.776042:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e5e000/0xb4b2209fbdac7755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72e8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.776043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147191.776055:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.776059:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890560 00000100:00100000:0.0:1746147191.776062:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890560 00000100:00100000:1.0:1746147191.776069:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466461568:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.776082:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1957:x1830967463889536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2063us (3113us total) trans 0 rc 0/0 00002000:00100000:0.0:1746147191.776085:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2121728->2125823) req@ffff8801312a7480 x1830967463890560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147191.776089:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5982 00002000:00100000:0.0:1746147191.776093:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a7480 with x1830967463890560 ext(2121728->2125823) 00002000:00010000:0.0:1746147191.776098:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a7480 00000100:00100000:1.0:1746147191.776105:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.776111:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4651 00000100:00100000:1.0:1746147191.776116:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12012 00000100:00100000:0.0:1746147191.776116:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463890560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147191.776120:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+41:1957:x1830967463890176:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.776125:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.776131:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac775c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72ef expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.776138:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12013 00000100:00100000:2.0:1746147191.776144:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463890304:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147191.776149:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466461696:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.776151:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.776158:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864800/0xb4b2209fbdac7763 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72f6 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.776173:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.776178:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466461824:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.776199:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.776250:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967463890560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 132us (204us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147191.776256:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4651 00002000:00100000:0.0:1746147191.776261:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2121728->2125823) req@ffff8801312a7480 x1830967463890560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.776268:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a7480 with x1830967463890560 ext(2121728->2125823) 00002000:00010000:0.0:1746147191.776271:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312a7480 00000100:00100000:2.0:1746147191.776273:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+42:1958:x1830967463889280:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12203us (12451us total) trans 21474840678 rc 0/0 00000100:00100000:2.0:1746147191.776279:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1593 00002000:00100000:2.0:1746147191.776288:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2580480->3145727) req@ffff8800936ded80 x1830967463889280/t21474840678(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.776296:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830967463889280 ext(2580480->3145727) 00010000:00010000:2.0:1746147191.776302:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 42 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.776313:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 42 pid: 8480 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.776319:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936ded80 00000100:00100000:0.0:1746147191.778259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.778279:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890816 00000100:00100000:0.0:1746147191.778284:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890816 00000100:00100000:0.0:1746147191.778313:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4204 00000100:00100000:0.0:1746147191.778319:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:29092:x1830967463890816:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147191.778502:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29092:x1830967463890816:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 183us (249us total) trans 8589944332 rc 0/0 00000100:00100000:0.0:1746147191.778508:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4204 00000100:00100000:2.0:1746147191.778715:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466461312:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.778741:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac7747 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72da expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.778752:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c200/0xb4b2209fbdac7747 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72da expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.778763:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48c200, rc 0) 00000100:00100000:2.0:1746147191.778786:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463889792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3053us (3553us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.778791:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12009 00000100:00100000:3.0:1746147191.778886:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466461184:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.778904:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7740 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72d3 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.778913:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678e00/0xb4b2209fbdac7740 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72d3 expref: 41 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.778924:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678e00, rc 0) 00000100:00100000:3.0:1746147191.778960:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1957:x1830967463889664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3344us (3773us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.778965:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12008 00000100:00100000:3.0:1746147191.780901:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466461440:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.780929:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac774e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72e1 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.780966:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f48000/0xb4b2209fbdac774e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72e1 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.780975:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f48000, rc 0) 00000100:00100000:3.0:1746147191.781012:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463889920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5227us (5600us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.781022:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12010 00000100:00100000:0.0:1746147191.781667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.781831:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463890944 00000100:00100000:2.0:1746147191.781838:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463890944 00002000:00010000:3.0:1746147191.781846:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:3.0:1746147191.781849:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147190 -> 1746147191 00000100:00100000:3.0:1746147191.781859:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466461824:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.781864:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 40 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.781876:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864800/0xb4b2209fbdac7763 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72f6 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.781883:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864800/0xb4b2209fbdac7763 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72f6 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147191.781887:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5983 00010000:00010000:3.0:1746147191.781891:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864800, rc 0) 00000100:00100000:2.0:1746147191.781893:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1959:x1830967463890944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.781905:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147191.781912:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463890304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5769us (5917us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.781917:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12013 00010000:00010000:2.0:1746147191.781919:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 40 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.781928:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 40 pid: 8480 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.781968:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.781971:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.781980:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.781989:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.782025:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.782040:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466461952:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.782123:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00010000:00010000:2.0:1746147191.782166:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e48d000/0xb4b2209fbdac76c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7278 expref: 40 pid: 8480 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.782185:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466461696:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.782206:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac775c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72ef expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.782215:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e5f200/0xb4b2209fbdac775c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72ef expref: 39 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.782222:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5f200, rc 0) 00000100:00100000:2.0:1746147191.782247:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1957:x1830967463890176:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6124us (6273us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.782253:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12012 00000100:00100000:1.0:1746147191.782526:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466461568:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.782547:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132e5e000/0xb4b2209fbdac7755 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72e8 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.782558:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e5e000/0xb4b2209fbdac7755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72e8 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.782583:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5e000, rc 0) 00000100:00100000:1.0:1746147191.782610:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463890048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6580us (7106us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.782616:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12011 00000100:00100000:0.0:1746147191.786039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.786134:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891200 00000100:00100000:1.0:1746147191.786144:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891200 00000100:00100000:1.0:1746147191.786204:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12014 00000100:00100000:1.0:1746147191.786214:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+36:29088:x1830967463891200:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.786237:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.786257:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e72fd expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.786281:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.786283:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.786291:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 37 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.786304:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 37 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.786314:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e5ec00, rc 0) 00000100:00100000:1.0:1746147191.786358:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+37:29088:x1830967463891200:12345-192.168.203.36@tcp:101:cat.0 Request processed in 145us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.786364:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12014 00000100:00100000:0.0:1746147191.786393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.787172:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466461952:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.787192:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.787230:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1959:x1830967463890944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5337us (5565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.787238:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5983 00000100:00100000:3.0:1746147191.787784:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891456 00000100:00100000:3.0:1746147191.787790:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891456 00002000:00100000:3.0:1746147191.787823:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8801312a5c00 x1830967463891456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.787832:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5c00 with x1830967463891456 ext(4194304->4947967) 00002000:00010000:3.0:1746147191.787837:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5c00 00000100:00100000:3.0:1746147191.787851:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4652 00000100:00100000:3.0:1746147191.787857:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463891456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147191.791837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.791869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.791890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.791924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.791969:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891584 00000100:00100000:2.0:1746147191.791978:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891584 00000100:00100000:3.0:1746147191.792010:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891840 00000100:00100000:3.0:1746147191.792013:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891840 00000100:00100000:2.0:1746147191.792018:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891712 00000100:00100000:2.0:1746147191.792020:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891712 00000100:00100000:2.0:1746147191.792028:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463891968 00000100:00100000:2.0:1746147191.792030:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463891968 00000100:00100000:3.0:1746147191.792062:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12015 00000100:00100000:3.0:1746147191.792070:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1956:x1830967463891584:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.792094:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.792112:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac7771 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7304 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.792166:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466462080:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.792252:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.792272:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12016 00000100:00100000:3.0:1746147191.792277:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463891712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.792285:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.792299:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9cac00/0xb4b2209fbdac7778 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e730b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.792323:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466462208:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.792353:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a452d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.792369:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12017 00000100:00100000:3.0:1746147191.792375:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463891840:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.792381:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.792388:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df2c200/0xb4b2209fbdac777f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7312 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.792408:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466462336:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.792424:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.792495:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12018 00000100:00100000:1.0:1746147191.792503:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1956:x1830967463891968:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.792509:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.792516:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac7786 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7319 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.792537:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466462464:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.792563:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.795052:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463891456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7185us (8649us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147191.795065:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4652 00002000:00100000:3.0:1746147191.795075:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8801312a5c00 x1830967463891456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.795085:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a5c00 with x1830967463891456 ext(4194304->4947967) 00002000:00010000:3.0:1746147191.795090:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a5c00 00000100:00100000:2.0:1746147191.795821:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466462080:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.795855:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac7771 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7304 expref: 39 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.795874:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f49a00/0xb4b2209fbdac7771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7304 expref: 39 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.795884:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f49a00, rc 0) 00000100:00100000:2.0:1746147191.795923:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1956:x1830967463891584:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3852us (4093us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.795931:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12015 00000100:00100000:0.0:1746147191.796496:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466462336:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147191.796524:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df2c200/0xb4b2209fbdac777f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7312 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.796535:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df2c200/0xb4b2209fbdac777f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7312 expref: 28 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.796551:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df2c200, rc 0) 00000100:00100000:3.0:1746147191.806898:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466462208:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.807855:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466462464:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.808278:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463891840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 15893us (16398us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.808291:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12017 00010000:00010000:1.0:1746147191.808732:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac7786 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7319 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.808746:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac7786 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7319 expref: 37 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.808769:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c600, rc 0) 00000100:00100000:1.0:1746147191.808832:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1956:x1830967463891968:12345-192.168.203.36@tcp:101:cat.0 Request processed in 16329us (16906us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.808840:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12018 00010000:00010000:3.0:1746147191.809421:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9cac00/0xb4b2209fbdac7778 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e730b expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.809437:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9cac00/0xb4b2209fbdac7778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e730b expref: 26 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.809447:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9cac00, rc 0) 00000100:00100000:2.0:1746147191.812083:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463891712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 19794us (20181us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.812094:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12016 00000100:00100000:1.0:1746147191.813798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.813819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.813845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.813872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.813952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.814135:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892096 00000100:00100000:0.0:1746147191.814144:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892096 00000100:00100000:0.0:1746147191.814188:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892224 00000100:00100000:0.0:1746147191.814190:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892224 00000100:00100000:0.0:1746147191.814202:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892352 00000100:00100000:0.0:1746147191.814204:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892352 00000100:00100000:0.0:1746147191.814217:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892480 00000100:00100000:0.0:1746147191.814219:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892480 00000100:00100000:0.0:1746147191.814228:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892608 00000100:00100000:0.0:1746147191.814230:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892608 00000100:00100000:3.0:1746147191.814244:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12019 00000100:00100000:3.0:1746147191.814253:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463892096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.814270:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147191.814355:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12020 00000100:00100000:0.0:1746147191.814362:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967463892224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.814372:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147191.814475:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12021 00000100:00100000:2.0:1746147191.814497:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1959:x1830967463892352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.814866:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6558c00/0xb4b2209fbdac778d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7327 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.814931:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466462592:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147191.815049:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.815073:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12022 00000100:00100000:0.0:1746147191.815080:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463892480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.815088:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.815097:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7794 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7335 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.815217:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12023 00000100:00100000:1.0:1746147191.815225:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1959:x1830967463892608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.815232:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.815240:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c800/0xb4b2209fbdac779b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e733c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147191.815398:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466462848:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.815457:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.815519:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466462720:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147191.815546:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147191.815641:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.815656:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdac77a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e732e expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.815669:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df2c000/0xb4b2209fbdac77a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7320 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.815684:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466462976:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.815716:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.815774:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466463104:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.815822:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.817708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.818628:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463892864 00000100:00100000:3.0:1746147191.818639:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463892864 00002000:00100000:3.0:1746147191.818682:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4943872->4947967) req@ffff8801312a6a00 x1830967463892864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.818693:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967463892864 ext(4943872->4947967) 00002000:00010000:3.0:1746147191.820124:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:3.0:1746147191.820155:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4653 00000100:00100000:3.0:1746147191.820165:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463892864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147191.820464:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466462976:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.820494:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdac77a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e732e expref: 54 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147191.820505:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466462848:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.820507:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864a00/0xb4b2209fbdac77a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e732e expref: 54 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.820517:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864a00, rc 0) 00010000:00010000:1.0:1746147191.820522:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c800/0xb4b2209fbdac779b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e733c expref: 53 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.820534:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c800/0xb4b2209fbdac779b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e733c expref: 53 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.820546:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c800, rc 0) 00000100:00100000:2.0:1746147191.820559:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1959:x1830967463892352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6068us (6707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.820577:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1959:x1830967463892608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5342us (6629us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.820582:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12021 00000100:00100000:1.0:1746147191.820590:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12023 00000100:00100000:1.0:1746147191.820631:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466462592:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.820647:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6558c00/0xb4b2209fbdac778d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7327 expref: 50 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.820656:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6558c00/0xb4b2209fbdac778d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7327 expref: 50 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.820663:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6558c00, rc 0) 00000100:00100000:1.0:1746147191.820684:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1959:x1830967463892224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6323us (6864us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.820689:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12020 00000100:00100000:3.0:1746147191.822094:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463892864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1924us (4385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147191.822103:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4653 00002000:00100000:3.0:1746147191.822111:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4943872->4947967) req@ffff8801312a6a00 x1830967463892864/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147191.822120:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6a00 with x1830967463892864 ext(4943872->4947967) 00002000:00010000:3.0:1746147191.822125:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6a00 00000100:00100000:0.0:1746147191.822608:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466462720:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147191.822637:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7794 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7335 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.822648:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7794 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7335 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.822669:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6558600, rc 0) 00000100:00100000:0.0:1746147191.822700:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463892480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7621us (8826us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147191.822705:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12022 00000100:00100000:3.0:1746147191.823403:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466463104:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.823422:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df2c000/0xb4b2209fbdac77a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7320 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.823430:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df2c000/0xb4b2209fbdac77a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7320 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.823439:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df2c000, rc 0) 00000100:00100000:3.0:1746147191.823465:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463892096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9214us (9673us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147191.823471:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12019 00000100:00100000:0.0:1746147191.825821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.825997:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893120 00000100:00100000:2.0:1746147191.826011:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893120 00000100:00100000:2.0:1746147191.826185:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4205 00000100:00100000:2.0:1746147191.826194:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29088:x1830967463893120:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147191.826619:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29088:x1830967463893120:12345-192.168.203.36@tcp:35:cat.0 Request processed in 416us (797us total) trans 8589944333 rc 0/0 00000100:00100000:2.0:1746147191.826629:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4205 00000100:00100000:0.0:1746147191.828674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.829017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.829038:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893248 00000100:00100000:0.0:1746147191.829046:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893248 00000100:00100000:0.0:1746147191.829080:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893504 00000100:00100000:0.0:1746147191.829082:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893504 00000100:00100000:0.0:1746147191.829114:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12024 00000100:00100000:0.0:1746147191.829121:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463893248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147191.829139:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.829156:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac77b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7343 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.829212:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466463232:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147191.829289:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.829317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147191.829413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.830505:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893760 00000100:00100000:1.0:1746147191.830516:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893760 00000100:00100000:0.0:1746147191.830527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.830563:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893376 00000100:00100000:1.0:1746147191.830573:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893376 00000100:00100000:1.0:1746147191.830589:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893632 00000100:00100000:1.0:1746147191.830591:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893632 00000100:00100000:1.0:1746147191.830618:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12025 00000100:00100000:1.0:1746147191.830629:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463893504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.830648:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147191.830648:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12026 00000100:00100000:0.0:1746147191.830656:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463893760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147191.830662:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7351 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.830667:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.830675:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6558800/0xb4b2209fbdac77be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e735f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.830722:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466463360:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147191.830765:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12027 00000100:00100000:2.0:1746147191.830772:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+52:1958:x1830967463893376:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147191.830774:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f63c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147191.830779:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147191.830791:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac77c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e734a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.831014:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466463616:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.831047:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12028 00000100:00100000:3.0:1746147191.831059:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463893632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147191.831066:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147191.831079:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df2c800/0xb4b2209fbdac77cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7358 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.831108:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466463744:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.831159:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.831217:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466463488:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147191.831243:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.831415:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.834042:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466463232:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.834076:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac77b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7343 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.834091:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac77b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7343 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.834102:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559c00, rc 0) 00000100:00100000:2.0:1746147191.834144:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463893248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5023us (5476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.834152:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12024 00000100:00100000:2.0:1746147191.835919:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466463360:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147191.835960:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6558800/0xb4b2209fbdac77be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e735f expref: 54 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.835973:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6558800/0xb4b2209fbdac77be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e735f expref: 54 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.835983:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6558800, rc 0) 00000100:00100000:2.0:1746147191.836015:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1958:x1830967463893760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5360us (6697us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.836023:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12026 00000100:00100000:3.0:1746147191.837442:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466463744:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147191.837474:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df2c800/0xb4b2209fbdac77cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7358 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.837486:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df2c800/0xb4b2209fbdac77cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7358 expref: 36 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147191.837500:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df2c800, rc 0) 00000100:00100000:2.0:1746147191.837519:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466463616:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147191.837537:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463893632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6482us (7011us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147191.837539:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac77c5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e734a expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147191.837550:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12028 00010000:00010000:2.0:1746147191.837556:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac77c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e734a expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147191.837563:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864e00, rc 0) 00000100:00100000:2.0:1746147191.837599:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463893376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6828us (8185us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147191.837605:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12027 00000100:00100000:1.0:1746147191.837605:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466463488:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147191.837623:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7351 expref: 50 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.837632:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7351 expref: 50 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147191.837649:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5d200, rc 0) 00000100:00100000:1.0:1746147191.837671:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:1958:x1830967463893504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7047us (8654us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147191.837676:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12025 00010000:00010000:2.0:1746147191.841055:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147191.853518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.854169:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463893888 00000100:00100000:1.0:1746147191.854179:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463893888 00000100:00100000:1.0:1746147191.854240:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12029 00000100:00100000:1.0:1746147191.854251:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29096:x1830967463893888:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.854273:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.854292:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7366 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854324:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854334:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854341:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.854343:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147191.854346:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854377:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854389:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 35 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.854401:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466463872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.854510:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.854517:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.854525:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466464000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.854544:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.858032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.858222:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466463872:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.858239:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d49bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466464000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.858272:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 36 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.858291:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c800, rc 0) 00000100:00100000:1.0:1746147191.858353:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29096:x1830967463893888:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4104us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.858362:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12029 00000100:00100000:1.0:1746147191.858882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.858991:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894016 00000100:00100000:2.0:1746147191.858999:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894016 00010000:00010000:2.0:1746147191.859029:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 36 pid: 4445 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.859181:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894144 00000100:00100000:2.0:1746147191.859184:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894144 00010000:00010000:2.0:1746147191.859196:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00000100:00100000:0.0:1746147191.859258:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5984 00000100:00100000:0.0:1746147191.859270:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1956:x1830967463894016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147191.859274:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5985 00000100:00100000:2.0:1746147191.859281:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463894144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.859286:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.859293:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.859308:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 36 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.859310:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.859322:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 36 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.859420:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:0.0:1746147191.859444:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e5ec00/0xb4b2209fbdac776a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72fd expref: 36 pid: 4445 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.859454:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e5e800/0xb4b2209fbdac7732 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72c5 expref: 36 pid: 17548 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.859470:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.859471:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.859477:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.859483:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.859510:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 35 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.859520:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466464128:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147191.859528:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.859595:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.859627:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1956:x1830967463894016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 360us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.859633:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5984 00000100:00100000:0.0:1746147191.862375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.862580:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466464128:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.862613:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.862742:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463894144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3460us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.862743:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894272 00000100:00100000:1.0:1746147191.862750:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894272 00000100:00100000:2.0:1746147191.862753:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5985 00000100:00100000:1.0:1746147191.863012:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12030 00000100:00100000:1.0:1746147191.863018:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+49:29096:x1830967463894272:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.863035:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.863051:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e736d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.863076:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.863083:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.863085:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.863088:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->3862527] (req 3145728->3862527) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 50 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.863112:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.863127:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 24 pid: 21080 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.863139:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466464256:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.863197:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.865902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.865965:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466464256:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.865995:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3145728->3862527] (req 3145728->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 50 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.866012:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5d800, rc 0) 00000100:00100000:1.0:1746147191.866068:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+50:29096:x1830967463894272:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3049us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.866077:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12030 00000100:00100000:2.0:1746147191.866252:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894400 00000100:00100000:2.0:1746147191.866259:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894400 00002000:00100000:2.0:1746147191.866301:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2125823) req@ffff88008fa95c00 x1830967463894400/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.866316:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95c00 with x1830967463894400 ext(2097152->2125823) 00010000:00010000:2.0:1746147191.866323:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 25 pid: 21080 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.866335:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 25 pid: 21080 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.866342:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa95c00 00000100:00100000:2.0:1746147191.866420:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1594 00000100:00100000:2.0:1746147191.866428:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463894400:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147191.870418:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463894400:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3979us (4515us total) trans 17179873267 rc 0/0 00000100:00100000:2.0:1746147191.870430:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1594 00002000:00100000:2.0:1746147191.870441:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2125823) req@ffff88008fa95c00 x1830967463894400/t17179873267(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/448 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.870451:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95c00 with x1830967463894400 ext(2097152->2125823) 00010000:00010000:2.0:1746147191.870461:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.870476:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00002000:00010000:2.0:1746147191.870484:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fa95c00 00000100:00100000:0.0:1746147191.872642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.873020:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894528 00000100:00100000:2.0:1746147191.873030:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894528 00010000:00010000:2.0:1746147191.873138:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00000100:00100000:2.0:1746147191.873198:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5986 00000100:00100000:2.0:1746147191.873218:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463894528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147191.873244:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147191.873279:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.873305:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.873340:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7739 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72cc expref: 27 pid: 21080 timeout: 678 lvb_type: 0 00010000:00010000:2.0:1746147191.874129:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.874132:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147191.874140:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 49 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.874159:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 49 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147191.874208:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 49 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147191.874229:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466464384:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147191.874402:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147191.877110:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466464384:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147191.877132:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147191.877220:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463894528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4001us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147191.877232:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5986 00000100:00100000:0.0:1746147191.882457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.882559:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463894784 00000100:00100000:2.0:1746147191.882578:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463894784 00002000:00100000:2.0:1746147191.882627:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3858432->3862527) req@ffff88008fa96300 x1830967463894784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.882637:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa96300 with x1830967463894784 ext(3858432->3862527) 00002000:00010000:2.0:1746147191.882643:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fa96300 00000100:00100000:2.0:1746147191.882664:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4654 00000100:00100000:2.0:1746147191.882672:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967463894784:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147191.882968:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+50:1956:x1830967463894784:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 267us (490us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147191.882975:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4654 00002000:00100000:2.0:1746147191.882981:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3858432->3862527) req@ffff88008fa96300 x1830967463894784/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.882987:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa96300 with x1830967463894784 ext(3858432->3862527) 00002000:00010000:2.0:1746147191.882989:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fa96300 00000100:00100000:0.0:1746147191.885517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.885668:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463895040 00000100:00100000:2.0:1746147191.885676:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463895040 00000100:00100000:2.0:1746147191.885725:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4206 00000100:00100000:2.0:1746147191.885732:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29096:x1830967463895040:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147191.885981:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+307:29096:x1830967463895040:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 248us (471us total) trans 8589944334 rc 0/0 00000100:00100000:2.0:1746147191.885989:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4206 00000100:00100000:0.0:1746147191.902353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.902430:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463895296 00000100:00100000:1.0:1746147191.902440:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463895296 00000100:00100000:1.0:1746147191.902504:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10577 00000100:00100000:1.0:1746147191.902512:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29103:x1830967463895296:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.902538:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.902557:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d600/0xb4b2209fbdac77e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7374 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.902712:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902724:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902735:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902747:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902751:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902756:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902866:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902874:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.902880:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147191.902888:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147191.903017:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903023:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903028:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903033:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5d400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.903037:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903043:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903052:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147191.903054:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.903058:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903062:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac77e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903410:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903417:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903422:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903426:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5d200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147191.903428:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903433:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903440:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a56dea00) 00010000:00010000:1.0:1746147191.903442:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147191.903444:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903449:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d200/0xb4b2209fbdac77ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147191.903486:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d600/0xb4b2209fbdac77e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 14 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.903496:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.903503:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147191.903505:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147191.903507:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c600, rc 0) 00000100:00100000:1.0:1746147191.903555:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29103:x1830967463895296:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1043us (1214us total) trans 8589944335 rc 0/0 00000100:00100000:1.0:1746147191.903562:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10577 00000100:00100000:0.0:1746147191.905574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147191.906133:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463895424 00000100:00100000:1.0:1746147191.906144:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463895424 00000100:00100000:1.0:1746147191.906185:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12031 00000100:00100000:1.0:1746147191.906192:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29103:x1830967463895424:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147191.906211:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147191.906227:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e737b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.906254:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.906262:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.906264:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147191.906267:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1794048->1830911] (req 1794048->1830911) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.906301:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.906313:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 12 pid: 17530 timeout: 678 lvb_type: 0 00000100:00100000:1.0:1746147191.906324:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466464512:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147191.906410:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147191.909579:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466464512:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147191.909614:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1794048->1830911] (req 1794048->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 27 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147191.909631:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5d000, rc 0) 00000100:00100000:1.0:1746147191.909676:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29103:x1830967463895424:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3483us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147191.909684:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12031 00000100:00100000:0.0:1746147191.910400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147191.910465:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463895552 00000100:00100000:3.0:1746147191.910472:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463895552 00010000:00010000:3.0:1746147191.910500:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 13 pid: 17530 timeout: 678 lvb_type: 0 00000100:00100000:3.0:1746147191.910536:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5987 00000100:00100000:3.0:1746147191.910543:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463895552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147191.910557:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147191.910588:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 13 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.910600:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 13 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.910622:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0xb4b2209fbdac7659 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7224 expref: 13 pid: 17530 timeout: 678 lvb_type: 0 00010000:00010000:3.0:1746147191.910646:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.910649:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147191.910656:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.910665:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147191.910697:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147191.910710:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466464640:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147191.910788:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800948b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147191.913056:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466464640:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147191.913075:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147191.913223:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463895552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2678us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147191.913233:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5987 00000100:00100000:0.0:1746147191.913925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.914254:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463895808 00000100:00100000:2.0:1746147191.914261:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463895808 00002000:00100000:2.0:1746147191.914299:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1826816->1830911) req@ffff88008fa95880 x1830967463895808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.914313:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95880 with x1830967463895808 ext(1826816->1830911) 00002000:00010000:2.0:1746147191.914319:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fa95880 00000100:00100000:2.0:1746147191.914762:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4655 00000100:00100000:2.0:1746147191.914772:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463895808:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147191.915322:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463895808:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 550us (1396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147191.915330:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4655 00002000:00100000:2.0:1746147191.915337:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41d:0x0] (1826816->1830911) req@ffff88008fa95880 x1830967463895808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147191.915345:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fa95880 with x1830967463895808 ext(1826816->1830911) 00002000:00010000:2.0:1746147191.915349:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fa95880 00000100:00100000:0.0:1746147191.918322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147191.918428:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896064 00000100:00100000:2.0:1746147191.918438:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896064 00000100:00100000:2.0:1746147191.919282:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4207 00000100:00100000:2.0:1746147191.919667:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29103:x1830967463896064:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147191.919909:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29103:x1830967463896064:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 618us (1597us total) trans 8589944336 rc 0/0 00000100:00100000:2.0:1746147191.919919:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4207 00000100:00100000:0.0:1746147192.019955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.020501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.020583:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896192 00000100:00100000:0.0:1746147192.020590:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896192 00000100:00100000:0.0:1746147192.020618:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896448 00000100:00100000:0.0:1746147192.020620:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896448 00000100:00100000:0.0:1746147192.020871:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10578 00000100:00100000:0.0:1746147192.020879:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:29107:x1830967463896192:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.020899:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147192.020901:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10579 00000100:00100000:3.0:1746147192.020914:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:29106:x1830967463896448:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147192.020915:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559800/0xb4b2209fbdac780b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7382 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.020934:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.020967:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2c000/0xb4b2209fbdac7812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7389 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.020986:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.020998:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.021007:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.021016:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.021021:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.021030:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.021057:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.021070:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.021078:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.021084:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.021118:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.021119:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.021131:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.021140:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147192.021143:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466464768:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147192.021146:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.021160:0:14049:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.021168:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00080000:0.0:1746147192.021187:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147192.021242:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 308 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.021248:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 308 pid: 14047 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.021257:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466464896:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.021273:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa7f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.027711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.027758:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466464768:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.027768:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466464896:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.027783:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896576 00010000:00010000:2.0:1746147192.027789:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147192.027794:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896576 00010000:00010000:3.0:1746147192.027843:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.027868:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5988 00000100:00100000:3.0:1746147192.027875:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463896576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1746147192.027883:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147192.027888:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.027894:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.027904:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.027924:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c600/0xb4b2209fbdac77f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7374 expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.027954:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.027959:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.027967:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.027971:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.027976:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.027981:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.028035:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463896576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 160us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.028041:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5988 00000100:00100000:0.0:1746147192.028068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.028099:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896704 00000100:00100000:3.0:1746147192.028102:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896704 00010000:00010000:3.0:1746147192.028112:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 309 pid: 14047 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.028267:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5989 00000100:00100000:3.0:1746147192.028272:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+309:1956:x1830967463896704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.028279:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.028283:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 309 pid: 14047 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.028290:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 309 pid: 14047 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.028300:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6279a00/0xb4b2209fbdac7724 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e72be expref: 309 pid: 14047 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.028311:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.028314:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.028324:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.028329:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.028334:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.028338:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.028342:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.028355:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147192.028366:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147192.028370:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1956:x1830967463896704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (303us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147192.028373:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147192.028375:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5989 00000004:00200000:2.0:1746147192.028389:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147192.028499:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2c000/0xb4b2209fbdac7812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 309 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.028522:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.028529:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.028534:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df2ce00, rc 0) 00000100:00100000:2.0:1746147192.028583:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+308:29106:x1830967463896448:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7673us (8083us total) trans 8589944337 rc 0/0 00000100:00100000:2.0:1746147192.028590:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10579 00000100:00100000:3.0:1746147192.031495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.031525:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896832 00000100:00100000:3.0:1746147192.031534:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896832 00010000:00010000:3.0:1746147192.031574:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.031603:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5990 00000100:00100000:3.0:1746147192.031611:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+308:1959:x1830967463896832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.031625:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.031631:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.031647:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.032386:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df2ce00/0xb4b2209fbdac7827 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7389 expref: 308 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.032405:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.032410:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.032417:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.032424:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.033088:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.033157:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+307:1959:x1830967463896832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1539us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.033169:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5990 00010000:00010000:0.0:1746147192.035209:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035225:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147192.035274:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:0.0:1746147192.035278:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147192.035297:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035309:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035321:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035326:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035332:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035337:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6559e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147192.035341:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035347:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035361:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147192.035364:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147192.035367:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035372:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559e00/0xb4b2209fbdac7819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035387:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035392:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035396:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035400:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6558000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147192.035402:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035407:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035412:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134d0ad00) 00010000:00010000:0.0:1746147192.035413:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147192.035415:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035419:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558000/0xb4b2209fbdac7820 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.035454:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559800/0xb4b2209fbdac780b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.035465:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 11 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.035470:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147192.035472:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147192.035474:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559a00, rc 0) 00000100:00100000:0.0:1746147192.035526:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:29107:x1830967463896192:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 14648us (15593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.035535:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10578 00000100:00100000:3.0:1746147192.041221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.041255:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463896960 00000100:00100000:3.0:1746147192.041263:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463896960 00000100:00100000:3.0:1746147192.041308:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12032 00000100:00100000:3.0:1746147192.041316:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463896960:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.041335:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.041352:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea40200/0xb4b2209fbdac783c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7390 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.041409:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466465024:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.041479:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.041663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.041724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.041743:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897088 00000100:00100000:2.0:1746147192.041744:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897216 00000100:00100000:0.0:1746147192.041747:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897088 00000100:00100000:2.0:1746147192.041752:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897216 00000100:00100000:0.0:1746147192.041774:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12033 00000100:00100000:0.0:1746147192.041780:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463897088:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.041791:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.041801:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac7843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7397 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.041829:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466465152:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.041897:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.042031:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12034 00000100:00100000:2.0:1746147192.042039:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463897216:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147192.042052:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.042066:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac784a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e739e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.042110:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466465280:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.042186:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.046259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.046298:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466465152:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.046301:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466465280:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.046321:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac784a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e739e expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.046321:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac7843 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7397 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.046333:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f864e00/0xb4b2209fbdac784a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e739e expref: 15 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.046333:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6559c00/0xb4b2209fbdac7843 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7397 expref: 16 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.046342:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864e00, rc 0) 00010000:00010000:1.0:1746147192.046342:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559c00, rc 0) 00000100:00100000:3.0:1746147192.046378:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463897216:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4340us (4653us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.046379:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463897088:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4598us (4720us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.046387:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12033 00000100:00100000:3.0:1746147192.046395:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12034 00000100:00100000:1.0:1746147192.046411:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897344 00000100:00100000:1.0:1746147192.046415:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897344 00002000:00010000:3.0:1746147192.046431:0:8481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:3.0:1746147192.046433:0:8481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147190 -> 1746147191 00000100:00100000:3.0:1746147192.046441:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466465024:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.046445:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12035 00000100:00100000:1.0:1746147192.046451:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+50:29106:x1830967463897344:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147192.046453:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea40200/0xb4b2209fbdac783c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7390 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.046461:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea40200/0xb4b2209fbdac783c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7390 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.046462:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.046467:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40200, rc 0) 00010000:00010000:1.0:1746147192.046472:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73a5 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.046485:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463896960:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5170us (5274us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.046489:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12032 00010000:00010000:1.0:1746147192.046490:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.046496:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.046498:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.046501:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1130496->1519615] (req 1130496->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 51 pid: 11147 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746147192.046530:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147192.046550:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.046561:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 11 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.046579:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466465408:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.046620:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.049770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.049809:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466465408:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.049830:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1130496->1519615] (req 1130496->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 51 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.049845:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c200, rc 0) 00000100:00100000:1.0:1746147192.049879:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:29106:x1830967463897344:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3427us (3624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.049886:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12035 00000100:00100000:1.0:1746147192.049979:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897600 00000100:00100000:1.0:1746147192.049985:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897600 00000100:00100000:1.0:1746147192.050024:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10580 00000100:00100000:1.0:1746147192.050031:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:29107:x1830967463897600:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.050044:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.050056:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c000/0xb4b2209fbdac7858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73ac expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.050768:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.050781:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.050789:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.050811:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.050822:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 12 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.050834:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466465536:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.050875:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.054535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.057127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.057419:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897728 00000100:00100000:0.0:1746147192.057427:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897728 00010000:00010000:0.0:1746147192.057480:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 12 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.057504:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897856 00000100:00100000:0.0:1746147192.057506:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897856 00010000:00010000:0.0:1746147192.057517:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.057530:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5991 00000100:00100000:0.0:1746147192.057536:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463897728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.057548:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.057576:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 12 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.057586:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 12 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.057607:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9da00/0xb4b2209fbdac7652 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e721d expref: 12 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.057622:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.057624:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.057630:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 50 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.057636:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 50 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.057660:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 50 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.057670:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466465664:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.057722:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.057736:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5992 00000100:00100000:0.0:1746147192.057740:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463897856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.057748:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.057753:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.057760:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.057771:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147192.057775:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.057784:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.057789:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.057797:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.057810:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463897856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 69us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.057814:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5992 00010000:00010000:2.0:1746147192.058491:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac782e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7382 expref: 12 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.058507:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466465536:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.058521:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147192.058529:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147192.058533:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:2.0:1746147192.058549:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147192.059597:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c000/0xb4b2209fbdac7858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.059613:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.059620:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.059622:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147192.059624:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5cc00, rc 0) 00000100:00100000:2.0:1746147192.059804:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463897600:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9772us (10038us total) trans 8589944338 rc 0/0 00000100:00100000:2.0:1746147192.059811:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10580 00000100:00100000:1.0:1746147192.062688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.062733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.062755:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463898240 00000100:00100000:1.0:1746147192.062762:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463898240 00002000:00100000:1.0:1746147192.062796:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1130496->1134591) req@ffff88012d498380 x1830967463898240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.062804:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498380 with x1830967463898240 ext(1130496->1134591) 00002000:00010000:1.0:1746147192.062808:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d498380 00000100:00100000:1.0:1746147192.062831:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4656 00000100:00100000:1.0:1746147192.062838:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967463898240:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.063046:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1956:x1830967463898240:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 208us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147192.063052:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4656 00002000:00100000:1.0:1746147192.063058:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1130496->1134591) req@ffff88012d498380 x1830967463898240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.063065:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d498380 with x1830967463898240 ext(1130496->1134591) 00002000:00010000:1.0:1746147192.063068:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d498380 00000100:00100000:1.0:1746147192.063134:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463897984 00000100:00100000:1.0:1746147192.063137:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463897984 00000100:00100000:1.0:1746147192.063155:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10581 00000100:00100000:1.0:1746147192.063159:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463897984:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.063170:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.063184:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d600/0xb4b2209fbdac786d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73b3 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.063238:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.063248:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.063254:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.063277:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.063286:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.063295:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466465792:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.063344:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.063397:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466465664:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.063407:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.063427:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463897728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5891us (8899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.063433:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5991 00000100:00100000:1.0:1746147192.067435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.067482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.067502:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463898496 00000100:00100000:1.0:1746147192.067509:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463898496 00000100:00100000:1.0:1746147192.067542:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10582 00000100:00100000:1.0:1746147192.067549:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29112:x1830967463898496:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.067578:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.067592:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5ca00/0xb4b2209fbdac787b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73ba expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.067677:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067688:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067697:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067707:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067712:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067716:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067802:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdac7890 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067813:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdac7890 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067820:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdac7890 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147192.067827:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147192.067895:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067900:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067905:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067910:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5c400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.067914:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067919:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067928:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147192.067930:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.067933:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067964:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5c400/0xb4b2209fbdac7882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067973:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067982:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067986:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067989:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f8a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.067991:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.067995:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.068000:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a56de000) 00010000:00010000:1.0:1746147192.068001:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.068003:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.068006:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8a00/0xb4b2209fbdac7889 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147192.068039:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466465792:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.068051:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:1.0:1746147192.068064:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463898624 00000100:00100000:1.0:1746147192.068066:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463898624 00010000:00010000:1.0:1746147192.068077:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.068090:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5993 00000100:00100000:1.0:1746147192.068095:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463898624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.068102:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.068105:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.068113:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.068122:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5cc00/0xb4b2209fbdac785f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ac expref: 14 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.068129:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.068132:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.068137:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.068141:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.068151:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.068177:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463898624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.068182:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5993 00010000:00010000:1.0:1746147192.068293:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.068298:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147192.068317:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:1.0:1746147192.068320:0:14049:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147192.068328:0:14049:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.068345:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d600/0xb4b2209fbdac786d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.068354:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.068359:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.068361:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147192.068362:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5de00, rc 0) 00000100:00100000:1.0:1746147192.068379:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463897984:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5220us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.068383:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10581 00010000:00010000:1.0:1746147192.068426:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5ca00/0xb4b2209fbdac787b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ba expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.068435:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdac7890 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ba expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.068439:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.068441:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147192.068443:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f8c00, rc 0) 00000100:00100000:1.0:1746147192.068459:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29112:x1830967463898496:12345-192.168.203.36@tcp:101:cat.0 Request processed in 910us (1032us total) trans 8589944339 rc 0/0 00000100:00100000:1.0:1746147192.068466:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10582 00000100:00100000:1.0:1746147192.076302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.076435:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463898880 00000100:00100000:1.0:1746147192.076442:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463898880 00002000:00100000:1.0:1746147192.076476:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1515520->1519615) req@ffff88012d499c00 x1830967463898880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.076487:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967463898880 ext(1515520->1519615) 00002000:00010000:1.0:1746147192.076491:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:1.0:1746147192.076507:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4657 00000100:00100000:1.0:1746147192.076513:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967463898880:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.076650:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967463898880:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 137us (355us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147192.076656:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4657 00002000:00100000:1.0:1746147192.076660:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1515520->1519615) req@ffff88012d499c00 x1830967463898880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.076667:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d499c00 with x1830967463898880 ext(1515520->1519615) 00002000:00010000:1.0:1746147192.076669:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d499c00 00000100:00100000:1.0:1746147192.076687:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899264 00000100:00100000:1.0:1746147192.076690:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899264 00000100:00100000:1.0:1746147192.076704:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899392 00000100:00100000:1.0:1746147192.076706:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899392 00000100:00100000:1.0:1746147192.076713:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899520 00000100:00100000:1.0:1746147192.076714:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899520 00000100:00100000:1.0:1746147192.076722:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899648 00000100:00100000:1.0:1746147192.076724:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899648 00000100:00100000:1.0:1746147192.076734:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12036 00000100:00100000:1.0:1746147192.076738:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463899264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.076745:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.076758:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c000/0xb4b2209fbdac789e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73c8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.076796:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466465920:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.076848:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.076863:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12037 00000100:00100000:1.0:1746147192.076868:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463899392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.076875:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.076883:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ac5c00/0xb4b2209fbdac78a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73cf expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.076903:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466466048:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.076923:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52dec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.076957:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12038 00000100:00100000:1.0:1746147192.076963:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463899520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.076970:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.076979:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac70400/0xb4b2209fbdac78ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73d6 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.077006:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466466176:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.077037:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.077124:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899136 00000100:00100000:1.0:1746147192.077127:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899136 00000100:00100000:1.0:1746147192.077152:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10583 00000100:00100000:1.0:1746147192.077157:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+307:29113:x1830967463899136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.077168:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.077179:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70c00/0xb4b2209fbdac78b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73c1 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.077260:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077271:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077280:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077289:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077293:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077298:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077380:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077389:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077394:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147192.077400:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147192.077465:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077471:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077475:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077480:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac70e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.077483:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077488:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077495:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147192.077498:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.077500:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077504:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70e00/0xb4b2209fbdac78ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077512:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077519:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077522:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077525:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac71000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.077527:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077530:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077534:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f500) 00010000:00010000:1.0:1746147192.077536:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.077537:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077540:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71000/0xb4b2209fbdac78c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.077576:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70c00/0xb4b2209fbdac78b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 310 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.077586:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 309 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.077592:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.077593:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147192.077595:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac71200, rc 0) 00000100:00100000:1.0:1746147192.077616:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+309:29113:x1830967463899136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 459us (1275us total) trans 8589944340 rc 0/0 00000100:00100000:1.0:1746147192.077623:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10583 00000100:00100000:3.0:1746147192.077869:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12039 00000100:00100000:3.0:1746147192.077875:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463899648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.077884:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.077890:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea40800/0xb4b2209fbdac78d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73dd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.077914:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466466304:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.077967:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.078093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.078132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.078143:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.078153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.078170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.078183:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899776 00000100:00100000:0.0:1746147192.078186:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899776 00000100:00100000:0.0:1746147192.078199:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463899904 00000100:00100000:0.0:1746147192.078200:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463899904 00000100:00100000:0.0:1746147192.078207:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900032 00000100:00100000:0.0:1746147192.078208:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900032 00000100:00100000:0.0:1746147192.078212:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900160 00000100:00100000:0.0:1746147192.078214:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900160 00000100:00100000:0.0:1746147192.078218:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900288 00000100:00100000:0.0:1746147192.078219:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900288 00000100:00100000:0.0:1746147192.078226:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12040 00000100:00100000:0.0:1746147192.078231:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1957:x1830967463899776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.078238:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.078246:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6559800/0xb4b2209fbdac78dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73e4 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.078269:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f730000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466466432:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.078292:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.078456:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12041 00000100:00100000:3.0:1746147192.078462:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1956:x1830967463899904:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.078468:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.078475:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea40a00/0xb4b2209fbdac78e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73eb expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.078493:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466466560:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.078512:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.080717:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12042 00000100:00100000:2.0:1746147192.080729:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1956:x1830967463900032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.080743:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.080755:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865c00/0xb4b2209fbdac78eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73f2 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.080792:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466466688:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.082140:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12043 00000100:00100000:3.0:1746147192.082149:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1957:x1830967463900160:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.082159:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.082167:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac78f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e73f9 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.082201:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466466816:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.083427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.083503:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466466048:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.083540:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ac5c00/0xb4b2209fbdac78a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73cf expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083551:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ac5c00/0xb4b2209fbdac78a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73cf expref: 16 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083560:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac5c00, rc 0) 00000100:00100000:0.0:1746147192.083594:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463899392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6726us (7214us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.083601:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12037 00000100:00100000:0.0:1746147192.083621:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12044 00000100:00100000:0.0:1746147192.083628:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463900288:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.083636:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.083643:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6559000/0xb4b2209fbdac78f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7400 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.083665:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466466944:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.083706:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466466176:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.083719:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac70400/0xb4b2209fbdac78ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73d6 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083727:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac70400/0xb4b2209fbdac78ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73d6 expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083733:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac70400, rc 0) 00000100:00100000:0.0:1746147192.083745:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463899520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6783us (7352us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.083749:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12038 00000100:00100000:0.0:1746147192.083772:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466466304:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.083782:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea40800/0xb4b2209fbdac78d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73dd expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083789:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea40800/0xb4b2209fbdac78d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73dd expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083795:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40800, rc 0) 00000100:00100000:0.0:1746147192.083805:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463899648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5931us (7392us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.083809:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12039 00002000:00010000:0.0:1746147192.083826:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:0.0:1746147192.083829:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147190 -> 1746147191 00000100:00100000:0.0:1746147192.083834:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466466560:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.083843:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea40a00/0xb4b2209fbdac78e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73eb expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083854:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea40a00/0xb4b2209fbdac78e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73eb expref: 30 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083859:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40a00, rc 0) 00000100:00100000:0.0:1746147192.083869:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463899904:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5409us (5737us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.083873:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12041 00002000:00010000:0.0:1746147192.083890:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:0.0:1746147192.083892:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147190 -> 1746147191 00002000:00010000:0.0:1746147192.083896:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2041 00000100:00100000:0.0:1746147192.083899:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f730000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466466432:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.083910:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6559800/0xb4b2209fbdac78dd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73e4 expref: 40 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083917:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6559800/0xb4b2209fbdac78dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73e4 expref: 40 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.083923:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559800, rc 0) 00000100:00100000:0.0:1746147192.083932:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1957:x1830967463899776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5701us (5841us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.083950:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12040 00000100:00100000:1.0:1746147192.085143:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466465920:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.085160:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c000/0xb4b2209fbdac789e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c8 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.085168:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c000/0xb4b2209fbdac789e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c8 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.085175:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c000, rc 0) 00000100:00100000:1.0:1746147192.085207:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463899264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8468us (8844us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.085212:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12036 00000100:00100000:2.0:1746147192.086014:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.086027:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900544 00000100:00100000:2.0:1746147192.086033:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900544 00000100:00100000:2.0:1746147192.086059:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4208 00000100:00100000:2.0:1746147192.086064:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+309:29113:x1830967463900544:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147192.086196:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+310:29113:x1830967463900544:12345-192.168.203.36@tcp:35:cat.0 Request processed in 131us (2769us total) trans 8589944341 rc 0/0 00000100:00100000:2.0:1746147192.086201:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4208 00000100:00100000:2.0:1746147192.086246:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ff11300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.086256:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.095685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.095780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147192.095823:0:8478:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147190 -> 1746147191 00002000:00010000:1.0:1746147192.095826:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147190 -> 1746147191 00000100:00100000:1.0:1746147192.095844:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466466688:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.095871:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f865c00/0xb4b2209fbdac78eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73f2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.095885:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865c00/0xb4b2209fbdac78eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73f2 expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.095896:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865c00, rc 0) 00000100:00100000:1.0:1746147192.095933:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1956:x1830967463900032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 15207us (17787us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.095956:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12042 00000100:00100000:1.0:1746147192.095978:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900928 00000100:00100000:1.0:1746147192.095982:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900928 00000100:00100000:1.0:1746147192.096014:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12045 00000100:00100000:1.0:1746147192.096019:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463900928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.096029:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.096039:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac71c00/0xb4b2209fbdac7900 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e740e expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.096074:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466467072:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.096114:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.096128:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463900800 00000100:00100000:1.0:1746147192.096130:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463900800 00000100:00100000:1.0:1746147192.096152:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10584 00000100:00100000:1.0:1746147192.096156:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463900800:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.096163:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.096172:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71400/0xb4b2209fbdac7907 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7407 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.096236:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096246:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096253:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096264:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096269:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096273:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096277:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac70000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.096280:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096285:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096292:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.096294:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147192.096296:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096300:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac70000/0xb4b2209fbdac790e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.096318:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71400/0xb4b2209fbdac7907 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7407 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.096324:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71400/0xb4b2209fbdac7907 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7407 expref: 13 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.096331:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac71400, rc 0) 00000100:00100000:1.0:1746147192.096348:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463900800:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 191us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.096354:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10584 00000100:00100000:1.0:1746147192.096389:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466466944:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.096404:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6559000/0xb4b2209fbdac78f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7400 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.096412:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6559000/0xb4b2209fbdac78f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7400 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.096420:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559000, rc 0) 00000100:00100000:1.0:1746147192.096437:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463900288:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12810us (18266us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.096442:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12044 00000100:00080000:1.0:1746147192.096519:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147192.098700:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466466816:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.098729:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac78f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73f9 expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.098740:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac78f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73f9 expref: 36 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.098749:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41400, rc 0) 00000100:00100000:2.0:1746147192.098790:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1957:x1830967463900160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 16643us (20635us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.098797:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12043 00000100:00100000:1.0:1746147192.104014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.104045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.104061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.104101:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901312 00000100:00100000:1.0:1746147192.104107:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901312 00000100:00100000:1.0:1746147192.104134:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901440 00000100:00100000:1.0:1746147192.104137:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901440 00000100:00100000:1.0:1746147192.104149:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12046 00000100:00100000:1.0:1746147192.104155:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463901312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.104168:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.104183:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac70a00/0xb4b2209fbdac7915 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7415 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.104228:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466467200:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.104283:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136b4a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.104300:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12047 00000100:00100000:1.0:1746147192.104306:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463901440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.104313:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.104322:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac70c00/0xb4b2209fbdac791c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e741c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.104344:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466467328:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.104363:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52de780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.104376:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901184 00000100:00100000:1.0:1746147192.104379:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901184 00000100:00100000:1.0:1746147192.104399:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4209 00000100:00100000:1.0:1746147192.104402:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+310:29106:x1830967463901184:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147192.104529:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+311:29106:x1830967463901184:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 126us (524us total) trans 8589944342 rc 0/0 00000100:00100000:1.0:1746147192.104535:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4209 00000100:00100000:1.0:1746147192.104591:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466467072:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.104611:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac71c00/0xb4b2209fbdac7900 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e740e expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.104620:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac71c00/0xb4b2209fbdac7900 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e740e expref: 38 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.104633:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac71c00, rc 0) 00000100:00100000:1.0:1746147192.104648:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463900928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8629us (8868us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.104654:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12045 00000100:00100000:0.0:1746147192.104697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.106547:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901696 00000100:00100000:1.0:1746147192.106554:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901696 00000100:00100000:1.0:1746147192.106590:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4210 00000100:00100000:1.0:1746147192.106597:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:29107:x1830967463901696:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147192.106714:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+13:29107:x1830967463901696:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 117us (2017us total) trans 8589944343 rc 0/0 00000100:00100000:1.0:1746147192.106720:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4210 00000100:00100000:0.0:1746147192.107671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.107686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.107699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.107710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.107732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.107747:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901824 00000100:00100000:0.0:1746147192.107750:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901824 00000100:00100000:0.0:1746147192.107769:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463901952 00000100:00100000:0.0:1746147192.107770:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463901952 00000100:00100000:0.0:1746147192.107780:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902080 00000100:00100000:0.0:1746147192.107781:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902080 00000100:00100000:0.0:1746147192.107787:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902208 00000100:00100000:0.0:1746147192.107788:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902208 00000100:00100000:0.0:1746147192.107793:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902336 00000100:00100000:0.0:1746147192.107795:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902336 00000100:00100000:0.0:1746147192.107803:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12048 00000100:00100000:0.0:1746147192.107808:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1959:x1830967463901824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.107818:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.107829:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7923 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7423 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.107863:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466467456:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.107904:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.107920:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12049 00000100:00100000:0.0:1746147192.107926:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463901952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.107933:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.107960:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6559400/0xb4b2209fbdac792a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e742a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.107983:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466467584:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.108004:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.108018:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12050 00000100:00100000:0.0:1746147192.108023:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+38:1959:x1830967463902080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.108029:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.108036:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8514400/0xb4b2209fbdac7931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7431 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.108055:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466467712:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.108073:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.108085:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12051 00000100:00100000:0.0:1746147192.108090:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1958:x1830967463902208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.108095:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.108102:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac7938 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7438 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.108120:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466467840:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.108137:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.108149:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12052 00000100:00100000:0.0:1746147192.108154:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463902336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.108159:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.108165:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54600/0xb4b2209fbdac793f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e743f expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.108185:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466467968:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.108201:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.108889:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466467200:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.108908:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac70a00/0xb4b2209fbdac7915 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7415 expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.108918:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac70a00/0xb4b2209fbdac7915 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7415 expref: 52 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.108927:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac70a00, rc 0) 00000100:00100000:1.0:1746147192.110776:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1958:x1830967463901312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6617us (6726us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.110784:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12046 00000100:00100000:1.0:1746147192.118538:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466467328:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.118583:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac70c00/0xb4b2209fbdac791c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e741c expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147192.119404:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466467456:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.119421:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7923 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7423 expref: 40 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119433:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7923 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7423 expref: 40 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119445:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559a00, rc 0) 00000100:00100000:0.0:1746147192.119482:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1959:x1830967463901824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11673us (11812us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.119489:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12048 00000100:00100000:0.0:1746147192.119527:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466467584:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.119541:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6559400/0xb4b2209fbdac792a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e742a expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119549:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6559400/0xb4b2209fbdac792a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e742a expref: 30 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119556:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559400, rc 0) 00000100:00100000:0.0:1746147192.119579:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463901952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11653us (11892us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.119585:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12049 00000100:00100000:0.0:1746147192.119611:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466467712:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.119622:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8514400/0xb4b2209fbdac7931 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7431 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119634:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8514400/0xb4b2209fbdac7931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7431 expref: 38 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119640:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8514400, rc 0) 00000100:00100000:0.0:1746147192.119653:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1959:x1830967463902080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11630us (11953us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.119657:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12050 00002000:00010000:0.0:1746147192.119682:0:17530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5599 -> 5639 00000100:00100000:0.0:1746147192.119686:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466467840:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.119696:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac7938 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7438 expref: 36 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119704:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4d55000/0xb4b2209fbdac7938 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7438 expref: 36 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119710:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d55000, rc 0) 00000100:00100000:0.0:1746147192.119721:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1958:x1830967463902208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11632us (12010us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.119726:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12051 00000100:00100000:0.0:1746147192.119751:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466467968:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.119761:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54600/0xb4b2209fbdac793f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e743f expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119768:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54600/0xb4b2209fbdac793f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e743f expref: 28 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.119775:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54600, rc 0) 00000100:00100000:0.0:1746147192.119786:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1959:x1830967463902336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11633us (12055us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.119791:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12052 00010000:00010000:1.0:1746147192.126463:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac70c00/0xb4b2209fbdac791c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e741c expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.126474:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac70c00, rc 0) 00000100:00100000:1.0:1746147192.126581:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463901440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 22273us (22517us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.126589:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12047 00000100:00100000:2.0:1746147192.130954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.130986:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902464 00000100:00100000:2.0:1746147192.130994:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902464 00000100:00100000:2.0:1746147192.131033:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12053 00000100:00100000:2.0:1746147192.131040:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+35:29112:x1830967463902464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.131056:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.131070:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7446 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.131096:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.131103:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.131105:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.131108:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 36 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.131137:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.131148:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 14 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.131160:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466468096:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.131218:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.135424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.136472:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902592 00000100:00100000:2.0:1746147192.136480:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902592 00000100:00100000:2.0:1746147192.136514:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12054 00000100:00100000:2.0:1746147192.136520:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29113:x1830967463902592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.136536:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.136550:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e744d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.136584:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.136589:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 36 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.136600:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 36 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.136608:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f864e00, rc 0) 00000100:00100000:2.0:1746147192.136646:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29113:x1830967463902592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 126us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.136655:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12054 00000100:00100000:2.0:1746147192.136859:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466468096:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.136877:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 36 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.136884:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f865e00, rc 0) 00000100:00100000:2.0:1746147192.136903:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+36:29112:x1830967463902464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5863us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.136908:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12053 00000100:00100000:0.0:1746147192.137271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.137289:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902720 00000100:00100000:0.0:1746147192.137292:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902720 00010000:00010000:0.0:1746147192.137308:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 15 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.137323:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5994 00000100:00100000:0.0:1746147192.137328:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463902720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.137336:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.137352:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 15 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.137362:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 15 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.137378:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd9c800/0xb4b2209fbdac762f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71fa expref: 15 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.137389:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.137390:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.137396:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.137402:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.137407:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.137408:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.137411:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.137416:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.137437:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 35 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.137446:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466468224:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147192.137490:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 35 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.137498:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466468352:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.137513:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.158047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.158120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.158138:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463903232 00000100:00100000:2.0:1746147192.158144:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463903232 00002000:00100000:2.0:1746147192.158174:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d37b80 x1830967463903232/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.158183:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463903232 ext(0->1048575) 00002000:00010000:2.0:1746147192.158187:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:2.0:1746147192.158200:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4658 00000100:00100000:2.0:1746147192.158206:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1959:x1830967463903232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147192.159428:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463902976 00000100:00100000:1.0:1746147192.159432:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463902976 00000100:00100000:1.0:1746147192.159457:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10585 00000100:00100000:1.0:1746147192.159462:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29117:x1830967463902976:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147192.159476:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.159489:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290800/0xb4b2209fbdac7954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7454 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.159558:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159580:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159589:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159600:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159608:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159612:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159693:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159700:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159705:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:1.0:1746147192.159711:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147192.159772:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159778:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159783:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159788:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5291000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.159791:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159795:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159804:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147192.159806:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.159809:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159813:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291000/0xb4b2209fbdac795b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159820:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159824:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159828:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159831:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5290c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.159833:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159837:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159841:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f600) 00010000:00010000:1.0:1746147192.159842:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.159844:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159847:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290c00/0xb4b2209fbdac7962 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.159873:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5290800/0xb4b2209fbdac7954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.159885:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.159890:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.159892:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147192.159893:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5291a00, rc 0) 00000100:00100000:1.0:1746147192.159916:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29117:x1830967463902976:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 453us (1874us total) trans 8589944344 rc 0/0 00000100:00100000:1.0:1746147192.159921:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10585 00000100:00100000:2.0:1746147192.159934:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466468224:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.159959:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466468352:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.159973:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.159993:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463902720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 22664us (22722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.160004:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5994 00000100:00100000:2.0:1746147192.173458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.173479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.173671:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463903616 00000100:00100000:3.0:1746147192.173685:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463903616 00002000:00100000:3.0:1746147192.173737:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d35500 x1830967463903616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147192.173739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147192.173747:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35500 with x1830967463903616 ext(0->1048575) 00002000:00010000:3.0:1746147192.173753:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35500 00000100:00100000:2.0:1746147192.173765:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463903744 00000100:00100000:2.0:1746147192.173772:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463903744 00000100:00100000:3.0:1746147192.173785:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4659 00002000:00100000:2.0:1746147192.173804:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d34e00 x1830967463903744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 504/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.173814:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34e00 with x1830967463903744 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.173818:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34e00 00000100:00100000:3.0:1746147192.173903:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463903616:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.174691:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4660 00000100:00100000:2.0:1746147192.174700:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967463903744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.176864:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463903872 00000100:00100000:2.0:1746147192.176872:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463903872 00000100:00100000:2.0:1746147192.176910:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12055 00000100:00100000:2.0:1746147192.176917:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29117:x1830967463903872:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.176931:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.176961:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e745b expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.176989:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 52 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.176996:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.176998:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.177001:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.177029:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 52 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.177040:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 52 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.177050:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466468480:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.177127:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.178367:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1959:x1830967463903232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20158us (20243us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.178375:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4658 00002000:00100000:0.0:1746147192.178383:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d37b80 x1830967463903232/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.178391:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d37b80 with x1830967463903232 ext(0->1048575) 00002000:00010000:0.0:1746147192.178395:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d37b80 00000100:00100000:0.0:1746147192.190815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.191139:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967463903744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16439us (17657us total) trans 0 rc 659456/659456 00000100:00100000:0.0:1746147192.191148:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4660 00002000:00100000:0.0:1746147192.191158:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d34e00 x1830967463903744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 504/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.191167:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34e00 with x1830967463903744 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.191172:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34e00 00000100:00100000:0.0:1746147192.191190:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904000 00000100:00100000:0.0:1746147192.191195:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904000 00002000:00100000:0.0:1746147192.191217:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3862527) req@ffff8800936dce00 x1830967463904000/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.191224:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dce00 with x1830967463904000 ext(3145728->3862527) 00010000:00010000:0.0:1746147192.191230:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 51 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.191243:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 51 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:0.0:1746147192.191248:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dce00 00000100:00100000:0.0:1746147192.191261:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1595 00000100:00100000:0.0:1746147192.191267:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+51:1957:x1830967463904000:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147192.191697:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466468480:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.191718:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.191729:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a84dfa00, rc 0) 00000100:00100000:2.0:1746147192.191749:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29117:x1830967463903872:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 14832us (18010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.191755:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12055 00000100:00100000:0.0:1746147192.194995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.195748:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904128 00000100:00100000:2.0:1746147192.195755:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904128 00000100:00100000:2.0:1746147192.195786:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12056 00000100:00100000:2.0:1746147192.195793:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29112:x1830967463904128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.195808:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.195822:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7462 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.195849:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 52 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.195855:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.195856:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.195860:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.195883:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 52 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.195892:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 52 pid: 11147 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.195902:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466468608:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.195964:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a313480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.197163:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463903616:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23259us (23709us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.197171:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4659 00002000:00100000:3.0:1746147192.197179:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880093d35500 x1830967463903616/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.197186:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d35500 with x1830967463903616 ext(0->1048575) 00002000:00010000:3.0:1746147192.197190:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d35500 00000100:00100000:3.0:1746147192.205954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.205999:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466468608:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.206025:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.206039:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c10a00, rc 0) 00000100:00100000:3.0:1746147192.206073:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29112:x1830967463904128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10280us (11084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.206080:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12056 00000100:00100000:3.0:1746147192.206113:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904256 00000100:00100000:3.0:1746147192.206118:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904256 00002000:00100000:3.0:1746147192.206148:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1130496->1519615) req@ffff8801312a4000 x1830967463904256/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.206157:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967463904256 ext(1130496->1519615) 00010000:00010000:3.0:1746147192.206163:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 53 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.206173:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 53 pid: 11147 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.206179:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312a4000 00000100:00100000:1.0:1746147192.206210:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1596 00000100:00100000:1.0:1746147192.206218:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+53:1957:x1830967463904256:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147192.210853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.214081:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904384 00000100:00100000:2.0:1746147192.214092:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904384 00000100:00100000:2.0:1746147192.214130:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12057 00000100:00100000:2.0:1746147192.214136:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+56:29113:x1830967463904384:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.214151:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.214163:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7469 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.214183:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.214187:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 57 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.214197:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 57 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.214205:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f94e600, rc 0) 00000100:00100000:2.0:1746147192.214246:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+57:29113:x1830967463904384:12345-192.168.203.36@tcp:101:cat.0 Request processed in 110us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.214250:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12057 00000100:00100000:1.0:1746147192.218921:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+57:1957:x1830967463904256:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12694us (12979us total) trans 17179873269 rc 0/0 00000100:00100000:1.0:1746147192.218933:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1596 00002000:00100000:1.0:1746147192.218970:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41c:0x0] (1130496->1519615) req@ffff8801312a4000 x1830967463904256/t17179873269(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.218979:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4000 with x1830967463904256 ext(1130496->1519615) 00010000:00010000:1.0:1746147192.218987:0:21470:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 57 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.218998:0:21470:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 57 pid: 11147 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.219004:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312a4000 00000100:00100000:1.0:1746147192.219191:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+56:1957:x1830967463904000:12345-192.168.203.36@tcp:4:cat.0 Request processed in 27924us (28381us total) trans 17179873268 rc 0/0 00000100:00100000:1.0:1746147192.219197:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1595 00002000:00100000:1.0:1746147192.219202:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3862527) req@ffff8800936dce00 x1830967463904000/t17179873268(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.219209:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dce00 with x1830967463904000 ext(3145728->3862527) 00010000:00010000:1.0:1746147192.219214:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 56 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.219222:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 56 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.219227:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dce00 00000100:00100000:2.0:1746147192.224969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.225055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.225125:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904512 00000100:00100000:1.0:1746147192.225132:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904512 00010000:00010000:1.0:1746147192.225164:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 56 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.225184:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904640 00000100:00100000:1.0:1746147192.225186:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904640 00010000:00010000:1.0:1746147192.225196:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 57 pid: 11147 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.225210:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5995 00000100:00100000:1.0:1746147192.225217:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+57:1956:x1830967463904512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.225227:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.225246:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 57 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.225254:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 57 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.225273:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac77da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e736d expref: 57 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.225285:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.225287:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.225292:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.225299:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.225325:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.225335:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466468736:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147192.225402:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.225415:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5996 00000100:00100000:1.0:1746147192.225420:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+56:1956:x1830967463904640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.225426:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.225436:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 56 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.225448:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 56 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.226487:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5c200/0xb4b2209fbdac7851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1130496->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73a5 expref: 56 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.226501:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.226503:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.226509:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.226516:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.226523:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.226524:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.226526:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 55 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.226533:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 55 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.226554:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 55 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.226573:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466468864:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.226633:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.226641:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466468992:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147192.227052:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c180 going to sleep for 11 seconds 00000001:00080000:2.0:1746147192.229119:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840675 is committed 00000001:00080000:2.0:1746147192.229130:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840672 is committed 00000001:00080000:2.0:1746147192.229141:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840644 is committed 00000001:00080000:2.0:1746147192.229153:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840633 is committed 00000001:00080000:2.0:1746147192.229163:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840673 is committed 00000001:00080000:2.0:1746147192.229181:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840647 is committed 00000001:00080000:2.0:1746147192.229187:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840678 is committed 00000001:00080000:2.0:1746147192.229207:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840649 is committed 00000001:00080000:2.0:1746147192.229230:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840677 is committed 00000001:00080000:2.0:1746147192.229243:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840653 is committed 00000100:00100000:3.0:1746147192.229259:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466468736:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.229309:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.229346:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+55:1956:x1830967463904512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4128us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.229356:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5995 00000100:00100000:0.0:1746147192.229850:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466468864:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.229859:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466468992:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147192.229869:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.229889:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+54:1956:x1830967463904640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4468us (4834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.229896:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5996 00000001:00080000:3.0:1746147192.231076:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873266 is committed 00000001:00080000:3.0:1746147192.231084:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873263 is committed 00000001:00080000:3.0:1746147192.231090:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873262 is committed 00000001:00080000:3.0:1746147192.231106:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873243 is committed 00000001:00080000:3.0:1746147192.231135:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873267 is committed 00000100:00100000:0.0:1746147192.232229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.232372:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463904768 00000100:00100000:2.0:1746147192.232381:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463904768 00000100:00100000:2.0:1746147192.232423:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12058 00000100:00100000:2.0:1746147192.232430:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+6:29117:x1830967463904768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.232450:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.232468:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7470 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.232500:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.232507:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.232508:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.232512:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.232539:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.232550:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 13 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.232561:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466469120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.233395:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.236880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.236974:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463905024 00000100:00100000:1.0:1746147192.236985:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463905024 00002000:00100000:1.0:1746147192.237036:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d36680 x1830967463905024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.237047:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36680 with x1830967463905024 ext(1048576->2097151) 00002000:00010000:1.0:1746147192.237053:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d36680 00000100:00100000:1.0:1746147192.237077:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4661 00000100:00100000:1.0:1746147192.237084:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463905024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.239658:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466469120:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.239691:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.239711:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f94ec00, rc 0) 00000100:00100000:2.0:1746147192.239774:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29117:x1830967463904768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7341us (7551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.239784:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12058 00000100:00100000:2.0:1746147192.243837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.243879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.243913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.243921:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463905280 00000100:00100000:1.0:1746147192.243932:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463905280 00000100:00100000:3.0:1746147192.243954:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463905536 00000100:00100000:3.0:1746147192.243958:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463905536 00000100:00100000:2.0:1746147192.243959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147192.243993:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d34380 x1830967463905536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147192.243995:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10586 00002000:00100000:3.0:1746147192.244002:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34380 with x1830967463905536 ext(1048576->2097151) 00000100:00100000:1.0:1746147192.244003:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+311:29119:x1830967463905280:12345-192.168.203.36@tcp:101:multiop.0 00002000:00010000:3.0:1746147192.244008:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34380 00000100:00100000:3.0:1746147192.244020:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463905792 00000100:00100000:3.0:1746147192.244022:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463905792 00010000:00010000:1.0:1746147192.244023:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746147192.244035:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4157440->4194303) req@ffff880093d36300 x1830967463905792/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.244042:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36300 with x1830967463905792 ext(4157440->4194303) 00010000:00010000:1.0:1746147192.244044:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a7000/0xb4b2209fbdac7993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7477 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.244049:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 14 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.244061:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 14 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.244067:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093d36300 00000100:00100000:3.0:1746147192.244078:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463905920 00000100:00100000:3.0:1746147192.244080:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463905920 00002000:00100000:3.0:1746147192.244091:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880093d34000 x1830967463905920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 504/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.244098:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34000 with x1830967463905920 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.244101:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34000 00000100:00100000:3.0:1746147192.244112:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1597 00000100:00100000:3.0:1746147192.244118:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1958:x1830967463905792:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:1.0:1746147192.244140:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.244154:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244163:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 312 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244169:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244175:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.244205:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244214:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 16 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.244226:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.244261:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4662 00000100:00100000:3.0:1746147192.244267:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463905536:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147192.244463:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 312 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244470:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 312 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.244476:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469376:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.244498:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 12 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.244505:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 12 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.244512:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.244526:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.244559:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4663 00000100:00100000:1.0:1746147192.244577:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463905920:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147192.252220:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463905792:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8099us (8303us total) trans 21474840679 rc 0/0 00000100:00100000:3.0:1746147192.252232:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1597 00002000:00100000:3.0:1746147192.252243:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4157440->4194303) req@ffff880093d36300 x1830967463905792/t21474840679(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.252252:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36300 with x1830967463905792 ext(4157440->4194303) 00010000:00010000:3.0:1746147192.252262:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.252730:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967463905024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14951us (15162us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147192.252740:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4661 00002000:00100000:1.0:1746147192.252747:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d36680 x1830967463905024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.252754:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d36680 with x1830967463905024 ext(1048576->2097151) 00002000:00010000:1.0:1746147192.252758:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d36680 00010000:00010000:3.0:1746147192.253151:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.253158:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093d36300 00000100:00100000:0.0:1746147192.264848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.264886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.264893:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469376:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.264906:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.264922:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466469248:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147192.264957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147192.264969:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:0.0:1746147192.264980:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906048 00000100:00100000:0.0:1746147192.264986:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906048 00010000:00010000:0.0:1746147192.265018:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 313 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.265051:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906176 00000100:00100000:0.0:1746147192.265054:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906176 00010000:00010000:0.0:1746147192.265064:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.265068:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906304 00000100:00100000:1.0:1746147192.265073:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906304 00000100:00100000:0.0:1746147192.265086:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5997 00010000:00010000:1.0:1746147192.265087:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 17 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.265093:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+313:1958:x1830967463906048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147192.265103:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5998 00010000:00010000:0.0:1746147192.265105:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147192.265108:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463906176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.265111:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 313 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.265115:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.265118:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.265125:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 313 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.265133:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.265225:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5999 00000100:00100000:3.0:1746147192.265241:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463906304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.265258:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.265267:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 17 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.265268:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac71200/0xb4b2209fbdac78c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73c1 expref: 313 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.265275:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac7874 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73b3 expref: 13 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.265281:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 17 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.265288:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147192.265293:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.265301:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.265306:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147192.265318:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.265319:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5291a00/0xb4b2209fbdac7969 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7454 expref: 17 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.265321:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.265328:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.265334:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147192.265342:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.265347:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147192.265351:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.265351:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+312:1958:x1830967463906048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 258us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.265358:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5997 00000100:00100000:1.0:1746147192.265370:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463906176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 261us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.265375:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5998 00000100:00100000:3.0:1746147192.265388:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463906304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 153us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.265395:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5999 00010000:00010000:1.0:1746147192.265396:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.265403:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:2.0:1746147192.265418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.265740:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906432 00000100:00100000:3.0:1746147192.265746:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906432 00010000:00010000:3.0:1746147192.265762:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.265780:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6000 00000100:00100000:3.0:1746147192.265784:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463906432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.265790:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.265805:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.265813:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.265825:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac77d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7366 expref: 16 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.265830:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463905536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 21563us (21950us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746147192.265835:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147192.265836:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4662 00010000:00010000:3.0:1746147192.265837:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.265842:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147192.265843:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff880093d34380 x1830967463905536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147192.265849:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147192.265851:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34380 with x1830967463905536 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.265855:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34380 00010000:00010000:3.0:1746147192.265876:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 6 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.265886:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466469632:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.265930:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000004:00200000:1.0:1746147192.266095:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147192.266230:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a7000/0xb4b2209fbdac7993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 313 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.266243:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 312 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.266249:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.266252:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147192.266254:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7a6e00, rc 0) 00000100:00100000:1.0:1746147192.266285:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+312:29119:x1830967463905280:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 22283us (22460us total) trans 8589944345 rc 0/0 00000100:00100000:1.0:1746147192.266291:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10586 00000100:00100000:0.0:1746147192.266749:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1956:x1830967463905920:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 22172us (22788us total) trans 0 rc 1011712/1011712 00000100:00100000:0.0:1746147192.266758:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4663 00002000:00100000:0.0:1746147192.266765:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880093d34000 x1830967463905920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 504/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.266774:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d34000 with x1830967463905920 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.266778:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d34000 00000100:00100000:3.0:1746147192.273325:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466469632:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.273350:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.273426:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463906432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7639us (8005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.273436:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6000 00000100:00100000:0.0:1746147192.276539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.276642:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906688 00000100:00100000:2.0:1746147192.276652:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906688 00000100:00100000:0.0:1746147192.276653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.276714:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906816 00000100:00100000:3.0:1746147192.276717:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906816 00000100:00100000:3.0:1746147192.276755:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12059 00000100:00100000:3.0:1746147192.276767:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29113:x1830967463906816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.276781:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.276796:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e747e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.276822:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 8 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.276829:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.276830:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.276833:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.276865:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 8 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.276877:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 8 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.276887:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466469760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.276984:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00002000:00100000:2.0:1746147192.277256:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4202496->4206591) req@ffff88009f731180 x1830967463906688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.277265:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967463906688 ext(4202496->4206591) 00002000:00010000:2.0:1746147192.277269:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:2.0:1746147192.277283:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4664 00000100:00100000:2.0:1746147192.277288:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463906688:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.277418:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1959:x1830967463906688:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 130us (889us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147192.277424:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4664 00002000:00100000:2.0:1746147192.277429:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (4202496->4206591) req@ffff88009f731180 x1830967463906688/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.277441:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967463906688 ext(4202496->4206591) 00002000:00010000:2.0:1746147192.277444:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:0.0:1746147192.290108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.290234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.290481:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463906944 00000100:00100000:2.0:1746147192.290492:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463906944 00000100:00100000:2.0:1746147192.290735:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12060 00000100:00100000:2.0:1746147192.290744:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+7:29112:x1830967463906944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.290760:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.290777:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7485 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.290805:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.290812:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.290813:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.290817:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.290844:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.290855:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 10 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.290903:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466469760:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.290932:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.290963:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463907200 00000100:00100000:1.0:1746147192.290971:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463907200 00010000:00010000:3.0:1746147192.290973:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd9c400, rc 0) 00000100:00100000:1.0:1746147192.291006:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4211 00000100:00100000:1.0:1746147192.291012:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29117:x1830967463907200:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147192.291020:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29113:x1830967463906816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 14252us (14366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.291026:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12059 00000100:00100000:1.0:1746147192.291240:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29117:x1830967463907200:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 228us (1005us total) trans 8589944346 rc 0/0 00000100:00100000:1.0:1746147192.291246:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4211 00000100:00100000:2.0:1746147192.291501:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466469888:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.291882:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.299573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.299691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.299780:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463907328 00000100:00100000:2.0:1746147192.299789:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463907328 00002000:00100000:2.0:1746147192.299832:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1794048->1830911) req@ffff88008dded180 x1830967463907328/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.299842:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dded180 with x1830967463907328 ext(1794048->1830911) 00010000:00010000:2.0:1746147192.299851:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 9 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.299863:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 9 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.299869:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dded180 00000100:00100000:2.0:1746147192.299887:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1598 00000100:00100000:2.0:1746147192.299893:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463907328:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:2.0:1746147192.300068:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463907456 00000100:00100000:2.0:1746147192.300070:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463907456 00010000:00010000:2.0:1746147192.300086:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.300101:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6001 00000100:00100000:2.0:1746147192.300105:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463907456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.300114:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.300131:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.300140:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.300164:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.300165:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.300173:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.300180:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.300206:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.300216:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466470016:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.300262:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147192.300352:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e48ca00/0xb4b2209fbdac7667 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7232 expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.300369:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466469888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.300390:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 8 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.300398:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fd5800, rc 0) 00000100:00100000:3.0:1746147192.300417:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+8:29112:x1830967463906944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9675us (10320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.300424:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12060 00000100:00100000:2.0:1746147192.302385:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463907328:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 2485us (2823us total) trans 17179873270 rc 0/0 00000100:00100000:2.0:1746147192.302394:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1598 00002000:00100000:2.0:1746147192.302403:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1794048->1830911) req@ffff88008dded180 x1830967463907328/t17179873270(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.302411:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dded180 with x1830967463907328 ext(1794048->1830911) 00010000:00010000:2.0:1746147192.302420:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.302432:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.302443:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dded180 00000100:00100000:3.0:1746147192.302732:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466470016:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.302748:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.302925:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463907456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2817us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.302933:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6001 00000100:00100000:0.0:1746147192.305026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.305110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.305217:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463907840 00000100:00100000:2.0:1746147192.305226:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463907840 00002000:00100000:2.0:1746147192.305270:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddeea00 x1830967463907840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.305281:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeea00 with x1830967463907840 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.305286:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddeea00 00000100:00100000:2.0:1746147192.305306:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4665 00000100:00100000:2.0:1746147192.305313:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463907840:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147192.305355:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463907584 00000100:00100000:3.0:1746147192.305359:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463907584 00010000:00010000:3.0:1746147192.305380:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.305406:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6002 00000100:00100000:3.0:1746147192.305411:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463907584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.305420:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147192.305435:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147191 -> 1746147192 00002000:00010000:3.0:1746147192.305437:0:7119:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147191 -> 1746147192 00010000:00010000:3.0:1746147192.305442:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.305454:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.305475:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d000/0xb4b2209fbdac7804 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1830911) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e737b expref: 11 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.305494:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.305495:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.305502:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.305511:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.305541:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.305553:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466470144:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.305641:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.309305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.309368:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463908096 00000100:00100000:1.0:1746147192.309375:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463908096 00000100:00100000:3.0:1746147192.309388:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466470144:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.309409:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147192.309413:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008ddece00 x1830967463908096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.309421:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddece00 with x1830967463908096 ext(1048576->2097151) 00002000:00010000:1.0:1746147192.309426:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddece00 00000100:00100000:3.0:1746147192.309455:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1959:x1830967463907584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4043us (4437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.309458:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4666 00000100:00100000:3.0:1746147192.309464:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6002 00000100:00100000:1.0:1746147192.309464:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463908096:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.324529:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463908096:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15054us (15222us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.324542:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4666 00002000:00100000:2.0:1746147192.324555:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008ddece00 x1830967463908096/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.324575:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddece00 with x1830967463908096 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.324580:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddece00 00000100:00100000:3.0:1746147192.330640:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463907840:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 25315us (25517us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.330653:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4665 00002000:00100000:3.0:1746147192.330666:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddeea00 x1830967463907840/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.330674:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddeea00 with x1830967463907840 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.330682:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddeea00 00000100:00100000:0.0:1746147192.332519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.332763:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463908224 00000100:00100000:3.0:1746147192.332772:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463908224 00000100:00100000:3.0:1746147192.332827:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12061 00000100:00100000:3.0:1746147192.332835:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+15:29113:x1830967463908224:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.332855:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.332874:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e748c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.333030:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.333032:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.333040:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.333054:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.333064:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800912cd600, rc 0) 00000100:00100000:3.0:1746147192.333105:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+16:29113:x1830967463908224:12345-192.168.203.36@tcp:101:cat.0 Request processed in 270us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.333110:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12061 00000100:00100000:0.0:1746147192.340506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.341391:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463908480 00000100:00100000:3.0:1746147192.341400:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463908480 00002000:00100000:3.0:1746147192.341448:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddef480 x1830967463908480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.341459:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddef480 with x1830967463908480 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.341464:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddef480 00000100:00100000:3.0:1746147192.341501:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4667 00000100:00100000:3.0:1746147192.341509:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463908480:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.351416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.352782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.352841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.352847:0:21471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463908736 00000100:00100000:0.0:1746147192.352853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.352857:0:21471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463908736 00000100:00100000:1.0:1746147192.352866:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463908992 00000100:00100000:1.0:1746147192.352871:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463908992 00002000:00100000:2.0:1746147192.352902:0:21471:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008ddef800 x1830967463908736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.352902:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008ddec380 x1830967463908992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.352911:0:21471:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddef800 with x1830967463908736 ext(2097152->3145727) 00002000:00100000:1.0:1746147192.352911:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddec380 with x1830967463908992 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.352916:0:21471:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddef800 00002000:00010000:1.0:1746147192.352916:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddec380 00000100:00100000:1.0:1746147192.352963:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463909248 00000100:00100000:2.0:1746147192.352965:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463909504 00000100:00100000:1.0:1746147192.352966:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463909248 00000100:00100000:2.0:1746147192.352968:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463909504 00002000:00100000:1.0:1746147192.352979:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008ddedc00 x1830967463909248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147192.352979:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4668 00002000:00100000:2.0:1746147192.352981:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4128767) req@ffff88008ddee300 x1830967463909504/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.352986:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddedc00 with x1830967463909248 ext(2097152->3145727) 00000100:00100000:0.0:1746147192.352987:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463908736:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:2.0:1746147192.352988:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddee300 with x1830967463909504 ext(3145728->4128767) 00002000:00010000:1.0:1746147192.352989:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddedc00 00002000:00010000:2.0:1746147192.352991:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddee300 00000100:00100000:1.0:1746147192.353001:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4669 00000100:00100000:2.0:1746147192.353006:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4670 00000100:00100000:1.0:1746147192.353006:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463908992:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.353011:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463909248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.353024:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4671 00000100:00100000:3.0:1746147192.353033:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463909504:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147192.356672:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463908480:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15153us (16166us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147192.356685:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4667 00002000:00100000:1.0:1746147192.356698:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008ddef480 x1830967463908480/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.356708:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddef480 with x1830967463908480 ext(1048576->2097151) 00002000:00010000:1.0:1746147192.356714:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddef480 00000100:00100000:0.0:1746147192.370518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.370582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.370621:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463909760 00000100:00100000:2.0:1746147192.370631:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463909760 00000100:00100000:2.0:1746147192.370669:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463909632 00000100:00100000:2.0:1746147192.370671:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463909632 00000100:00100000:2.0:1746147192.370689:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12062 00000100:00100000:2.0:1746147192.370695:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463909760:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.370710:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.370724:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea57400/0xb4b2209fbdac79bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e749a expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.370764:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466470272:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.370835:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.370859:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12063 00000100:00100000:2.0:1746147192.370865:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463909632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.370871:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.370878:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea56600/0xb4b2209fbdac79c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7493 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.370898:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466470400:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.370915:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.371894:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463909504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18858us (19034us total) trans 0 rc 983040/983040 00000100:00100000:3.0:1746147192.371906:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4671 00002000:00100000:3.0:1746147192.371918:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4128767) req@ffff88008ddee300 x1830967463909504/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.371928:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddee300 with x1830967463909504 ext(3145728->4128767) 00002000:00010000:3.0:1746147192.371934:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddee300 00002000:00010000:1.0:1746147192.381665:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147191 -> 1746147192 00002000:00010000:1.0:1746147192.381671:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147191 -> 1746147192 00002000:00010000:1.0:1746147192.381673:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147191 -> 1746147192 00000100:00100000:1.0:1746147192.381692:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466470272:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.381719:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea57400/0xb4b2209fbdac79bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e749a expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.381731:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea57400/0xb4b2209fbdac79bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e749a expref: 26 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.381748:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea57400, rc 0) 00000100:00100000:1.0:1746147192.381786:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463909760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11091us (11279us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.381793:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12062 00000100:00100000:2.0:1746147192.382118:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463908992:12345-192.168.203.36@tcp:3:cat.0 Request processed in 29109us (29336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.382127:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4669 00002000:00100000:2.0:1746147192.382134:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008ddec380 x1830967463908992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.382143:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddec380 with x1830967463908992 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.382147:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddec380 00000100:00100000:3.0:1746147192.383174:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463909248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 30155us (30324us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.383184:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4670 00002000:00100000:3.0:1746147192.383194:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008ddedc00 x1830967463909248/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.383885:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddedc00 with x1830967463909248 ext(2097152->3145727) 00002000:00010000:3.0:1746147192.383893:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ddedc00 00002000:00010000:2.0:1746147192.386697:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147191 -> 1746147192 00002000:00010000:2.0:1746147192.386705:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147191 -> 1746147192 00002000:00010000:2.0:1746147192.386707:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147191 -> 1746147192 00000100:00100000:2.0:1746147192.386729:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466470400:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.386766:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea56600/0xb4b2209fbdac79c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7493 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.386782:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea56600/0xb4b2209fbdac79c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7493 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.386805:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea56600, rc 0) 00000100:00100000:2.0:1746147192.386862:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463909632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 15995us (16278us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.386870:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12063 00000100:00100000:0.0:1746147192.386896:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1957:x1830967463908736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 33902us (35481us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.386908:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4668 00002000:00100000:0.0:1746147192.386918:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008ddef800 x1830967463908736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.386932:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ddef800 with x1830967463908736 ext(2097152->3145727) 00002000:00010000:0.0:1746147192.386957:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ddef800 00000100:00100000:0.0:1746147192.398058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.398593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.398677:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463909888 00000100:00100000:2.0:1746147192.398685:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463909888 00000100:00100000:1.0:1746147192.398700:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910016 00000100:00100000:1.0:1746147192.398710:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910016 00000100:00100000:2.0:1746147192.398732:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12064 00000100:00100000:2.0:1746147192.398740:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+16:29113:x1830967463909888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.398756:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147192.398767:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12065 00010000:00010000:2.0:1746147192.398770:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74a1 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.398775:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463910016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.398794:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.398795:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.398801:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.398803:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.398806:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.398811:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74a8 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.398830:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 7 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.398830:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.398831:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.398840:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 7 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.398840:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147192.398850:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466470528:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.398858:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.398868:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f199a00, rc 0) 00000100:00100000:1.0:1746147192.398911:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463910016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 137us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.398917:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.398927:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12065 00000100:00100000:2.0:1746147192.400306:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466470528:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.400329:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.400340:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e3e00, rc 0) 00000100:00100000:2.0:1746147192.400416:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29113:x1830967463909888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1674us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.400423:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12064 00000100:00100000:0.0:1746147192.402747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.402797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.402848:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910144 00000100:00100000:3.0:1746147192.402861:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910144 00000100:00100000:3.0:1746147192.402917:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12066 00000100:00100000:3.0:1746147192.402925:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ddedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29119:x1830967463910144:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147192.402983:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.403008:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74af expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.403041:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.403049:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.403060:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.403063:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.403066:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.403099:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.403109:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.403121:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466470656:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.403338:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910272 00000100:00100000:1.0:1746147192.403344:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910272 00002000:00100000:1.0:1746147192.403376:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4206591) req@ffff8800a5ba1c00 x1830967463910272/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 12776/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.403385:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1c00 with x1830967463910272 ext(4194304->4206591) 00010000:00010000:1.0:1746147192.403392:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 8 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.403401:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 8 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.403405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:1.0:1746147192.403407:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba1c00 00000100:00100000:1.0:1746147192.403432:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1599 00000100:00100000:1.0:1746147192.403438:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1956:x1830967463910272:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:3.0:1746147192.404126:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 10 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.404136:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 10 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.404146:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466470784:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.404448:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463910272:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1008us (1648us total) trans 21474840680 rc 0/0 00000100:00100000:1.0:1746147192.404455:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1599 00002000:00100000:1.0:1746147192.404461:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4206591) req@ffff8800a5ba1c00 x1830967463910272/t21474840680(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 12776/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.404469:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1c00 with x1830967463910272 ext(4194304->4206591) 00010000:00010000:1.0:1746147192.404473:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 10 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.404482:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 10 pid: 17530 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.404487:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ba1c00 00000100:00100000:1.0:1746147192.404512:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910400 00000100:00100000:1.0:1746147192.404515:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910400 00000100:00100000:1.0:1746147192.404533:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12067 00000100:00100000:1.0:1746147192.404537:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29112:x1830967463910400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.404545:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.404555:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74b6 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.404582:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.404584:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.404588:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4206592->4947967] (req 4206592->4947967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.404597:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4206592->4947967] (req 4206592->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.404605:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f198c00, rc 0) 00000100:00100000:1.0:1746147192.404625:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29112:x1830967463910400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 87us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.404629:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12067 00000100:00100000:3.0:1746147192.404700:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.405730:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466470656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.406084:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466470784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.406110:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.406124:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d800, rc 0) 00000100:00100000:3.0:1746147192.406159:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ddedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29119:x1830967463910144:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3234us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.406166:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12066 00000100:00100000:0.0:1746147192.407288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.407322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.407395:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910528 00000100:00100000:2.0:1746147192.407400:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910528 00010000:00010000:2.0:1746147192.407423:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.407433:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910656 00000100:00100000:3.0:1746147192.407435:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910656 00000100:00100000:2.0:1746147192.407452:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6003 00000100:00100000:2.0:1746147192.407457:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463910528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.407468:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.407484:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.407493:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.407511:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f94e600/0xb4b2209fbdac7985 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7469 expref: 26 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.407525:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.407572:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463910528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.407578:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6003 00010000:00010000:3.0:1746147192.407753:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.407768:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6004 00000100:00100000:3.0:1746147192.407773:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463910656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.407780:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.407787:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.407794:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.407811:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c10a00/0xb4b2209fbdac797e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7462 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.407824:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.407826:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.407831:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.407839:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.407861:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.407870:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466470912:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.407915:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.409924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.410074:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463910784 00000100:00100000:2.0:1746147192.410081:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463910784 00010000:00010000:2.0:1746147192.410104:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 11 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.410123:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6005 00000100:00100000:2.0:1746147192.410129:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463910784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.410138:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.410153:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 11 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.410162:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 11 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.410177:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ec00/0xb4b2209fbdac798c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7470 expref: 11 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.410188:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.410189:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.410194:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.410200:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.410206:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.410208:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.410211:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.410217:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.410239:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 10 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.410248:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466471040:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.410314:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.410321:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466471168:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.410339:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.412341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.412454:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463911040 00000100:00100000:1.0:1746147192.412462:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463911040 00002000:00100000:1.0:1746147192.412532:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1748992->1753087) req@ffff8800a5ba1500 x1830967463911040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.412543:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1500 with x1830967463911040 ext(1748992->1753087) 00002000:00010000:1.0:1746147192.412548:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1500 00000100:00100000:1.0:1746147192.412586:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4672 00000100:00100000:1.0:1746147192.412593:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463911040:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.412777:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463911040:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 183us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147192.412783:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4672 00002000:00100000:1.0:1746147192.412789:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1748992->1753087) req@ffff8800a5ba1500 x1830967463911040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.412795:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1500 with x1830967463911040 ext(1748992->1753087) 00002000:00010000:1.0:1746147192.412798:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1500 00000100:00100000:3.0:1746147192.413217:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466470912:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.413238:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.413280:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463910656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5505us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.413282:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466471040:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.413289:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6004 00000100:00100000:1.0:1746147192.415045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.415094:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463911296 00000100:00100000:2.0:1746147192.415103:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463911296 00002000:00100000:2.0:1746147192.415144:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4206592->4947967) req@ffff880090509880 x1830967463911296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.415152:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509880 with x1830967463911296 ext(4206592->4947967) 00002000:00010000:2.0:1746147192.415156:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509880 00000100:00100000:0.0:1746147192.415325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.415385:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463911552 00000100:00100000:2.0:1746147192.415391:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463911552 00002000:00100000:2.0:1746147192.415406:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a5ba0a80 x1830967463911552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.415413:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0a80 with x1830967463911552 ext(2097152->3145727) 00002000:00010000:2.0:1746147192.415416:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0a80 00000100:00100000:3.0:1746147192.415442:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466471168:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.415469:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.415508:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463910784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5377us (5704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.415516:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6005 00000100:00100000:2.0:1746147192.415640:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4673 00000100:00100000:2.0:1746147192.415649:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463911296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147192.415649:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4674 00000100:00100000:1.0:1746147192.415658:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967463911552:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147192.421137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.421208:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463911680 00000100:00100000:3.0:1746147192.421218:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463911680 00000100:00100000:3.0:1746147192.421652:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12068 00000100:00100000:3.0:1746147192.421660:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29119:x1830967463911680:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147192.421679:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.421697:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74bd expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.421727:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.421734:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.421740:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.421741:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.421744:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.421772:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.421781:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 9 pid: 21080 timeout: 679 lvb_type: 1 00000100:00100000:3.0:1746147192.421790:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471296:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.421877:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.421888:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.421895:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.421915:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.422114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.422384:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463911936 00000100:00100000:1.0:1746147192.422390:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463911936 00000100:00100000:1.0:1746147192.422421:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10587 00000100:00100000:1.0:1746147192.422425:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29122:x1830967463911936:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147192.422440:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.422452:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199800/0xb4b2209fbdac79ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74c4 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.422634:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422645:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422656:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422667:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422672:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422677:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422874:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0xb4b2209fbdac7a03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422882:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0xb4b2209fbdac7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.422887:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0xb4b2209fbdac7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147192.422895:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147192.423012:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423022:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423027:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423032:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f198400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.423035:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423041:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423051:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147192.423054:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.423057:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423061:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f198400/0xb4b2209fbdac79f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423085:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423090:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423094:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423098:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f199000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.423100:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423108:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423115:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f900) 00010000:00010000:1.0:1746147192.423116:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.423118:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423122:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199000/0xb4b2209fbdac79fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.423162:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f199800/0xb4b2209fbdac79ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74c4 expref: 20 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.423172:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0xb4b2209fbdac7a03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74c4 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.423178:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.423180:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147192.423182:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63ec00, rc 0) 00000100:00100000:1.0:1746147192.423216:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29122:x1830967463911936:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 790us (1102us total) trans 8589944347 rc 0/0 00000100:00100000:1.0:1746147192.423222:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10587 00000100:00100000:1.0:1746147192.427191:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967463911552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11523us (11853us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147192.427204:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4674 00002000:00100000:1.0:1746147192.427218:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a5ba0a80 x1830967463911552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.427234:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0a80 with x1830967463911552 ext(2097152->3145727) 00002000:00010000:1.0:1746147192.427239:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0a80 00000100:00100000:3.0:1746147192.428310:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471296:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.428321:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471424:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.428350:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.428368:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5c800, rc 0) 00000100:00100000:3.0:1746147192.428401:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29119:x1830967463911680:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6742us (7274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.428409:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12068 00000100:00100000:2.0:1746147192.428897:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1958:x1830967463911296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13248us (14186us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746147192.428905:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4673 00002000:00100000:2.0:1746147192.428912:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4206592->4947967) req@ffff880090509880 x1830967463911296/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.428921:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509880 with x1830967463911296 ext(4206592->4947967) 00002000:00010000:2.0:1746147192.428925:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509880 00000100:00100000:0.0:1746147192.429096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.429458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.429544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.429612:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912320 00000100:00100000:1.0:1746147192.429619:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912320 00000100:00100000:1.0:1746147192.429653:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912192 00000100:00100000:1.0:1746147192.429655:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912192 00010000:00010000:1.0:1746147192.429666:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.429678:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912064 00000100:00100000:1.0:1746147192.429680:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912064 00010000:00010000:1.0:1746147192.429688:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 10 pid: 21080 timeout: 679 lvb_type: 1 00000100:00100000:1.0:1746147192.429699:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6006 00000100:00100000:1.0:1746147192.429705:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463912192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.429718:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.429738:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.429747:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.429768:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd9c400/0xb4b2209fbdac79a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e747e expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.429783:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.429804:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463912192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.429809:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6006 00000100:00100000:1.0:1746147192.429821:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6007 00000100:00100000:1.0:1746147192.429825:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463912064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.429831:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.429837:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 10 pid: 21080 timeout: 679 lvb_type: 1 00010000:00010000:1.0:1746147192.429845:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 10 pid: 21080 timeout: 679 lvb_type: 1 00010000:00010000:1.0:1746147192.429856:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f199a00/0xb4b2209fbdac79d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a8 expref: 10 pid: 21080 timeout: 679 lvb_type: 1 00010000:00010000:1.0:1746147192.429869:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.429871:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.429877:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.429884:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.429911:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.429923:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466471552:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147192.429997:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.430045:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 594 00000100:00100000:3.0:1746147192.430052:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1958:x1830967463912320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.430060:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.430073:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0xb4b2209fbdac7a03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74c4 expref: 19 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.430088:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.430092:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.430107:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463912320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 56us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.430113:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 594 00000100:00100000:0.0:1746147192.432666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.432703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.432729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.432827:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912448 00000100:00100000:3.0:1746147192.432835:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912448 00000100:00100000:3.0:1746147192.432881:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912576 00000100:00100000:3.0:1746147192.432884:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912576 00000100:00100000:3.0:1746147192.432894:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912704 00000100:00100000:3.0:1746147192.432896:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912704 00000100:00100000:3.0:1746147192.432909:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12069 00000100:00100000:3.0:1746147192.432915:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463912448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.432933:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.432970:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7a11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74cb expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.433020:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471680:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.433084:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.433193:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12070 00000100:00100000:1.0:1746147192.433200:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463912576:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.433207:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.433215:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdac7a18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74d2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.433237:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466471808:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.433267:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.433296:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466471552:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.433309:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.433327:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463912064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3501us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.433335:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6007 00000100:00100000:1.0:1746147192.433361:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12071 00000100:00100000:1.0:1746147192.433366:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29113:x1830967463912704:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.433372:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.433378:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74d9 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.433395:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.433407:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.433409:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.433413:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 26 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.433427:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.433438:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 12 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.433446:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466471936:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.433467:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746147192.435221:0:17530:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147191 -> 1746147192 00002000:00010000:3.0:1746147192.435228:0:17530:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147191 -> 1746147192 00002000:00010000:3.0:1746147192.435230:0:17530:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147191 -> 1746147192 00000100:00100000:3.0:1746147192.435253:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466471680:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.435280:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7a11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74cb expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.435291:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7a11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74cb expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.435303:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5de00, rc 0) 00000100:00100000:3.0:1746147192.435800:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1959:x1830967463912448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2882us (3141us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.435808:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12069 00000100:00100000:0.0:1746147192.435880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.435920:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463912960 00000100:00100000:3.0:1746147192.435926:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463912960 00002000:00100000:3.0:1746147192.435982:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1515520->1519615) req@ffff8800a4671880 x1830967463912960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.435992:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967463912960 ext(1515520->1519615) 00002000:00010000:3.0:1746147192.435997:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:3.0:1746147192.436127:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4675 00000100:00100000:3.0:1746147192.436135:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463912960:12345-192.168.203.36@tcp:3:multiop.0 00002000:00010000:1.0:1746147192.436279:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147191 -> 1746147192 00000100:00100000:1.0:1746147192.436287:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466471808:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.436303:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdac7a18 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d2 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.436311:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0xb4b2209fbdac7a18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d2 expref: 10 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.436318:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e000, rc 0) 00000100:00100000:1.0:1746147192.436343:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1959:x1830967463912576:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3143us (3639us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.436347:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12070 00000100:00100000:1.0:1746147192.436373:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466471936:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.436386:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.436396:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63f800, rc 0) 00000100:00100000:1.0:1746147192.436422:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:29113:x1830967463912704:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3056us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.436427:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12071 00000100:00100000:3.0:1746147192.436513:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463912960:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 379us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147192.436520:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4675 00002000:00100000:3.0:1746147192.436525:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1515520->1519615) req@ffff8800a4671880 x1830967463912960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.436532:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671880 with x1830967463912960 ext(1515520->1519615) 00002000:00010000:3.0:1746147192.436534:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671880 00000100:00100000:0.0:1746147192.438229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.438405:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913088 00000100:00100000:3.0:1746147192.438413:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913088 00002000:00100000:3.0:1746147192.438446:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (4128768->4194303) req@ffff8800a4672680 x1830967463913088/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.438456:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967463913088 ext(4128768->4194303) 00010000:00010000:3.0:1746147192.438464:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 9 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.438482:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 9 pid: 4445 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.438488:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4672680 00000100:00100000:3.0:1746147192.439039:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1600 00000100:00100000:3.0:1746147192.439048:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+9:1957:x1830967463913088:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147192.439830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.439970:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913216 00000100:00100000:1.0:1746147192.439977:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913216 00000100:00100000:1.0:1746147192.440017:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12072 00000100:00100000:1.0:1746147192.440023:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463913216:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.440033:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.440049:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63f400/0xb4b2209fbdac7a26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74e0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.440099:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466472064:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.440168:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.441123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.441140:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913344 00000100:00100000:0.0:1746147192.441144:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913344 00000100:00100000:2.0:1746147192.441146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.441184:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913472 00000100:00100000:3.0:1746147192.441187:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913472 00000100:00100000:3.0:1746147192.441207:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12073 00000100:00100000:3.0:1746147192.441213:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463913472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.441222:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.441234:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74ee expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.441261:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466472192:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.441309:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.441413:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12074 00000100:00100000:0.0:1746147192.441419:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463913344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147192.441425:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.441432:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea56a00/0xb4b2209fbdac7a34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74e7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.441453:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466472320:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147192.441475:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.443043:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463913088:12345-192.168.203.36@tcp:4:cat.0 Request processed in 3992us (4817us total) trans 17179873271 rc 0/0 00000100:00100000:3.0:1746147192.443053:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1600 00002000:00100000:3.0:1746147192.443062:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (4128768->4194303) req@ffff8800a4672680 x1830967463913088/t17179873271(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.443072:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4672680 with x1830967463913088 ext(4128768->4194303) 00010000:00010000:3.0:1746147192.443080:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.443093:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.443097:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466472064:192.168.203.36@tcp:106: 00002000:00010000:3.0:1746147192.443100:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4672680 00010000:00010000:1.0:1746147192.443120:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63f400/0xb4b2209fbdac7a26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74e0 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.443130:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63f400/0xb4b2209fbdac7a26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74e0 expref: 16 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.443140:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63f400, rc 0) 00000100:00100000:3.0:1746147192.443251:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466472192:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.443266:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74ee expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147192.443267:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463913216:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3243us (3439us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.443273:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12072 00010000:00010000:3.0:1746147192.443275:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74ee expref: 15 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.443282:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d400, rc 0) 00000100:00100000:3.0:1746147192.443412:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463913472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2199us (2264us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.443418:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12073 00000100:00100000:2.0:1746147192.443551:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e5caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466472320:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.443575:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea56a00/0xb4b2209fbdac7a34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74e7 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.443583:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea56a00/0xb4b2209fbdac7a34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74e7 expref: 12 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.443593:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea56a00, rc 0) 00000100:00100000:2.0:1746147192.443612:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463913344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2193us (2491us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.443617:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12074 00000100:00100000:0.0:1746147192.448740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.448848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.448911:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913600 00000100:00100000:1.0:1746147192.448920:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913600 00010000:00010000:1.0:1746147192.448991:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.449003:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463913856 00000100:00100000:2.0:1746147192.449007:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463913856 00000100:00100000:1.0:1746147192.449025:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6008 00000100:00100000:2.0:1746147192.449037:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4212 00000100:00100000:1.0:1746147192.449037:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463913600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147192.449043:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29112:x1830967463913856:12345-192.168.203.36@tcp:35:cat.0 00010000:00010000:1.0:1746147192.449127:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.449148:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.449161:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.449183:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a84dfa00/0xb4b2209fbdac7977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e745b expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.449197:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.449199:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.449207:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.449215:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.449253:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 25 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.449266:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466472448:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.449274:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29112:x1830967463913856:12345-192.168.203.36@tcp:35:cat.0 Request processed in 230us (424us total) trans 8589944348 rc 0/0 00000100:00100000:2.0:1746147192.449280:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4212 00000100:00100000:1.0:1746147192.449336:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.451364:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466472448:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.451385:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.451424:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463913600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2390us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.451434:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6008 00000100:00100000:0.0:1746147192.456069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.456324:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463914112 00000100:00100000:3.0:1746147192.456335:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463914112 00002000:00100000:3.0:1746147192.456381:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008e5c8e00 x1830967463914112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.456415:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967463914112 ext(2097152->3145727) 00002000:00010000:3.0:1746147192.456421:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:3.0:1746147192.456454:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4676 00000100:00100000:3.0:1746147192.456726:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463914112:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147192.462064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.462093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.462193:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463914368 00000100:00100000:1.0:1746147192.462203:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463914368 00002000:00100000:1.0:1746147192.462253:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e5c9f80 x1830967463914368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.462264:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9f80 with x1830967463914368 ext(3145728->4194303) 00002000:00010000:1.0:1746147192.462269:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c9f80 00000100:00100000:1.0:1746147192.462290:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463914624 00000100:00100000:1.0:1746147192.462292:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463914624 00002000:00100000:1.0:1746147192.462304:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e5c9180 x1830967463914624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.462311:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9180 with x1830967463914624 ext(3145728->4194303) 00002000:00010000:1.0:1746147192.462314:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9180 00000100:00100000:1.0:1746147192.462332:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4677 00000100:00100000:1.0:1746147192.462340:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463914368:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147192.462750:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4678 00000100:00100000:3.0:1746147192.462759:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463914624:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147192.471438:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463914112:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14706us (15368us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.471450:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4676 00002000:00100000:3.0:1746147192.471462:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008e5c8e00 x1830967463914112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.471471:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8e00 with x1830967463914112 ext(2097152->3145727) 00002000:00010000:3.0:1746147192.471477:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c8e00 00000100:00100000:1.0:1746147192.473350:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463914368:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 11005us (11291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147192.473360:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4677 00002000:00100000:1.0:1746147192.473368:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008e5c9f80 x1830967463914368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.473377:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9f80 with x1830967463914368 ext(3145728->4194303) 00002000:00010000:1.0:1746147192.473381:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5c9f80 00000100:00100000:3.0:1746147192.475473:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463914624:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12706us (13370us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.475486:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4678 00002000:00100000:3.0:1746147192.475496:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e5c9180 x1830967463914624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.475505:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9180 with x1830967463914624 ext(3145728->4194303) 00002000:00010000:3.0:1746147192.475510:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9180 00000100:00100000:0.0:1746147192.483651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.483980:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463914880 00000100:00100000:3.0:1746147192.483990:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463914880 00002000:00100000:3.0:1746147192.484036:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88008e5c8000 x1830967463914880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.484047:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8000 with x1830967463914880 ext(4194304->4947967) 00002000:00010000:3.0:1746147192.484053:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8000 00000100:00100000:3.0:1746147192.484088:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4679 00000100:00100000:3.0:1746147192.484097:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463914880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.491765:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463914880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7658us (8113us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147192.491779:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4679 00002000:00100000:3.0:1746147192.491791:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88008e5c8000 x1830967463914880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.491801:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8000 with x1830967463914880 ext(4194304->4947967) 00002000:00010000:3.0:1746147192.491807:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8000 00000100:00100000:0.0:1746147192.527829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.527970:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915008 00000100:00100000:2.0:1746147192.527979:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915008 00000100:00100000:2.0:1746147192.528027:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12075 00000100:00100000:2.0:1746147192.528035:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29122:x1830967463915008:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.528055:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.528078:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74f5 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528111:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528121:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528127:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.528128:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.528132:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1781760->2097151] (req 1781760->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528162:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 16 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528177:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 16 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.528195:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.528296:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.528304:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.528311:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472704:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.528329:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.530303:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.530316:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472704:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.530345:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1781760->2097151] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.530359:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31ce00, rc 0) 00000100:00100000:2.0:1746147192.530405:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29122:x1830967463915008:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2371us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.530414:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12075 00000100:00100000:0.0:1746147192.532900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.532966:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915136 00000100:00100000:1.0:1746147192.532975:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915136 00000100:00100000:0.0:1746147192.532976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147192.533012:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.533044:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915264 00000100:00100000:1.0:1746147192.533047:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915264 00000100:00100000:0.0:1746147192.533055:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6009 00010000:00010000:1.0:1746147192.533057:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.533065:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1957:x1830967463915136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.533080:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147192.533120:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6010 00000100:00100000:1.0:1746147192.533127:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463915264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.533134:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.533143:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.533154:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.533162:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.533181:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800912cd600/0xb4b2209fbdac79b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e748c expref: 17 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.533194:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.533267:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4fd5800/0xb4b2209fbdac79af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7485 expref: 11 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.533268:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.533270:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.533278:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.533286:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.533295:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147192.533317:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.533328:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466472832:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.533331:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463915136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 268us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.533337:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6009 00000100:00100000:1.0:1746147192.533387:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.536660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.536755:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915520 00000100:00100000:3.0:1746147192.536764:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915520 00002000:00100000:3.0:1746147192.536813:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1781760->1785855) req@ffff880090509180 x1830967463915520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.536824:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967463915520 ext(1781760->1785855) 00002000:00010000:3.0:1746147192.536828:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00000100:00100000:3.0:1746147192.536848:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4680 00000100:00100000:3.0:1746147192.536854:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463915520:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.536882:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466472832:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.536900:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.536967:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463915264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3839us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.536976:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6010 00000100:00100000:3.0:1746147192.537019:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463915520:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 164us (368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147192.537024:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4680 00002000:00100000:3.0:1746147192.537029:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1781760->1785855) req@ffff880090509180 x1830967463915520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.537035:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090509180 with x1830967463915520 ext(1781760->1785855) 00002000:00010000:3.0:1746147192.537038:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090509180 00000100:00100000:0.0:1746147192.541174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.541263:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915648 00000100:00100000:2.0:1746147192.541272:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915648 00000100:00100000:2.0:1746147192.541333:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12076 00000100:00100000:2.0:1746147192.541341:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29122:x1830967463915648:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.541361:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.541379:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e74fc expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.541411:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 15 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.541420:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.541427:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.541429:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.541432:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->2568191] (req 2097152->2568191) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 11 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.541464:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 11 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.541476:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 11 pid: 21080 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.541488:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.542308:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 15 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.542319:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 15 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.542327:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473088:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.542368:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.543665:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466472960:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147192.544063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.544139:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915776 00000100:00100000:2.0:1746147192.544146:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915776 00010000:00010000:2.0:1746147192.544176:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 12 pid: 21080 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.544766:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6011 00000100:00100000:2.0:1746147192.544774:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463915776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.544788:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.544808:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 12 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.544817:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 12 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.544835:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f198c00/0xb4b2209fbdac79e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4206592->4947967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74b6 expref: 12 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.544862:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.544904:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463915776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.544909:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6011 00000100:00100000:3.0:1746147192.545287:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.545330:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->2568191] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.545345:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31de00, rc 0) 00000100:00100000:3.0:1746147192.546331:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+10:29122:x1830967463915648:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4986us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.546340:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12076 00000100:00100000:0.0:1746147192.548312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.548375:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463915904 00000100:00100000:2.0:1746147192.548384:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463915904 00010000:00010000:2.0:1746147192.548418:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.548458:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6012 00000100:00100000:2.0:1746147192.548465:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967463915904:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.548481:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.548503:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.548514:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.548536:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e3e00/0xb4b2209fbdac79cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74a1 expref: 16 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.548550:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.548552:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.548569:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.548577:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.548612:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.548623:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466473216:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.548707:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.554848:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466473216:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.554887:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.554975:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463915904:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6508us (6665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.554986:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6012 00000100:00100000:0.0:1746147192.555287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.555341:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463916160 00000100:00100000:1.0:1746147192.555349:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463916160 00002000:00100000:1.0:1746147192.555393:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2564096->2568191) req@ffff88008e5cbb80 x1830967463916160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.555402:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cbb80 with x1830967463916160 ext(2564096->2568191) 00002000:00010000:1.0:1746147192.555407:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5cbb80 00000100:00100000:1.0:1746147192.555436:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4681 00000100:00100000:1.0:1746147192.555444:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463916160:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.555698:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1956:x1830967463916160:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 255us (417us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147192.555704:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4681 00002000:00100000:1.0:1746147192.555710:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2564096->2568191) req@ffff88008e5cbb80 x1830967463916160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.555717:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5cbb80 with x1830967463916160 ext(2564096->2568191) 00002000:00010000:1.0:1746147192.555720:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5cbb80 00000100:00100000:0.0:1746147192.559021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.559068:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463916416 00000100:00100000:1.0:1746147192.559077:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463916416 00000100:00100000:1.0:1746147192.559167:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4213 00000100:00100000:1.0:1746147192.559176:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29122:x1830967463916416:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147192.559408:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:29122:x1830967463916416:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 232us (484us total) trans 8589944349 rc 0/0 00000100:00100000:1.0:1746147192.559413:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4213 00000100:00100000:0.0:1746147192.629512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.629685:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463916672 00000100:00100000:2.0:1746147192.629696:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463916672 00000100:00100000:2.0:1746147192.629762:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10588 00000100:00100000:2.0:1746147192.629771:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+312:29129:x1830967463916672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.629799:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.629819:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31cc00/0xb4b2209fbdac7a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7503 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.629969:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.629983:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.629994:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630012:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630018:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630024:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630133:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac7a5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630142:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac7a5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630147:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac7a5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147192.630156:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147192.630237:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630244:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630249:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630254:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f31d200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.630258:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630264:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630274:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147192.630277:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.630280:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630285:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31d200/0xb4b2209fbdac7a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630304:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630308:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630312:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630316:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f31c000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.630318:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630323:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630329:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013664e600) 00010000:00010000:2.0:1746147192.630331:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.630332:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630336:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c000/0xb4b2209fbdac7a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.630373:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31cc00/0xb4b2209fbdac7a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7503 expref: 315 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.630385:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac7a5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7503 expref: 314 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.630391:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.630393:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147192.630397:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31c600, rc 0) 00000100:00100000:2.0:1746147192.630465:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:29129:x1830967463916672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 694us (961us total) trans 8589944350 rc 0/0 00000100:00100000:2.0:1746147192.630472:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10588 00000100:00100000:0.0:1746147192.632789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.633181:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463916928 00000100:00100000:1.0:1746147192.633192:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463916928 00000100:00100000:1.0:1746147192.633248:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4214 00000100:00100000:1.0:1746147192.633256:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+314:29129:x1830967463916928:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:1.0:1746147192.633481:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+315:29129:x1830967463916928:12345-192.168.203.36@tcp:35:cat.0 Request processed in 225us (701us total) trans 8589944351 rc 0/0 00000100:00100000:1.0:1746147192.633487:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4214 00000100:00100000:0.0:1746147192.634877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.634961:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463917056 00000100:00100000:3.0:1746147192.634968:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463917056 00000100:00100000:3.0:1746147192.635014:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12077 00000100:00100000:3.0:1746147192.635022:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463917056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.635037:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.635055:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac7a6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e750a expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.635158:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473344:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.635384:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.635541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.635634:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463917184 00000100:00100000:2.0:1746147192.635639:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463917184 00000100:00100000:2.0:1746147192.635714:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12078 00000100:00100000:2.0:1746147192.635721:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463917184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.635728:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.635735:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac7a73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7511 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.635758:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466473472:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.635866:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.638842:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466473472:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.638875:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac7a73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7511 expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.638888:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f31d800/0xb4b2209fbdac7a73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7511 expref: 18 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.638910:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f31d800, rc 0) 00000100:00100000:0.0:1746147192.638980:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463917184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3259us (3438us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.638987:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12078 00002000:00010000:3.0:1746147192.639131:0:6881:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147191 -> 1746147192 00002000:00010000:3.0:1746147192.639135:0:6881:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147191 -> 1746147192 00002000:00010000:3.0:1746147192.639137:0:6881:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147191 -> 1746147192 00000100:00100000:3.0:1746147192.639146:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473344:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.639162:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac7a6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e750a expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.639171:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5cc00/0xb4b2209fbdac7a6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e750a expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.639195:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5cc00, rc 0) 00000100:00100000:3.0:1746147192.639213:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967463917056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4192us (4339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.639218:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12077 00000100:00100000:0.0:1746147192.647140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.647311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.647344:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463917440 00000100:00100000:3.0:1746147192.647354:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463917440 00000100:00100000:1.0:1746147192.647375:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463917696 00000100:00100000:1.0:1746147192.647378:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463917696 00002000:00100000:3.0:1746147192.647402:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1748991) req@ffff88008e5ca680 x1830967463917440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.647402:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1519616->2097151) req@ffff88008e5caa00 x1830967463917696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.647412:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca680 with x1830967463917440 ext(1048576->1748991) 00002000:00100000:1.0:1746147192.647415:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967463917696 ext(1519616->2097151) 00002000:00010000:3.0:1746147192.647416:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5ca680 00002000:00010000:1.0:1746147192.647418:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5caa00 00000100:00100000:1.0:1746147192.647465:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4682 00000100:00100000:1.0:1746147192.647476:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463917696:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.647536:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4683 00000100:00100000:3.0:1746147192.647542:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463917440:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.659693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.659736:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463917952 00000100:00100000:0.0:1746147192.659745:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463917952 00000100:00100000:0.0:1746147192.659792:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10589 00000100:00100000:0.0:1746147192.659800:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+315:29131:x1830967463917952:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147192.659825:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.659845:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f200/0xb4b2209fbdac7a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7518 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.659982:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.659995:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660005:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660017:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660022:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660027:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660130:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e200/0xb4b2209fbdac7a8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660139:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e200/0xb4b2209fbdac7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660144:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e200/0xb4b2209fbdac7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147192.660152:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147192.660234:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660244:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660250:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660256:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f94f000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147192.660260:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660266:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660277:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147192.660280:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147192.660284:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660289:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f000/0xb4b2209fbdac7a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660305:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660310:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660314:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660318:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f94e000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147192.660320:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660327:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660333:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48400) 00010000:00010000:0.0:1746147192.660335:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147192.660337:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660341:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e000/0xb4b2209fbdac7a88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147192.660374:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94f200/0xb4b2209fbdac7a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7518 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.660384:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e200/0xb4b2209fbdac7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7518 expref: 317 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.660390:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147192.660391:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147192.660394:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f94e200, rc 0) 00000100:00100000:0.0:1746147192.660441:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:29131:x1830967463917952:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 641us (757us total) trans 8589944352 rc 0/0 00000100:00100000:0.0:1746147192.660448:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10589 00000100:00100000:3.0:1746147192.661673:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463917440:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14128us (14542us total) trans 0 rc 700416/700416 00000100:00100000:3.0:1746147192.661681:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4683 00002000:00100000:3.0:1746147192.661690:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1748991) req@ffff88008e5ca680 x1830967463917440/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.661699:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5ca680 with x1830967463917440 ext(1048576->1748991) 00002000:00010000:3.0:1746147192.661704:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5ca680 00000100:00100000:1.0:1746147192.662761:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967463917696:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15284us (15445us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746147192.662770:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4682 00002000:00100000:1.0:1746147192.662776:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41d:0x0] (1519616->2097151) req@ffff88008e5caa00 x1830967463917696/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.662784:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5caa00 with x1830967463917696 ext(1519616->2097151) 00002000:00010000:1.0:1746147192.662787:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e5caa00 00000100:00100000:0.0:1746147192.662795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.662874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.662906:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918208 00000100:00100000:0.0:1746147192.662913:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918208 00000100:00100000:0.0:1746147192.662970:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4215 00000100:00100000:0.0:1746147192.662978:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:29131:x1830967463918208:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147192.663000:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918336 00000100:00100000:2.0:1746147192.663005:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918336 00000100:00100000:2.0:1746147192.663036:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 595 00000100:00100000:2.0:1746147192.663042:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1959:x1830967463918336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.663052:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.663073:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94e200/0xb4b2209fbdac7a8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7518 expref: 318 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.663093:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.663096:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.663117:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+318:1959:x1830967463918336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 75us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.663122:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 595 00000100:00100000:0.0:1746147192.663136:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+317:29131:x1830967463918208:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 159us (262us total) trans 8589944353 rc 0/0 00000100:00100000:0.0:1746147192.663142:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4215 00000100:00100000:0.0:1746147192.671422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.672456:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918464 00000100:00100000:3.0:1746147192.672467:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918464 00000100:00100000:3.0:1746147192.672516:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12079 00000100:00100000:3.0:1746147192.672523:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+15:29129:x1830967463918464:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.672543:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.672570:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e751f expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.672600:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.672607:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.672609:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.672612:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.672642:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 9 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.672654:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 9 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.672664:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473600:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.672757:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.678142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.678398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.678443:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918848 00000100:00100000:0.0:1746147192.678452:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918848 00002000:00100000:0.0:1746147192.678497:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1781760->2097151) req@ffff88012ba59180 x1830967463918848/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.678507:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59180 with x1830967463918848 ext(1781760->2097151) 00010000:00010000:0.0:1746147192.678517:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 10 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.678530:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 10 pid: 6881 timeout: 679 lvb_type: 0 00002000:00010000:0.0:1746147192.678537:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba59180 00000100:00100000:0.0:1746147192.678557:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1601 00000100:00100000:0.0:1746147192.678578:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+10:1957:x1830967463918848:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147192.680006:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466473600:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.680037:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.680128:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d400, rc 0) 00000100:00100000:2.0:1746147192.680491:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918720 00000100:00100000:2.0:1746147192.680497:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918720 00000100:00100000:2.0:1746147192.680547:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10590 00000100:00100000:2.0:1746147192.680553:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:29135:x1830967463918720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.680579:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.680595:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a000/0xb4b2209fbdac7aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7526 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.680687:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680698:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680708:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680717:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680722:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680726:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680815:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680822:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680826:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147192.680833:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147192.680902:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680908:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680913:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680917:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.680920:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680926:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680934:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147192.680951:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.680954:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.680958:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a600/0xb4b2209fbdac7aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681282:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681288:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681292:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681296:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.681298:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681301:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681307:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013664e600) 00010000:00010000:2.0:1746147192.681309:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.681311:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681315:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a200/0xb4b2209fbdac7ab2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.681344:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a000/0xb4b2209fbdac7aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7526 expref: 23 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.681352:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7526 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.681357:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.681359:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147192.681361:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a800, rc 0) 00000100:00100000:3.0:1746147192.682148:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:29129:x1830967463918464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9621us (10732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.682157:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12079 00000100:00100000:2.0:1746147192.682599:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29135:x1830967463918720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2044us (4465us total) trans 8589944354 rc 0/0 00000100:00100000:2.0:1746147192.682606:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10590 00000100:00100000:0.0:1746147192.688329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.688367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.688396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.688409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.688436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.688468:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919104 00000100:00100000:0.0:1746147192.688477:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919104 00000100:00100000:2.0:1746147192.688493:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919360 00000100:00100000:2.0:1746147192.688504:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919360 00000100:00100000:0.0:1746147192.688514:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919232 00000100:00100000:0.0:1746147192.688517:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919232 00000100:00100000:0.0:1746147192.688527:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919488 00000100:00100000:0.0:1746147192.688528:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919488 00000100:00100000:2.0:1746147192.688555:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12080 00000100:00100000:2.0:1746147192.688576:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463919104:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.688593:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.688608:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7ac7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e752d expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.688653:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466473728:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.688721:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.688738:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463918976 00000100:00100000:2.0:1746147192.688741:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463918976 00000100:00100000:2.0:1746147192.688765:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 596 00000100:00100000:2.0:1746147192.688770:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463918976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.688778:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.688795:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7ab9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7526 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.688800:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12081 00000100:00100000:0.0:1746147192.688812:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463919232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.688813:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.688817:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147192.688825:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147192.688836:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463918976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.688846:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 596 00000100:00100000:3.0:1746147192.688852:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12082 00000100:00100000:3.0:1746147192.688859:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463919360:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147192.688859:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12083 00010000:00010000:3.0:1746147192.688867:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147192.688868:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463919488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.688875:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.688876:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7ad5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e753b expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.688884:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7542 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.688896:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.688898:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.688907:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147192.688916:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466473856:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.688920:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 14 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.688950:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e0c00, rc 0) 00000100:00100000:3.0:1746147192.688984:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.688985:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463919488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.688991:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12083 00010000:00010000:0.0:1746147192.689078:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f94f400/0xb4b2209fbdac7ace lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7534 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.689152:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466473984:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.689185:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.690193:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463918848:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 11614us (11792us total) trans 21474840681 rc 0/0 00000100:00100000:1.0:1746147192.690201:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1601 00002000:00100000:1.0:1746147192.690210:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1781760->2097151) req@ffff88012ba59180 x1830967463918848/t21474840681(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.690218:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59180 with x1830967463918848 ext(1781760->2097151) 00010000:00010000:1.0:1746147192.690225:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 14 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.690237:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 14 pid: 6881 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.690242:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba59180 00000100:00100000:3.0:1746147192.693038:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466473856:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.693084:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7ad5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e753b expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.693099:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5de00/0xb4b2209fbdac7ad5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e753b expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.693125:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5de00, rc 0) 00000100:00100000:3.0:1746147192.693169:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463919360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4309us (4771us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.693177:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12082 00000100:00100000:3.0:1746147192.693836:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466473728:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.693857:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7ac7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e752d expref: 14 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.693869:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7ac7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e752d expref: 14 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.693876:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1ba00, rc 0) 00000100:00100000:3.0:1746147192.693898:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463919104:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5324us (5529us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.693904:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12080 00000100:00100000:3.0:1746147192.695216:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466473984:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.695235:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f94f400/0xb4b2209fbdac7ace lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7534 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.695243:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f94f400/0xb4b2209fbdac7ace lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7534 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.695250:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f94f400, rc 0) 00000100:00100000:3.0:1746147192.695274:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463919232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6464us (6864us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.695280:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12081 00000100:00100000:0.0:1746147192.698286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.698350:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919616 00000100:00100000:3.0:1746147192.698360:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919616 00000100:00100000:0.0:1746147192.698381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147192.698391:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 12 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.698421:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6013 00000100:00100000:0.0:1746147192.698424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.698429:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463919616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147192.698434:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463919872 00010000:00010000:3.0:1746147192.698444:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147192.698444:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463919872 00010000:00010000:3.0:1746147192.698465:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 12 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.698476:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 12 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.698497:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f31ce00/0xb4b2209fbdac7a3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74f5 expref: 12 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.698499:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10591 00000100:00100000:2.0:1746147192.698507:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29136:x1830967463919872:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147192.698511:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.698513:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.698520:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.698523:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920000 00010000:00010000:3.0:1746147192.698528:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.698528:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920000 00010000:00010000:2.0:1746147192.698531:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.698548:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac7ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7549 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.698551:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12084 00000100:00100000:1.0:1746147192.698557:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29135:x1830967463920000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.698572:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.698578:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147192.698585:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466474112:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.698593:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7550 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.698616:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.698623:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.698624:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147192.698627:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.698645:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147192.698645:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 25 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.698649:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147192.698655:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 25 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.698660:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147192.698662:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.698669:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698680:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698684:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147192.698686:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147192.698689:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698772:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1be00/0xb4b2209fbdac7aff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698781:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1be00/0xb4b2209fbdac7aff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698787:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1be00/0xb4b2209fbdac7aff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147192.698794:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147192.698857:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698863:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698868:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698872:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1ba00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.698875:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698880:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698889:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147192.698891:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.698894:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698899:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1ba00/0xb4b2209fbdac7af1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698922:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698927:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698964:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698969:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab1a800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.698971:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698975:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698981:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013664ee00) 00010000:00010000:2.0:1746147192.698983:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.698985:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.698990:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7af8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.699023:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1bc00/0xb4b2209fbdac7ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7549 expref: 24 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.699033:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1be00/0xb4b2209fbdac7aff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7549 expref: 23 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.699038:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.699040:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147192.699042:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1be00, rc 0) 00000100:00100000:2.0:1746147192.699140:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29136:x1830967463919872:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 632us (761us total) trans 8589944355 rc 0/0 00000100:00100000:2.0:1746147192.699147:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10591 00000100:00100000:1.0:1746147192.707357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.707388:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920128 00000100:00100000:1.0:1746147192.707397:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920128 00002000:00100000:1.0:1746147192.707444:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1748992->2097151) req@ffff88009e680380 x1830967463920128/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.707454:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967463920128 ext(1748992->2097151) 00010000:00010000:1.0:1746147192.707462:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.707475:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.707483:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e680380 00000100:00100000:1.0:1746147192.707518:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1602 00000100:00100000:1.0:1746147192.707526:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463920128:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147192.708048:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474240:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.708057:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466474112:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.708073:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147192.708074:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.708088:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e33200, rc 0) 00000100:00100000:3.0:1746147192.708102:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1956:x1830967463919616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9674us (9825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.708109:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:29135:x1830967463920000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9552us (9686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.708112:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6013 00000100:00100000:0.0:1746147192.708116:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12084 00000100:00100000:0.0:1746147192.713018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.713060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.713471:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920512 00000100:00100000:3.0:1746147192.713482:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920512 00000100:00100000:3.0:1746147192.713549:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 597 00000100:00100000:3.0:1746147192.713557:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463920512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.713581:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.713607:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab1be00/0xb4b2209fbdac7aff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7549 expref: 23 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.713625:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.713630:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.713690:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5803050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463920512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 133us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.713697:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 597 00000100:00100000:3.0:1746147192.713762:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920384 00000100:00100000:3.0:1746147192.713766:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920384 00002000:00100000:3.0:1746147192.713791:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012ba59500 x1830967463920384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.713801:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59500 with x1830967463920384 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.713804:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba59500 00000100:00100000:3.0:1746147192.713825:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4684 00000100:00100000:3.0:1746147192.713831:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967463920384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.717502:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463920128:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9965us (10143us total) trans 17179873272 rc 0/0 00000100:00100000:2.0:1746147192.717515:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1602 00002000:00100000:2.0:1746147192.717527:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1748992->2097151) req@ffff88009e680380 x1830967463920128/t17179873272(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.717535:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680380 with x1830967463920128 ext(1748992->2097151) 00010000:00010000:2.0:1746147192.717545:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.717557:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.717573:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e680380 00000100:00100000:0.0:1746147192.727225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.727297:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920640 00000100:00100000:1.0:1746147192.727307:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920640 00010000:00010000:1.0:1746147192.727346:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.727373:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6014 00000100:00100000:1.0:1746147192.727379:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463920640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.727393:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.727413:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.727423:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.727444:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0xb4b2209fbdac79d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74af expref: 28 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.727460:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.727462:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.727469:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.727481:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.727510:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 11 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.727521:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466474368:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147192.727607:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.728354:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967463920384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14520us (15340us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.728364:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4684 00002000:00100000:3.0:1746147192.728374:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012ba59500 x1830967463920384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.728383:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba59500 with x1830967463920384 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.728388:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba59500 00000100:00100000:0.0:1746147192.734641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.735065:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920768 00000100:00100000:2.0:1746147192.735076:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920768 00000100:00100000:2.0:1746147192.735151:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12085 00000100:00100000:2.0:1746147192.735159:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:29131:x1830967463920768:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.735173:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.735187:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7557 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.735212:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.735220:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.735231:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.735232:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.735236:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.735262:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.735272:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 11 pid: 11147 timeout: 679 lvb_type: 1 00000100:00100000:2.0:1746147192.735290:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474496:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.735390:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.735398:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.735406:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474624:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.735432:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.741130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.741751:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466474368:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.741778:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.741837:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463920640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 14455us (14621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.741849:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6014 00000100:00100000:2.0:1746147192.742615:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463920896 00000100:00100000:2.0:1746147192.742625:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463920896 00000100:00100000:2.0:1746147192.742672:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10592 00000100:00100000:2.0:1746147192.742683:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:29137:x1830967463920896:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147192.742711:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.742735:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac7b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e755e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.742798:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.742813:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.742824:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.742841:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.743390:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.743401:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.743533:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.743547:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.743553:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.743594:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 316 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.743604:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 316 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.743616:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466474752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.743689:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.744099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.744143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.744161:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.744202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.744216:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921280 00000100:00100000:1.0:1746147192.744220:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921280 00010000:00010000:1.0:1746147192.744245:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 12 pid: 11147 timeout: 679 lvb_type: 1 00000100:00100000:1.0:1746147192.744266:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921536 00000100:00100000:1.0:1746147192.744268:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921536 00010000:00010000:1.0:1746147192.744278:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.744292:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6015 00000100:00100000:1.0:1746147192.744297:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463921280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.744307:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.744324:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 12 pid: 11147 timeout: 679 lvb_type: 1 00010000:00010000:1.0:1746147192.744333:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 12 pid: 11147 timeout: 679 lvb_type: 1 00010000:00010000:1.0:1746147192.744351:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.744379:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463921280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.744385:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6015 00000100:00100000:1.0:1746147192.744399:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6016 00000100:00100000:1.0:1746147192.744403:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967463921536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147192.744409:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147192.744416:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.744424:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.744435:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.744436:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.744443:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.744587:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921408 00000100:00100000:3.0:1746147192.744591:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921408 00000100:00100000:3.0:1746147192.744614:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12086 00000100:00100000:3.0:1746147192.744619:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+16:29129:x1830967463921408:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.744629:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.744640:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7565 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.744656:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.744662:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.744663:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.744666:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.744683:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 10 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.744691:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 10 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.744700:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466474880:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.744749:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.744765:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921152 00000100:00100000:3.0:1746147192.744768:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921152 00002000:00100000:3.0:1746147192.744791:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012ba5b100 x1830967463921152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.744800:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b100 with x1830967463921152 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.744804:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5b100 00000100:00100000:3.0:1746147192.744818:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4685 00000100:00100000:3.0:1746147192.744822:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463921152:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:2.0:1746147192.745924:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0c00/0xb4b2209fbdac7adc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7542 expref: 13 pid: 11147 timeout: 679 lvb_type: 1 00000100:00100000:2.0:1746147192.745958:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474496:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.745971:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63f800/0xb4b2209fbdac7a1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74d9 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.745979:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466474624:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.746211:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.746227:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.746236:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d444800, rc 0) 00010000:00010000:1.0:1746147192.746236:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.746244:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466475008:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.746267:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+28:29131:x1830967463920768:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11109us (11635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.746274:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12085 00000100:00100000:1.0:1746147192.746274:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.748050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.748168:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466474752:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.748188:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147192.748253:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921664 00000100:00100000:3.0:1746147192.748260:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921664 00010000:00010000:3.0:1746147192.748288:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 317 pid: 14049 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.748311:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6017 00000100:00100000:3.0:1746147192.748319:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+317:1956:x1830967463921664:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.748333:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.748339:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 317 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.748349:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 317 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.748369:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7a6e00/0xb4b2209fbdac799a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7477 expref: 317 pid: 14049 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.748395:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.748401:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.748411:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.748417:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.748432:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.748459:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+316:1956:x1830967463921664:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.748466:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6017 00010000:00010000:2.0:1746147192.748602:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748609:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147192.748652:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:2.0:1746147192.748657:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147192.748672:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748680:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748688:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748694:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748699:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748703:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a8400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.748706:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748712:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748719:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147192.748721:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.748723:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748727:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8400/0xb4b2209fbdac7b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748735:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748740:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748744:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748747:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a9e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.748749:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748752:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748757:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013664e600) 00010000:00010000:2.0:1746147192.748758:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147192.748760:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748763:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9e00/0xb4b2209fbdac7b22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.748791:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9200/0xb4b2209fbdac7b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.748799:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 13 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.748805:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.748806:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147192.748808:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a9400, rc 0) 00000100:00100000:2.0:1746147192.748830:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:29137:x1830967463920896:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6151us (7711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.748836:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10592 00000100:00100000:0.0:1746147192.752588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.752636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.752661:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463921792 00000100:00100000:0.0:1746147192.752670:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463921792 00002000:00100000:0.0:1746147192.752715:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2568191) req@ffff88008d5de300 x1830967463921792/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.752725:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967463921792 ext(2097152->2568191) 00010000:00010000:0.0:1746147192.752734:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.752748:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 11 pid: 6881 timeout: 679 lvb_type: 0 00002000:00010000:0.0:1746147192.752755:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:1.0:1746147192.752964:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466475008:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147192.752990:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147192.753036:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967463921536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8631us (8833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.753045:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6016 00000100:00100000:2.0:1746147192.753332:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922048 00000100:00100000:2.0:1746147192.753336:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922048 00002000:00100000:2.0:1746147192.753356:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3620864->3624959) req@ffff88008d5dfb80 x1830967463922048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.753364:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967463922048 ext(3620864->3624959) 00002000:00010000:2.0:1746147192.753367:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dfb80 00000100:00100000:2.0:1746147192.753390:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4686 00000100:00100000:2.0:1746147192.753398:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463922048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.753545:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463922048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 148us (908us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147192.753551:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4686 00002000:00100000:2.0:1746147192.753556:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3620864->3624959) req@ffff88008d5dfb80 x1830967463922048/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.753574:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dfb80 with x1830967463922048 ext(3620864->3624959) 00002000:00010000:2.0:1746147192.753577:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5dfb80 00000100:00100000:0.0:1746147192.753783:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1603 00000100:00100000:0.0:1746147192.753790:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463921792:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147192.753893:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466474880:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.753916:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.753930:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3c00, rc 0) 00000100:00100000:3.0:1746147192.753967:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29129:x1830967463921408:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9347us (9822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.753974:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12086 00000100:00100000:1.0:1746147192.754212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.754232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.754241:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922176 00000100:00100000:3.0:1746147192.754244:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922176 00000100:00100000:3.0:1746147192.754261:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922304 00000100:00100000:3.0:1746147192.754263:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922304 00000100:00100000:1.0:1746147192.754264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.754276:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922432 00000100:00100000:3.0:1746147192.754278:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922432 00000100:00100000:1.0:1746147192.754282:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12087 00000100:00100000:1.0:1746147192.754289:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463922176:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147192.754293:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12088 00000100:00100000:3.0:1746147192.754297:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463922304:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.754298:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.754307:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.754311:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e756c expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.754317:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7573 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.754326:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.754327:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.754328:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.754329:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.754335:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.754335:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.754346:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.754347:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.754355:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3800, rc 0) 00010000:00010000:1.0:1746147192.754355:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e32200, rc 0) 00000100:00100000:1.0:1746147192.754371:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463922176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.754376:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12087 00000100:00100000:3.0:1746147192.754379:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463922304:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.754384:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12088 00000100:00100000:1.0:1746147192.754387:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12089 00000100:00100000:1.0:1746147192.754392:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463922432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.754398:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.754405:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e32400/0xb4b2209fbdac7b45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e757a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.754416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.754427:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922560 00000100:00100000:3.0:1746147192.754430:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922560 00000100:00100000:1.0:1746147192.754438:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466475136:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.754442:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12090 00000100:00100000:3.0:1746147192.754446:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463922560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.754452:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.754459:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7581 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.754469:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.754471:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.754475:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.754483:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147192.754488:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00010000:00010000:3.0:1746147192.754490:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2000, rc 0) 00000100:00100000:3.0:1746147192.754504:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463922560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.754508:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12090 00000100:00100000:1.0:1746147192.754515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.754524:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922688 00000100:00100000:3.0:1746147192.754526:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922688 00000100:00100000:3.0:1746147192.754549:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12091 00000100:00100000:1.0:1746147192.754552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.754554:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463922688:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.754572:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147192.754577:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922816 00010000:00010000:3.0:1746147192.754578:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7b53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7588 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.754580:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922816 00000100:00100000:3.0:1746147192.754598:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466475264:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.754600:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12092 00000100:00100000:1.0:1746147192.754604:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463922816:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147192.754609:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.754616:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094068c00/0xb4b2209fbdac7b5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e758f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.754620:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.754635:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466475392:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147192.755800:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.761062:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+11:1958:x1830967463921152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16226us (16952us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.761076:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4685 00002000:00100000:0.0:1746147192.761087:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88012ba5b100 x1830967463921152/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.761104:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5b100 with x1830967463921152 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.761110:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba5b100 00000100:00100000:1.0:1746147192.761244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.761893:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466475136:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.761923:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e32400/0xb4b2209fbdac7b45 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e757a expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.761956:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e32400/0xb4b2209fbdac7b45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e757a expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147192.762017:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466475392:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.762030:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094068c00/0xb4b2209fbdac7b5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e758f expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.762038:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094068c00/0xb4b2209fbdac7b5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e758f expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.762050:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094068c00, rc 0) 00000100:00100000:0.0:1746147192.762072:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463922816:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7467us (7519us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.762079:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12092 00000100:00100000:0.0:1746147192.762096:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463922944 00000100:00100000:0.0:1746147192.762101:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463922944 00000100:00100000:0.0:1746147192.762124:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12093 00000100:00100000:0.0:1746147192.762130:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29131:x1830967463922944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147192.762143:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.762155:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7596 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.762177:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147192.762179:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147192.762183:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->4263935] (req 4194304->4263935) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.762197:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->4263935] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.762205:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab1a800, rc 0) 00000100:00100000:0.0:1746147192.762216:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29131:x1830967463922944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 87us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.762221:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12093 00010000:00010000:1.0:1746147192.764581:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e32400, rc 0) 00000100:00100000:1.0:1746147192.764653:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463922432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10256us (10383us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.764662:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12089 00000100:00100000:3.0:1746147192.765018:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466475264:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.765048:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7b53 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7588 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.765062:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3600/0xb4b2209fbdac7b53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7588 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.765080:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f3600, rc 0) 00000100:00100000:3.0:1746147192.765106:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463922688:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10551us (10590us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.765111:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12091 00000100:00100000:0.0:1746147192.765973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.766106:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923072 00000100:00100000:3.0:1746147192.766112:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923072 00000100:00100000:3.0:1746147192.766141:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12094 00000100:00100000:3.0:1746147192.766148:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+11:29135:x1830967463923072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.766163:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.766178:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e759d expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.766202:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.766210:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.766212:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.766215:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.766243:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 26 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.766254:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 26 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.766269:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466475520:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.766317:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.766915:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463921792:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13123us (14335us total) trans 21474840682 rc 0/0 00000100:00100000:2.0:1746147192.766925:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1603 00002000:00100000:2.0:1746147192.766952:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2568191) req@ffff88008d5de300 x1830967463921792/t21474840682(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.766962:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de300 with x1830967463921792 ext(2097152->2568191) 00010000:00010000:2.0:1746147192.766970:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.766981:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.766987:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5de300 00000100:00100000:3.0:1746147192.768883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.768915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.769056:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923328 00000100:00100000:2.0:1746147192.769065:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923328 00000100:00100000:2.0:1746147192.769109:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10593 00000100:00100000:2.0:1746147192.769117:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:29137:x1830967463923328:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147192.769138:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.769156:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca000/0xb4b2209fbdac7b6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75a4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.769253:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.769270:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.769277:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.769308:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.769317:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 14 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.769329:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466475648:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.769415:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.769417:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923584 00000100:00100000:0.0:1746147192.769421:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923584 00010000:00010000:0.0:1746147192.769440:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.769446:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466475520:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147192.769457:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6018 00000100:00100000:0.0:1746147192.769461:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1958:x1830967463923584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.769469:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 12 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.769471:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.769481:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b829e00, rc 0) 00010000:00010000:0.0:1746147192.769486:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.769494:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.769501:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+12:29135:x1830967463923072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3354us (3532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.769507:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12094 00010000:00010000:0.0:1746147192.769510:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f31de00/0xb4b2209fbdac7a42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74fc expref: 13 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.769529:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.769531:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.769538:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.769545:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.769552:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.769553:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.769556:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.769572:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.769591:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.769600:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466475776:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147192.769625:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.769632:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466475904:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.769645:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.769724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.769762:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923456 00000100:00100000:2.0:1746147192.769765:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923456 00002000:00100000:2.0:1746147192.769790:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1519615) req@ffff8801312a4e00 x1830967463923456/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.769798:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4e00 with x1830967463923456 ext(1048576->1519615) 00010000:00010000:2.0:1746147192.769803:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 27 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.769812:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 27 pid: 17530 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.769818:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312a4e00 00000100:00100000:2.0:1746147192.769830:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1604 00000100:00100000:2.0:1746147192.769835:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463923456:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147192.771438:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466475648:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147192.771458:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147192.774074:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466475776:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.774356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.775465:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923712 00000100:00100000:3.0:1746147192.775474:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923712 00010000:00010000:3.0:1746147192.775509:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 15 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.775553:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6019 00000100:00100000:3.0:1746147192.775569:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967463923712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.775584:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.775703:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 15 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.775806:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 15 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.775828:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a9400/0xb4b2209fbdac7b29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e755e expref: 15 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.775845:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.775850:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.776801:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.776812:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.776835:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.777180:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967463923712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1617us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.777189:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6019 00010000:00010000:0.0:1746147192.777280:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.777287:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147192.777305:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147192.777427:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca000/0xb4b2209fbdac7b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.777446:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.777453:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147192.777456:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147192.777458:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ca200, rc 0) 00000100:00100000:0.0:1746147192.777484:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463923328:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 8369us (8609us total) trans 8589944356 rc 0/0 00000100:00100000:0.0:1746147192.777490:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10593 00000100:00100000:2.0:1746147192.777586:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466475904:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.777605:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.777621:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463923584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8159us (8706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.777627:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6018 00000100:00100000:0.0:1746147192.777656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.777707:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463923968 00000100:00100000:0.0:1746147192.777713:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463923968 00002000:00100000:0.0:1746147192.777739:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4259840->4263935) req@ffff88008d5dd180 x1830967463923968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.777748:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967463923968 ext(4259840->4263935) 00002000:00010000:0.0:1746147192.777752:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:0.0:1746147192.777767:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4687 00000100:00100000:0.0:1746147192.777772:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463923968:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.778999:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463923968:12345-192.168.203.36@tcp:3:cat.0 Request processed in 1221us (1337us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147192.779006:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4687 00002000:00100000:0.0:1746147192.779012:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4259840->4263935) req@ffff88008d5dd180 x1830967463923968/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.779019:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dd180 with x1830967463923968 ext(4259840->4263935) 00002000:00010000:0.0:1746147192.779023:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dd180 00000100:00100000:2.0:1746147192.782017:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967463923456:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12161us (12272us total) trans 17179873273 rc 0/0 00000100:00100000:2.0:1746147192.782032:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1604 00002000:00100000:2.0:1746147192.782049:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->1519615) req@ffff8801312a4e00 x1830967463923456/t17179873273(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.782060:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a4e00 with x1830967463923456 ext(1048576->1519615) 00010000:00010000:2.0:1746147192.782073:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 29 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.782092:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 29 pid: 17530 timeout: 679 lvb_type: 0 00002000:00010000:2.0:1746147192.782099:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312a4e00 00000100:00100000:0.0:1746147192.782580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.782619:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463924096 00000100:00100000:0.0:1746147192.782628:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463924096 00000100:00100000:0.0:1746147192.782665:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10594 00000100:00100000:0.0:1746147192.782672:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463924096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.782696:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.782712:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac7b84 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75ab expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.782795:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.782809:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.782816:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.782844:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.782858:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 15 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.782869:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466476032:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.782918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.782955:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.783029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.783052:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463924352 00000100:00100000:2.0:1746147192.783055:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463924352 00000100:00100000:3.0:1746147192.783085:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463924608 00000100:00100000:3.0:1746147192.783088:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463924608 00002000:00100000:2.0:1746147192.783088:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc97100 x1830967463924352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.783094:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97100 with x1830967463924352 ext(2097152->3145727) 00002000:00010000:2.0:1746147192.783098:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc97100 00002000:00100000:3.0:1746147192.783102:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fc95500 x1830967463924608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.783108:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95500 with x1830967463924608 ext(3145728->4194303) 00000100:00100000:2.0:1746147192.783109:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4688 00002000:00010000:3.0:1746147192.783111:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc95500 00000100:00100000:2.0:1746147192.783114:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463924352:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.783127:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4689 00000100:00100000:3.0:1746147192.783131:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463924608:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.784100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.784121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.784177:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463924864 00000100:00100000:1.0:1746147192.784181:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463924864 00002000:00100000:1.0:1746147192.784200:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008d5de680 x1830967463924864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.784206:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de680 with x1830967463924864 ext(2097152->3145727) 00002000:00010000:1.0:1746147192.784210:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5de680 00000100:00100000:1.0:1746147192.784220:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463925120 00000100:00100000:1.0:1746147192.784222:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463925120 00002000:00100000:1.0:1746147192.784230:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3620863) req@ffff88008d5df800 x1830967463925120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.784236:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df800 with x1830967463925120 ext(3145728->3620863) 00002000:00010000:1.0:1746147192.784238:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df800 00000100:00100000:1.0:1746147192.784247:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4690 00000100:00100000:1.0:1746147192.784252:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463924864:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.784445:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4691 00000100:00100000:0.0:1746147192.784450:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967463925120:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147192.789159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.789175:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466476032:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147192.789202:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147192.789207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.789432:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463925376 00000100:00100000:2.0:1746147192.789439:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463925376 00000100:00100000:2.0:1746147192.789498:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4216 00000100:00100000:2.0:1746147192.789506:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+316:29131:x1830967463925376:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147192.790045:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463925504 00000100:00100000:3.0:1746147192.790050:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463925504 00000100:00100000:2.0:1746147192.790063:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:29131:x1830967463925376:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 557us (912us total) trans 8589944357 rc 0/0 00000100:00100000:2.0:1746147192.790069:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4216 00010000:00010000:3.0:1746147192.790070:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 16 pid: 14125 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.790087:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6020 00000100:00100000:3.0:1746147192.790092:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463925504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.790101:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.790107:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 16 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.790120:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 16 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.790141:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ca200/0xb4b2209fbdac7b76 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75a4 expref: 16 pid: 14125 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.790257:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.790263:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.790272:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.790279:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147192.790304:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.790330:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1957:x1830967463925504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 238us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.790336:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6020 00010000:00010000:0.0:1746147192.790411:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.790417:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147192.790443:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:0.0:1746147192.790447:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147192.790462:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147192.790487:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f3000/0xb4b2209fbdac7b84 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.792803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.793052:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463925632 00000100:00100000:3.0:1746147192.793061:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463925632 00010000:00010000:3.0:1746147192.793091:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 33 pid: 17530 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.793485:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6021 00000100:00100000:3.0:1746147192.793493:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1959:x1830967463925632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.793509:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.793516:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.793526:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147192.793529:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 33 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.793529:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147192.793532:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2c00, rc 0) 00010000:00010000:3.0:1746147192.793540:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 33 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.793570:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5c800/0xb4b2209fbdac79e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e74bd expref: 33 pid: 17530 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.793583:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.793584:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.793591:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.793591:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463924096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10919us (11014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.793597:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10594 00010000:00010000:3.0:1746147192.793599:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.793630:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 11 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.793873:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466476160:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.794105:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.794499:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1959:x1830967463925120:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10047us (10374us total) trans 0 rc 475136/475136 00000100:00100000:1.0:1746147192.794507:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4691 00002000:00100000:1.0:1746147192.794517:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3620863) req@ffff88008d5df800 x1830967463925120/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.794526:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df800 with x1830967463925120 ext(3145728->3620863) 00002000:00010000:1.0:1746147192.794530:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df800 00000100:00100000:2.0:1746147192.796363:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967463924608:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13224us (13327us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.796371:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4689 00002000:00100000:2.0:1746147192.796378:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008fc95500 x1830967463924608/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.796387:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc95500 with x1830967463924608 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.796391:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc95500 00000100:00100000:2.0:1746147192.802749:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463924864:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18488us (18641us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.802760:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4690 00002000:00100000:2.0:1746147192.802770:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008d5de680 x1830967463924864/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.802778:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5de680 with x1830967463924864 ext(2097152->3145727) 00002000:00010000:2.0:1746147192.802784:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5de680 00000100:00100000:0.0:1746147192.804010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.804233:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466476160:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.804257:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.804314:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1959:x1830967463925632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10820us (11518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.804326:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6021 00000100:00100000:2.0:1746147192.804830:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463924352:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21713us (21909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.804839:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4688 00002000:00100000:2.0:1746147192.804846:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008fc97100 x1830967463924352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.804853:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc97100 with x1830967463924352 ext(2097152->3145727) 00002000:00010000:2.0:1746147192.804858:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc97100 00000100:00100000:2.0:1746147192.804877:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463925888 00000100:00100000:2.0:1746147192.804882:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463925888 00002000:00100000:2.0:1746147192.804904:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008d5df480 x1830967463925888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.804911:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967463925888 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.804914:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:2.0:1746147192.804926:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4692 00000100:00100000:2.0:1746147192.804931:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463925888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147192.807569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.807601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.807619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.807929:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926144 00000100:00100000:3.0:1746147192.807966:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926144 00000100:00100000:3.0:1746147192.808020:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926016 00000100:00100000:3.0:1746147192.808023:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926016 00000100:00100000:3.0:1746147192.808039:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926272 00000100:00100000:3.0:1746147192.808041:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926272 00000100:00100000:3.0:1746147192.808061:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12095 00000100:00100000:3.0:1746147192.808068:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463926144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.808088:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.808107:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7b92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75b9 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.808168:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466476288:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.808247:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.808269:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12096 00000100:00100000:3.0:1746147192.808274:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463926016:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.808282:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.808294:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75b2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.808305:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.808307:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.808316:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.808330:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.808341:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a310c00, rc 0) 00000100:00100000:3.0:1746147192.808361:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463926016:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 86us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.808366:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12096 00000100:00100000:3.0:1746147192.808381:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12097 00000100:00100000:3.0:1746147192.808385:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463926272:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147192.808390:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.808396:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a311800/0xb4b2209fbdac7ba0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75c0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.808415:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466476416:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.808433:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.817037:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463925888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12095us (13020us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.817047:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4692 00002000:00100000:2.0:1746147192.817056:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88008d5df480 x1830967463925888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.817065:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5df480 with x1830967463925888 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.817151:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d5df480 00000100:00100000:3.0:1746147192.817373:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466476288:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.817398:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7b92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b9 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.817409:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7b92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b9 expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.817422:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1200, rc 0) 00000100:00100000:3.0:1746147192.817441:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463926144:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9373us (9888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.817446:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12095 00000100:00100000:3.0:1746147192.817738:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466476416:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.817755:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a311800/0xb4b2209fbdac7ba0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c0 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.817763:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a311800/0xb4b2209fbdac7ba0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c0 expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.817770:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a311800, rc 0) 00000100:00100000:3.0:1746147192.817798:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463926272:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9412us (10177us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.817803:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12097 00000100:00100000:0.0:1746147192.818346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.818368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.818391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.818768:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926400 00000100:00100000:2.0:1746147192.818774:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926400 00000100:00100000:3.0:1746147192.818800:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926528 00000100:00100000:3.0:1746147192.818803:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926528 00000100:00100000:2.0:1746147192.818807:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926656 00000100:00100000:2.0:1746147192.818808:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926656 00000100:00100000:3.0:1746147192.818820:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12098 00000100:00100000:3.0:1746147192.818850:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1958:x1830967463926400:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.818861:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.818871:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75c7 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.818887:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.818888:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.818894:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.818904:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 30 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.818916:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a310800, rc 0) 00000100:00100000:3.0:1746147192.818952:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463926400:12345-192.168.203.36@tcp:101:cat.0 Request processed in 112us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.818980:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12099 00000100:00100000:0.0:1746147192.818984:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12100 00000100:00100000:2.0:1746147192.818986:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967463926528:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147192.818989:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463926656:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.818992:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.818995:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.818998:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75ce expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.819001:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d606c00/0xb4b2209fbdac7bb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75d5 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.819007:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.819008:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.819012:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.819020:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 31 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.819025:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0200, rc 0) 00000100:00100000:0.0:1746147192.819027:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466476544:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.819040:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463926528:12345-192.168.203.36@tcp:101:cat.0 Request processed in 55us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.819044:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12099 00000100:00100000:0.0:1746147192.819057:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.819469:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12098 00000100:00100000:0.0:1746147192.822651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.822805:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463926912 00000100:00100000:2.0:1746147192.822814:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463926912 00000100:00100000:2.0:1746147192.822876:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10595 00000100:00100000:2.0:1746147192.822885:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463926912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147192.822901:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.822914:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bbc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75dc expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.823030:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823041:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823049:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823058:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823063:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823068:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823073:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147192.823076:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823082:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823090:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147192.823092:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147192.823096:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823100:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7bc3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147192.823130:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bbc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75dc expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.823136:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bbc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75dc expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.823142:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0e00, rc 0) 00000100:00100000:2.0:1746147192.823197:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463926912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 312us (555us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.823202:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10595 00000100:00100000:1.0:1746147192.825112:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.825141:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466476544:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147192.825163:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d606c00/0xb4b2209fbdac7bb5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75d5 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.825174:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d606c00/0xb4b2209fbdac7bb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75d5 expref: 19 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.825200:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d606c00, rc 0) 00000100:00100000:3.0:1746147192.825210:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463927040 00000100:00100000:3.0:1746147192.825215:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463927040 00000100:00100000:0.0:1746147192.825227:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463926656:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6237us (6835us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147192.825234:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12100 00000100:00100000:3.0:1746147192.825241:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12101 00000100:00100000:3.0:1746147192.825247:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:29135:x1830967463927040:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.825258:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.825269:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75e3 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.825283:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.825285:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.825291:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.825303:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 13 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.825309:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1200, rc 0) 00000100:00100000:3.0:1746147192.825326:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29135:x1830967463927040:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.825331:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12101 00000100:00100000:0.0:1746147192.826029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.826075:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463927296 00000100:00100000:2.0:1746147192.826085:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463927296 00000100:00100000:2.0:1746147192.826119:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4217 00000100:00100000:2.0:1746147192.826124:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:29137:x1830967463927296:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147192.826336:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:29137:x1830967463927296:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 210us (313us total) trans 8589944358 rc 0/0 00000100:00100000:2.0:1746147192.826342:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4217 00000100:00100000:1.0:1746147192.829900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.829986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.830189:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463927552 00000100:00100000:3.0:1746147192.830199:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463927552 00002000:00100000:3.0:1746147192.830247:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4263936->4947967) req@ffff88008fc96d80 x1830967463927552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.830256:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463927552 ext(4263936->4947967) 00002000:00010000:3.0:1746147192.830261:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96d80 00000100:00100000:3.0:1746147192.830277:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463927808 00000100:00100000:3.0:1746147192.830279:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463927808 00002000:00100000:3.0:1746147192.830289:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009e681180 x1830967463927808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.830295:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681180 with x1830967463927808 ext(1048576->2097151) 00002000:00010000:3.0:1746147192.830298:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681180 00000100:00100000:3.0:1746147192.830307:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4693 00000100:00100000:3.0:1746147192.830313:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463927552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147192.830318:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4694 00000100:00100000:2.0:1746147192.830327:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463927808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.841064:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463927552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10739us (11161us total) trans 0 rc 684032/684032 00000100:00100000:3.0:1746147192.841849:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4693 00002000:00100000:3.0:1746147192.841863:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4263936->4947967) req@ffff88008fc96d80 x1830967463927552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.841876:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc96d80 with x1830967463927552 ext(4263936->4947967) 00002000:00010000:3.0:1746147192.841883:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc96d80 00010000:00010000:2.0:1746147192.843669:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147192.846194:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463927808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15861us (16200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.846203:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4694 00002000:00100000:2.0:1746147192.846213:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009e681180 x1830967463927808/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.846225:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681180 with x1830967463927808 ext(1048576->2097151) 00002000:00010000:2.0:1746147192.846229:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681180 00000100:00100000:0.0:1746147192.849488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.849691:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463927936 00000100:00100000:3.0:1746147192.849703:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463927936 00000100:00100000:3.0:1746147192.849769:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12102 00000100:00100000:3.0:1746147192.849776:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463927936:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.849795:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.849813:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a0000/0xb4b2209fbdac7bd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75ea expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.849867:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466476672:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.850004:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.854901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.855090:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928192 00000100:00100000:1.0:1746147192.855098:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928192 00000100:00100000:1.0:1746147192.855131:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12103 00000100:00100000:1.0:1746147192.855138:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463928192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.855154:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.855169:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b1a4200/0xb4b2209fbdac7bd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75f8 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.855183:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466476672:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.855206:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a0000/0xb4b2209fbdac7bd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ea expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147192.855211:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466476800:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.855216:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a0000/0xb4b2209fbdac7bd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ea expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.855231:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a0000, rc 0) 00000100:00100000:3.0:1746147192.855255:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463927936:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5479us (5773us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.855260:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12102 00000100:00100000:1.0:1746147192.855278:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.858204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.858882:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928064 00000100:00100000:2.0:1746147192.858893:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928064 00000100:00100000:2.0:1746147192.858982:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12104 00000100:00100000:2.0:1746147192.858991:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463928064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.859012:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.859032:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75f1 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.859089:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466476928:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.859706:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.860442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.860487:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928320 00000100:00100000:3.0:1746147192.860492:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928320 00000100:00100000:3.0:1746147192.860529:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12105 00000100:00100000:3.0:1746147192.860535:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463928320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.860546:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.860555:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac7be6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e75ff expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.860597:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477056:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.860645:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.860655:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466476800:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.860684:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b1a4200/0xb4b2209fbdac7bd8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75f8 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.860697:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b1a4200/0xb4b2209fbdac7bd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75f8 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.860716:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b1a4200, rc 0) 00000100:00100000:1.0:1746147192.860757:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1958:x1830967463928192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5619us (5862us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.860764:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12103 00000100:00100000:3.0:1746147192.861820:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477056:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.861844:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac7be6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ff expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.861856:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1600/0xb4b2209fbdac7be6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ff expref: 19 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147192.861977:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466476928:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.861995:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bdf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75f1 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.862003:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b0e00/0xb4b2209fbdac7bdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75f1 expref: 14 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.862013:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b0e00, rc 0) 00000100:00100000:2.0:1746147192.862042:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463928064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3053us (3850us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.862048:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12104 00010000:00010000:3.0:1746147192.862185:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1600, rc 0) 00000100:00100000:3.0:1746147192.862218:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463928320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1683us (1778us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.862224:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12105 00000100:00100000:0.0:1746147192.865484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.866486:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928448 00000100:00100000:3.0:1746147192.866498:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928448 00000100:00100000:3.0:1746147192.866552:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12106 00000100:00100000:3.0:1746147192.866569:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29135:x1830967463928448:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.866588:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.866607:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7606 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.866633:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.866635:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.866642:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.866656:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.866671:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1000, rc 0) 00000100:00100000:3.0:1746147192.866722:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29135:x1830967463928448:12345-192.168.203.36@tcp:101:cat.0 Request processed in 163us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.866728:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12106 00000100:00100000:0.0:1746147192.866933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.867304:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928576 00000100:00100000:3.0:1746147192.867308:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928576 00000100:00100000:3.0:1746147192.867334:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12107 00000100:00100000:3.0:1746147192.867339:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29136:x1830967463928576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147192.867346:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.867355:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e760d expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867372:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867379:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867386:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.867391:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.867393:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.867395:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 15 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867427:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 11 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.867437:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 11 pid: 17530 timeout: 679 lvb_type: 1 00000100:00100000:3.0:1746147192.867448:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477184:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.867524:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867532:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 15 pid: 17548 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.867540:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477312:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.867576:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.867583:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 17 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.867591:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477440:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.867608:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.869701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.869762:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928960 00000100:00100000:2.0:1746147192.869769:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928960 00000100:00100000:3.0:1746147192.869804:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477184:192.168.203.36@tcp:104: 00002000:00100000:2.0:1746147192.869807:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f7cf800 x1830967463928960/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.869816:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf800 with x1830967463928960 ext(2097152->3145727) 00000100:00100000:3.0:1746147192.869817:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477312:192.168.203.36@tcp:104: 00002000:00010000:2.0:1746147192.869820:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cf800 00000100:00100000:3.0:1746147192.869823:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466477440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.869850:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4695 00010000:00010000:3.0:1746147192.869854:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.869857:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463928960:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:3.0:1746147192.869867:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a1a00, rc 0) 00000100:00100000:3.0:1746147192.869903:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29136:x1830967463928576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2562us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.869910:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12107 00000100:00100000:0.0:1746147192.871908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.871987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.872124:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929088 00000100:00100000:2.0:1746147192.872131:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929088 00010000:00010000:2.0:1746147192.872160:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 18 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.872179:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463928704 00000100:00100000:2.0:1746147192.872181:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463928704 00010000:00010000:2.0:1746147192.872188:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 679 lvb_type: 1 00000100:00100000:2.0:1746147192.872200:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6022 00000100:00100000:2.0:1746147192.872206:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463929088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.872216:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.872235:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 18 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.872244:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 18 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.872264:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d400/0xb4b2209fbdac7a9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e751f expref: 18 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.872280:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.872302:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967463929088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.872307:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6022 00000100:00100000:2.0:1746147192.872317:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6023 00000100:00100000:2.0:1746147192.872321:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463928704:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.872326:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.872330:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 679 lvb_type: 1 00010000:00010000:2.0:1746147192.872337:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 679 lvb_type: 1 00010000:00010000:2.0:1746147192.872346:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2000/0xb4b2209fbdac7b4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7581 expref: 12 pid: 17530 timeout: 679 lvb_type: 1 00010000:00010000:2.0:1746147192.872352:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.872362:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463928704:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.872366:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6023 00000100:00100000:1.0:1746147192.872995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.873075:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929216 00000100:00100000:3.0:1746147192.873080:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929216 00010000:00010000:3.0:1746147192.873103:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 17 pid: 17548 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.873120:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6024 00000100:00100000:3.0:1746147192.873124:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463929216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.873131:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.873141:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 17 pid: 17548 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.873150:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 17 pid: 17548 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.873162:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1200/0xb4b2209fbdac7bca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75e3 expref: 17 pid: 17548 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.873178:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.873180:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.873186:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.873193:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.873221:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 16 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.873232:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466477568:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.873882:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.877407:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463928960:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 7540us (7702us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.877421:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4695 00002000:00100000:2.0:1746147192.877434:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f7cf800 x1830967463928960/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.877446:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf800 with x1830967463928960 ext(2097152->3145727) 00002000:00010000:2.0:1746147192.877453:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cf800 00000100:00100000:0.0:1746147192.877710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.877737:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466477568:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147192.877757:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.877781:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463929216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4656us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.877790:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6024 00000100:00100000:2.0:1746147192.877902:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929472 00000100:00100000:2.0:1746147192.877909:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929472 00002000:00100000:2.0:1746147192.878103:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1957888->1961983) req@ffff88009f7ce680 x1830967463929472/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.878111:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce680 with x1830967463929472 ext(1957888->1961983) 00002000:00010000:2.0:1746147192.878115:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ce680 00000100:00100000:2.0:1746147192.878413:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4696 00000100:00100000:2.0:1746147192.878421:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463929472:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.878571:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463929472:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 150us (862us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147192.878577:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4696 00002000:00100000:2.0:1746147192.878582:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1957888->1961983) req@ffff88009f7ce680 x1830967463929472/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.878590:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ce680 with x1830967463929472 ext(1957888->1961983) 00002000:00010000:2.0:1746147192.878592:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ce680 00000100:00100000:0.0:1746147192.882143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.882238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.882288:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929600 00000100:00100000:3.0:1746147192.882297:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929600 00000100:00100000:2.0:1746147192.882305:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929728 00000100:00100000:2.0:1746147192.882310:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929728 00000100:00100000:3.0:1746147192.882393:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12108 00000100:00100000:3.0:1746147192.882399:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+12:29135:x1830967463929600:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147192.882414:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12109 00010000:00010000:3.0:1746147192.882421:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147192.882421:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29136:x1830967463929728:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147192.882430:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.882435:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7614 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.882440:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e761b expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.882463:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.882464:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.882469:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147192.882470:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.882472:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.882473:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.882477:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147192.882479:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147192.882481:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->2838527] (req 2097152->2838527) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.882500:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.882501:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 29 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.882512:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 29 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.882516:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.882523:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466477824:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.882525:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477696:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147192.882709:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147192.883099:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 16 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.883108:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 16 pid: 21080 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.883116:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477952:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.883139:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.885125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.885180:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929856 00000100:00100000:1.0:1746147192.885187:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929856 00002000:00100000:1.0:1746147192.885225:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3620864->4194303) req@ffff88009f7cc000 x1830967463929856/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147192.885231:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477696:192.168.203.36@tcp:104: 00002000:00100000:1.0:1746147192.885234:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc000 with x1830967463929856 ext(3620864->4194303) 00000100:00100000:2.0:1746147192.885242:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466477952:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.885242:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 30 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.885254:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 30 pid: 4445 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.885259:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7cc000 00010000:00010000:2.0:1746147192.885267:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->2838527] (req 2097152->2838527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147192.885278:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1605 00010000:00010000:2.0:1746147192.885282:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b1600, rc 0) 00000100:00100000:1.0:1746147192.885284:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967463929856:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147192.885315:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29136:x1830967463929728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2895us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.885322:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12109 00000100:00100000:3.0:1746147192.885406:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466477824:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147192.885422:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.885433:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dca00, rc 0) 00000100:00100000:3.0:1746147192.885449:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29135:x1830967463929600:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3051us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.885455:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12108 00000100:00100000:0.0:1746147192.886850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.886897:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463929984 00000100:00100000:3.0:1746147192.886903:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463929984 00010000:00010000:3.0:1746147192.886922:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.886972:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6025 00000100:00100000:3.0:1746147192.886978:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463929984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.886988:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.887007:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.887017:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.887037:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1000/0xb4b2209fbdac7bed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7606 expref: 15 pid: 6881 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.887055:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147192.887082:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463929984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147192.887088:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6025 00000100:00100000:3.0:1746147192.888343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.888362:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463930112 00000100:00100000:3.0:1746147192.888366:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463930112 00010000:00010000:3.0:1746147192.888381:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 679 lvb_type: 0 00000100:00100000:3.0:1746147192.888412:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6026 00000100:00100000:3.0:1746147192.888418:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967463930112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147192.888427:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147192.888438:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.888447:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.888460:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f3c00/0xb4b2209fbdac7b30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7565 expref: 17 pid: 21080 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.888469:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.888471:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147192.888478:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.888485:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147192.888514:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.888525:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466478080:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.888593:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.890196:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466478080:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.890215:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.890254:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967463930112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1835us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.890263:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6026 00000100:00100000:1.0:1746147192.893320:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1957:x1830967463929856:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8026us (8191us total) trans 17179873274 rc 0/0 00000100:00100000:1.0:1746147192.893333:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1605 00002000:00100000:1.0:1746147192.893346:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3620864->4194303) req@ffff88009f7cc000 x1830967463929856/t17179873274(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.893465:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc000 with x1830967463929856 ext(3620864->4194303) 00010000:00010000:1.0:1746147192.893478:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:1.0:1746147192.893492:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00002000:00010000:1.0:1746147192.893499:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7cc000 00000100:00100000:3.0:1746147192.897214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.897293:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463930240 00000100:00100000:0.0:1746147192.897430:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463930240 00010000:00010000:0.0:1746147192.897466:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00000100:00100000:0.0:1746147192.897746:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6027 00000100:00100000:0.0:1746147192.897755:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1958:x1830967463930240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.897769:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.897791:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.897803:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.897826:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d444800/0xb4b2209fbdac7b0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7557 expref: 32 pid: 4445 timeout: 679 lvb_type: 0 00010000:00010000:0.0:1746147192.897853:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.897855:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.897863:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.897871:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.897975:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.897989:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466478208:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147192.898215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.898477:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463930496 00000100:00100000:1.0:1746147192.898481:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463930496 00000100:00100000:0.0:1746147192.898634:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00002000:00100000:1.0:1746147192.898973:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2834432->2838527) req@ffff8801312a6d80 x1830967463930496/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.898982:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6d80 with x1830967463930496 ext(2834432->2838527) 00002000:00010000:1.0:1746147192.898987:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6d80 00000100:00100000:1.0:1746147192.899034:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4697 00000100:00100000:1.0:1746147192.899041:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463930496:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.899204:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463930496:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 162us (1240us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147192.899210:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4697 00002000:00100000:1.0:1746147192.899215:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2834432->2838527) req@ffff8801312a6d80 x1830967463930496/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147192.899226:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6d80 with x1830967463930496 ext(2834432->2838527) 00002000:00010000:1.0:1746147192.899229:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6d80 00000100:00100000:2.0:1746147192.899886:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466478208:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.899906:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.900138:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967463930240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2383us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.900147:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6027 00000100:00100000:0.0:1746147192.902297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.903383:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463930752 00000100:00100000:2.0:1746147192.903393:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463930752 00000100:00100000:2.0:1746147192.903510:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4218 00000100:00100000:2.0:1746147192.903517:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29136:x1830967463930752:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147192.903745:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29136:x1830967463930752:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 227us (1456us total) trans 8589944359 rc 0/0 00000100:00100000:2.0:1746147192.903751:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4218 00000100:00100000:0.0:1746147192.905630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.905661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.905690:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463931008 00000100:00100000:2.0:1746147192.905698:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463931008 00000100:00100000:0.0:1746147192.905703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.905723:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463931136 00000100:00100000:0.0:1746147192.905726:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463931136 00002000:00100000:2.0:1746147192.905739:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f7cfb80 x1830967463931008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.905743:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f7cd180 x1830967463931136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.905749:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cfb80 with x1830967463931008 ext(2097152->3145727) 00002000:00100000:0.0:1746147192.905751:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd180 with x1830967463931136 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.905755:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cfb80 00002000:00010000:0.0:1746147192.905755:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cd180 00000100:00100000:2.0:1746147192.905769:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463931520 00000100:00100000:2.0:1746147192.905771:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463931520 00002000:00100000:2.0:1746147192.905783:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f7cf100 x1830967463931520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.905790:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf100 with x1830967463931520 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.905793:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cf100 00000100:00100000:2.0:1746147192.905821:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4698 00000100:00100000:2.0:1746147192.905828:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463931008:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147192.905864:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4699 00000100:00100000:1.0:1746147192.905873:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463931520:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147192.906170:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4700 00000100:00100000:0.0:1746147192.906175:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463931136:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.916312:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463931136:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 10123us (10636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.916325:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4700 00002000:00100000:2.0:1746147192.916338:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009f7cd180 x1830967463931136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.916348:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd180 with x1830967463931136 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.916354:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cd180 00000100:00100000:2.0:1746147192.921651:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463931520:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 15756us (15923us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147192.921664:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4699 00002000:00100000:2.0:1746147192.921683:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f7cf100 x1830967463931520/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.921693:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cf100 with x1830967463931520 ext(3145728->4194303) 00002000:00010000:2.0:1746147192.921708:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cf100 00000100:00100000:3.0:1746147192.923590:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1959:x1830967463931008:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 17756us (17960us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147192.923604:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4698 00002000:00100000:3.0:1746147192.923612:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f7cfb80 x1830967463931008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.923621:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cfb80 with x1830967463931008 ext(2097152->3145727) 00002000:00010000:3.0:1746147192.923626:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7cfb80 00000100:00100000:0.0:1746147192.930610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.930889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.931121:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463931904 00000100:00100000:1.0:1746147192.931140:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463931904 00000100:00100000:1.0:1746147192.931211:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10596 00000100:00100000:1.0:1746147192.931220:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+317:29144:x1830967463931904:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147192.931255:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.931285:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173a00/0xb4b2209fbdac7c09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7629 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.931578:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931591:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931602:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931624:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931642:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931648:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931793:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931809:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.931815:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147192.931837:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000100:00100000:3.0:1746147192.932215:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463931648 00000100:00100000:3.0:1746147192.932228:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463931648 00000100:00100000:3.0:1746147192.932298:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12110 00000100:00100000:3.0:1746147192.932305:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463931648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.932323:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.932334:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5dc000/0xb4b2209fbdac7c2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7622 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147192.932413:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466478336:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147192.932555:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed300 going to sleep for 11 seconds 00010000:00010000:1.0:1746147192.933549:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933567:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933574:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933589:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b173400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.933592:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933599:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933612:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147192.933614:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.933630:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933635:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933666:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933671:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933676:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933680:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b172200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147192.933682:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933686:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933691:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f200) 00010000:00010000:1.0:1746147192.933693:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147192.933695:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933698:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147192.933770:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b173a00/0xb4b2209fbdac7c09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.933781:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 319 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.933788:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147192.933790:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147192.933793:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b172c00, rc 0) 00000100:00100000:1.0:1746147192.933840:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+319:29144:x1830967463931904:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2621us (2951us total) trans 8589944360 rc 0/0 00000100:00100000:1.0:1746147192.933847:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10596 00000100:00100000:3.0:1746147192.935240:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466478336:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.935270:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dc000/0xb4b2209fbdac7c2c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7622 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.935283:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dc000/0xb4b2209fbdac7c2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7622 expref: 15 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.936088:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dc000, rc 0) 00000100:00100000:3.0:1746147192.936148:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463931648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3840us (5548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.936157:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12110 00000100:00100000:0.0:1746147192.939649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.939704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.939759:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932032 00000100:00100000:2.0:1746147192.939769:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932032 00000100:00100000:2.0:1746147192.939808:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932160 00000100:00100000:2.0:1746147192.939810:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932160 00000100:00100000:2.0:1746147192.939843:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12111 00000100:00100000:2.0:1746147192.939850:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29135:x1830967463932032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.939870:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.939886:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7630 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.939917:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.939925:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.939927:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147192.939930:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.939986:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 15 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.940003:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 15 pid: 11147 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.940015:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466478464:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147192.940087:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.940168:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12112 00000100:00100000:1.0:1746147192.940178:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:29144:x1830967463932160:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147192.940186:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.940195:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7637 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.940209:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.940215:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.940217:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147192.940219:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3530752->3747839] (req 3530752->3747839) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.940234:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.940242:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 12 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:1.0:1746147192.940251:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466478592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147192.940276:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.945346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.945419:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932288 00000100:00100000:3.0:1746147192.945433:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932288 00000100:00100000:2.0:1746147192.945464:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466478464:192.168.203.36@tcp:104: 00002000:00100000:3.0:1746147192.945484:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4263935) req@ffff880134d02680 x1830967463932288/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147192.945493:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147192.945494:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02680 with x1830967463932288 ext(4194304->4263935) 00010000:00010000:2.0:1746147192.945508:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094761e00, rc 0) 00000100:00100000:2.0:1746147192.945573:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29135:x1830967463932032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5722us (5932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.945582:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12111 00000100:00100000:1.0:1746147192.945649:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466478592:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147192.945666:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3530752->3747839] (req 3530752->3747839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.945675:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173600, rc 0) 00000100:00100000:1.0:1746147192.945689:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+32:29144:x1830967463932160:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5513us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147192.945694:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12112 00010000:00010000:3.0:1746147192.945727:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 16 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.945740:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 16 pid: 11147 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.945747:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d02680 00000100:00100000:3.0:1746147192.945763:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1606 00000100:00100000:3.0:1746147192.945770:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1958:x1830967463932288:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147192.946270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.946370:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932416 00000100:00100000:2.0:1746147192.946374:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932416 00010000:00010000:2.0:1746147192.946391:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.946421:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6028 00000100:00100000:2.0:1746147192.946426:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463932416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.946435:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.946452:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.946520:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.946541:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7bfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7614 expref: 13 pid: 8481 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.946567:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.946569:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.946575:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.946584:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.946608:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.946618:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466478720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.947041:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.948989:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466478720:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147192.948989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147192.949005:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.949045:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463932416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2618us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.949054:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6028 00000100:00100000:2.0:1746147192.949083:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932672 00000100:00100000:2.0:1746147192.949088:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932672 00002000:00100000:2.0:1746147192.949113:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3530752->3534847) req@ffff880134d01180 x1830967463932672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.949121:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463932672 ext(3530752->3534847) 00002000:00010000:2.0:1746147192.949125:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:2.0:1746147192.949136:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4701 00000100:00100000:2.0:1746147192.949141:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463932672:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.949230:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463932672:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 88us (249us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147192.949236:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4701 00002000:00100000:2.0:1746147192.949240:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3530752->3534847) req@ffff880134d01180 x1830967463932672/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.949246:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463932672 ext(3530752->3534847) 00000100:00100000:3.0:1746147192.949703:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463932288:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 3932us (4367us total) trans 21474840683 rc 0/0 00000100:00100000:3.0:1746147192.949711:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1606 00002000:00100000:3.0:1746147192.949716:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4263935) req@ffff880134d02680 x1830967463932288/t21474840683(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.949723:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02680 with x1830967463932288 ext(4194304->4263935) 00010000:00010000:3.0:1746147192.949731:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:3.0:1746147192.949757:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00002000:00010000:3.0:1746147192.949764:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d02680 00002000:00010000:2.0:1746147192.949862:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:0.0:1746147192.951815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.951893:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463932928 00000100:00100000:2.0:1746147192.951901:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463932928 00002000:00100000:2.0:1746147192.951957:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3743744->3747839) req@ffff880134d03b80 x1830967463932928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.951964:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03b80 with x1830967463932928 ext(3743744->3747839) 00002000:00010000:2.0:1746147192.951968:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d03b80 00000100:00100000:2.0:1746147192.951986:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4702 00000100:00100000:2.0:1746147192.951991:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463932928:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147192.952151:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463932928:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 158us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147192.952160:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4702 00002000:00100000:2.0:1746147192.952165:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3743744->3747839) req@ffff880134d03b80 x1830967463932928/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.952172:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03b80 with x1830967463932928 ext(3743744->3747839) 00002000:00010000:2.0:1746147192.952175:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d03b80 00000100:00100000:0.0:1746147192.952676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.952763:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933056 00000100:00100000:2.0:1746147192.952767:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933056 00010000:00010000:2.0:1746147192.952786:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00000100:00100000:2.0:1746147192.952817:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6029 00000100:00100000:2.0:1746147192.952823:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463933056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147192.952835:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147192.952853:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.952864:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.952887:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab1a800/0xb4b2209fbdac7b61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7596 expref: 18 pid: 11147 timeout: 679 lvb_type: 0 00010000:00010000:2.0:1746147192.952915:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.952917:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147192.952925:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.952933:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.952988:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.952999:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466478848:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147192.953065:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.953358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.953413:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933312 00000100:00100000:1.0:1746147192.953417:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933312 00000100:00100000:1.0:1746147192.953451:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4219 00000100:00100000:1.0:1746147192.953456:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+319:29144:x1830967463933312:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:1.0:1746147192.953700:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+320:29144:x1830967463933312:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 242us (341us total) trans 8589944361 rc 0/0 00000100:00100000:1.0:1746147192.953706:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4219 00000100:00100000:2.0:1746147192.954818:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466478848:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147192.954833:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147192.954856:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967463933056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2033us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147192.954864:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6029 00000100:00100000:0.0:1746147192.956185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.956234:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933568 00000100:00100000:2.0:1746147192.956241:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933568 00002000:00100000:2.0:1746147192.956274:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff880134d01c00 x1830967463933568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147192.956284:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01c00 with x1830967463933568 ext(4194304->4947967) 00002000:00010000:2.0:1746147192.956289:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01c00 00000100:00100000:2.0:1746147192.956314:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4703 00000100:00100000:2.0:1746147192.956321:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463933568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147192.962335:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463933568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6003us (6143us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147192.962348:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4703 00002000:00100000:3.0:1746147192.962361:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff880134d01c00 x1830967463933568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147192.962373:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01c00 with x1830967463933568 ext(4194304->4947967) 00002000:00010000:3.0:1746147192.962379:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01c00 00000100:00100000:0.0:1746147192.965853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.965975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147192.966042:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933696 00000100:00100000:2.0:1746147192.966051:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933696 00000100:00100000:1.0:1746147192.966089:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933824 00000100:00100000:1.0:1746147192.966094:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933824 00000100:00100000:2.0:1746147192.966098:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12113 00000100:00100000:2.0:1746147192.966105:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463933696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.966123:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147192.966133:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12114 00000100:00100000:1.0:1746147192.966138:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463933824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.966141:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094760e00/0xb4b2209fbdac7c41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e763e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.966149:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.966159:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b173200/0xb4b2209fbdac7c48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7645 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.966173:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094760e00/0xb4b2209fbdac7c41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e763e expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.966182:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094760e00/0xb4b2209fbdac7c41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e763e expref: 16 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.966197:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094760e00, rc 0) 00000100:00100000:1.0:1746147192.966200:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466478976:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.966241:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463933696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 136us (399us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.966247:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12113 00000100:00100000:1.0:1746147192.966275:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147192.967979:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009050ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466478976:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147192.968007:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b173200/0xb4b2209fbdac7c48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7645 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.968017:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b173200/0xb4b2209fbdac7c48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7645 expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.968037:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173200, rc 0) 00000100:00100000:1.0:1746147192.968073:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1957:x1830967463933824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1934us (2097us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.968079:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12114 00000100:00100000:2.0:1746147192.970793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.971155:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463933952 00000100:00100000:1.0:1746147192.971165:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463933952 00000100:00100000:0.0:1746147192.971177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147192.971199:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463934080 00000100:00100000:1.0:1746147192.971201:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463934080 00000100:00100000:1.0:1746147192.971214:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12115 00000100:00100000:1.0:1746147192.971220:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463933952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147192.971236:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147192.971252:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e764c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147192.971279:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e764c expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.971287:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b172200/0xb4b2209fbdac7c4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e764c expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147192.971297:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b172200, rc 0) 00000100:00100000:2.0:1746147192.971317:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12116 00000100:00100000:2.0:1746147192.971326:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463934080:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147192.971334:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147192.971337:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463933952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 117us (556us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147192.971343:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12115 00010000:00010000:2.0:1746147192.971344:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094760600/0xb4b2209fbdac7c56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7653 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147192.971391:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466479104:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147192.971438:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147192.973001:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466479104:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.973032:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094760600/0xb4b2209fbdac7c56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7653 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.973044:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094760600/0xb4b2209fbdac7c56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7653 expref: 13 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.973548:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094760600, rc 0) 00000100:00100000:2.0:1746147192.973610:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1959:x1830967463934080:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2285us (2432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.973618:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12116 00000100:00100000:0.0:1746147192.982434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.982650:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463934336 00000100:00100000:3.0:1746147192.982659:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463934336 00000100:00100000:3.0:1746147192.982711:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4220 00000100:00100000:3.0:1746147192.982718:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29135:x1830967463934336:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147192.982957:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29135:x1830967463934336:12345-192.168.203.36@tcp:35:cat.0 Request processed in 238us (534us total) trans 8589944362 rc 0/0 00000100:00100000:3.0:1746147192.982963:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4220 00000100:00100000:0.0:1746147192.986738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147192.986792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147192.987076:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463934464 00000100:00100000:3.0:1746147192.987086:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463934464 00000100:00100000:2.0:1746147192.987107:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463934592 00000100:00100000:2.0:1746147192.987111:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463934592 00000100:00100000:3.0:1746147192.987129:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12117 00000100:00100000:3.0:1746147192.987137:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463934464:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147192.987149:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12118 00000100:00100000:2.0:1746147192.987156:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463934592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147192.987157:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147192.987163:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147192.987175:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7c64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e765a expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.987175:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac7c5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7661 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147192.987206:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac7c5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7661 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147192.987216:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac7c5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7661 expref: 20 pid: 6881 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147192.987226:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479232:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147192.987232:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094761600, rc 0) 00000100:00100000:2.0:1746147192.987275:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463934592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (482us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147192.987282:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12118 00000100:00100000:3.0:1746147192.987535:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147192.990361:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479232:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147192.990396:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7c64 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e765a expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.990409:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dca00/0xb4b2209fbdac7c64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e765a expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147192.990431:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dca00, rc 0) 00000100:00100000:3.0:1746147192.990487:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967463934464:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3350us (3759us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147192.990495:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12117 00000100:00100000:1.0:1746147193.003455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.003508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.004231:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463934848 00000100:00100000:0.0:1746147193.004241:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463934848 00002000:00100000:0.0:1746147193.004285:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009050ad80 x1830967463934848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.004295:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050ad80 with x1830967463934848 ext(1048576->2097151) 00002000:00010000:0.0:1746147193.004300:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050ad80 00000100:00100000:0.0:1746147193.004315:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935104 00000100:00100000:0.0:1746147193.004316:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935104 00002000:00100000:0.0:1746147193.004324:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090508000 x1830967463935104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.004330:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508000 with x1830967463935104 ext(1048576->2097151) 00002000:00010000:0.0:1746147193.004333:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508000 00000100:00100000:0.0:1746147193.004342:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4704 00000100:00100000:0.0:1746147193.004348:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463934848:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.005849:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4705 00000100:00100000:2.0:1746147193.005862:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463935104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.018871:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463934848:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14515us (15419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.018881:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4704 00002000:00100000:2.0:1746147193.018890:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009050ad80 x1830967463934848/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.018898:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009050ad80 with x1830967463934848 ext(1048576->2097151) 00002000:00010000:2.0:1746147193.018902:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009050ad80 00000100:00100000:2.0:1746147193.019858:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463935104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13999us (16347us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.019865:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4705 00002000:00100000:2.0:1746147193.019871:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090508000 x1830967463935104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.019878:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090508000 with x1830967463935104 ext(1048576->2097151) 00002000:00010000:2.0:1746147193.019882:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090508000 00000100:00100000:0.0:1746147193.025402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.025467:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935232 00000100:00100000:3.0:1746147193.025477:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935232 00000100:00100000:3.0:1746147193.025576:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12119 00000100:00100000:3.0:1746147193.025585:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29149:x1830967463935232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.025604:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.025621:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7668 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.025761:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.025773:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.025775:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.025778:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.025808:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 14 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.025818:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 14 pid: 8481 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.025829:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.026069:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.027769:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.027796:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.027811:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd600, rc 0) 00000100:00100000:3.0:1746147193.027844:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29149:x1830967463935232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2261us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.027852:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12119 00000100:00100000:0.0:1746147193.028434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.028846:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935360 00000100:00100000:3.0:1746147193.028852:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935360 00002000:00100000:3.0:1746147193.029197:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1957888->2097151) req@ffff880134d00a80 x1830967463935360/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.029216:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00a80 with x1830967463935360 ext(1957888->2097151) 00010000:00010000:3.0:1746147193.029224:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 15 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.029236:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 15 pid: 8481 timeout: 680 lvb_type: 0 00002000:00010000:3.0:1746147193.029243:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d00a80 00000100:00100000:3.0:1746147193.029267:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1607 00000100:00100000:3.0:1746147193.029274:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463935360:12345-192.168.203.36@tcp:4:cat.0 00000100:00080000:1.0:1746147193.029328:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147193.034787:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463935360:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5501us (6342us total) trans 21474840684 rc 0/0 00000100:00100000:3.0:1746147193.034801:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1607 00002000:00100000:3.0:1746147193.034813:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1957888->2097151) req@ffff880134d00a80 x1830967463935360/t21474840684(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.034823:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00a80 with x1830967463935360 ext(1957888->2097151) 00010000:00010000:3.0:1746147193.034834:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.035055:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00002000:00010000:3.0:1746147193.035063:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d00a80 00000100:00100000:0.0:1746147193.037667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.037756:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935488 00000100:00100000:2.0:1746147193.037766:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935488 00010000:00010000:2.0:1746147193.038026:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.038056:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6030 00000100:00100000:2.0:1746147193.038064:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463935488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.038080:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.038101:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.038113:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.038134:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a1a00/0xb4b2209fbdac7bf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e760d expref: 17 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.038380:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.038382:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.038390:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.038399:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.038541:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.038554:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466479488:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147193.038877:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.042001:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466479488:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147193.042026:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.042086:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463935488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4022us (4427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.042100:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6030 00000100:00100000:0.0:1746147193.042653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.042787:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935744 00000100:00100000:3.0:1746147193.042794:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935744 00002000:00100000:3.0:1746147193.042840:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f369500 x1830967463935744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.043298:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369500 with x1830967463935744 ext(1048576->2097151) 00002000:00010000:3.0:1746147193.043304:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f369500 00000100:00100000:3.0:1746147193.043329:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4706 00000100:00100000:3.0:1746147193.043337:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463935744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.051788:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967463935744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8442us (9126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.051800:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4706 00002000:00100000:3.0:1746147193.051812:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009f369500 x1830967463935744/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.051821:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369500 with x1830967463935744 ext(1048576->2097151) 00002000:00010000:3.0:1746147193.051827:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f369500 00000100:00100000:0.0:1746147193.058727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.058826:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463935872 00000100:00100000:3.0:1746147193.058835:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463935872 00000100:00100000:3.0:1746147193.058879:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12120 00000100:00100000:3.0:1746147193.058887:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29149:x1830967463935872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.058906:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.058925:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e766f expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.058978:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.058991:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.058993:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.058996:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.059026:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 15 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.059037:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.059048:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479616:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.059777:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.062624:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466479616:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.063659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.063724:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463936000 00000100:00100000:2.0:1746147193.063732:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463936000 00010000:00010000:3.0:1746147193.063754:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.063772:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ddc00, rc 0) 00002000:00100000:2.0:1746147193.063777:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2838527) req@ffff88009f36a300 x1830967463936000/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.063787:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36a300 with x1830967463936000 ext(2097152->2838527) 00010000:00010000:2.0:1746147193.063794:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 16 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.063806:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 16 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.063813:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f36a300 00000100:00100000:3.0:1746147193.063818:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:29149:x1830967463935872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4932us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.063826:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12120 00000100:00100000:2.0:1746147193.063841:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1608 00000100:00100000:2.0:1746147193.063848:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463936000:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147193.077076:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463936000:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13216us (13409us total) trans 21474840685 rc 0/0 00000100:00100000:2.0:1746147193.077090:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1608 00002000:00100000:2.0:1746147193.077102:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2838527) req@ffff88009f36a300 x1830967463936000/t21474840685(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.077111:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36a300 with x1830967463936000 ext(2097152->2838527) 00010000:00010000:2.0:1746147193.077123:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.077139:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.077145:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f36a300 00000100:00100000:0.0:1746147193.082509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.082618:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463936128 00000100:00100000:2.0:1746147193.082627:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463936128 00010000:00010000:2.0:1746147193.082665:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.083091:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6031 00000100:00100000:2.0:1746147193.083099:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463936128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.083113:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.083136:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.083147:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.083169:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7c02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2838527) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e761b expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.083389:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.083391:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.083399:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.083412:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.083445:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.083457:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466479744:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147193.084262:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.089078:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466479744:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147193.089095:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.089132:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463936128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6033us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.089141:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6031 00000100:00100000:0.0:1746147193.095899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.095974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.096797:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463936384 00000100:00100000:3.0:1746147193.096807:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463936384 00002000:00100000:3.0:1746147193.096853:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f368000 x1830967463936384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.096868:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368000 with x1830967463936384 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.096874:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368000 00000100:00100000:3.0:1746147193.096895:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463936640 00000100:00100000:3.0:1746147193.096898:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463936640 00002000:00100000:3.0:1746147193.096907:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f368700 x1830967463936640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.096913:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368700 with x1830967463936640 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.096915:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368700 00000100:00100000:1.0:1746147193.096927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.096928:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4707 00000100:00100000:3.0:1746147193.096934:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463936384:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.096985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.097007:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463936896 00000100:00100000:1.0:1746147193.097015:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463936896 00002000:00100000:1.0:1746147193.097050:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4670a80 x1830967463936896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.097060:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670a80 with x1830967463936896 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.097065:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4670a80 00000100:00100000:1.0:1746147193.097086:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463937152 00000100:00100000:1.0:1746147193.097088:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463937152 00002000:00100000:1.0:1746147193.097098:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4671500 x1830967463937152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.097105:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967463937152 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.097108:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:1.0:1746147193.097118:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4708 00000100:00100000:1.0:1746147193.097124:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463936640:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.097159:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4709 00000100:00100000:2.0:1746147193.097172:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4710 00000100:00100000:2.0:1746147193.097178:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967463937152:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.098078:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463936896:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.107246:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463937152:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10061us (10253us total) trans 0 rc 831488/831488 00000100:00100000:2.0:1746147193.107256:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4710 00002000:00100000:2.0:1746147193.107266:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a4671500 x1830967463937152/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.107279:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4671500 with x1830967463937152 ext(3145728->4194303) 00002000:00010000:2.0:1746147193.107284:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4671500 00000100:00100000:3.0:1746147193.110546:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463936384:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13602us (14647us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.110565:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4707 00002000:00100000:3.0:1746147193.110577:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f368000 x1830967463936384/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.110586:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368000 with x1830967463936384 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.110592:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368000 00000100:00100000:2.0:1746147193.113895:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967463936896:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16721us (16966us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.113906:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4709 00002000:00100000:2.0:1746147193.113915:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a4670a80 x1830967463936896/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.113924:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4670a80 with x1830967463936896 ext(2097152->3145727) 00002000:00010000:2.0:1746147193.113929:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4670a80 00000100:00100000:1.0:1746147193.116149:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463936640:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19017us (20206us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.116158:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4708 00002000:00100000:1.0:1746147193.116166:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f368700 x1830967463936640/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.116175:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368700 with x1830967463936640 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.116179:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f368700 00000100:00100000:0.0:1746147193.125409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.125594:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463937408 00000100:00100000:1.0:1746147193.125602:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463937408 00002000:00100000:1.0:1746147193.125638:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009f369180 x1830967463937408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.125647:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369180 with x1830967463937408 ext(4194304->4947967) 00002000:00010000:1.0:1746147193.125652:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f369180 00000100:00100000:1.0:1746147193.125683:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4711 00000100:00100000:1.0:1746147193.125690:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463937408:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147193.137218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.137248:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463937664 00000100:00100000:1.0:1746147193.137256:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463937664 00000100:00100000:1.0:1746147193.137302:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10597 00000100:00100000:1.0:1746147193.137310:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29152:x1830967463937664:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147193.137329:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.137344:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7676 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.137425:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137436:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137446:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137460:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137465:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137470:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137585:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137594:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137600:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147193.137613:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147193.137683:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137689:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137694:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137699:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147193.137702:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137707:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137717:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147193.137720:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147193.137723:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137728:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217a00/0xb4b2209fbdac7c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137751:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137755:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137760:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137764:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147193.137766:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137770:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137776:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f200) 00010000:00010000:1.0:1746147193.137777:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147193.137779:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137784:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7c87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.137812:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.137824:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 26 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.137830:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147193.137832:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147193.137834:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e217600, rc 0) 00000100:00100000:1.0:1746147193.137881:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29152:x1830967463937664:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 571us (671us total) trans 8589944363 rc 0/0 00000100:00100000:1.0:1746147193.137888:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10597 00000100:00100000:1.0:1746147193.138155:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463937408:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12465us (12753us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746147193.138162:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4711 00002000:00100000:1.0:1746147193.138170:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009f369180 x1830967463937408/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.138178:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f369180 with x1830967463937408 ext(4194304->4947967) 00002000:00010000:1.0:1746147193.138182:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f369180 00000100:00100000:0.0:1746147193.178583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.179444:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463937920 00000100:00100000:1.0:1746147193.179454:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463937920 00000100:00100000:1.0:1746147193.179694:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10598 00000100:00100000:1.0:1746147193.179704:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:29155:x1830967463937920:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147193.179729:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.179747:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217000/0xb4b2209fbdac7c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e767d expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.179842:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.179858:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.179864:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 321 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.179869:0:14049:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.179875:0:14049:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.179906:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 25 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.179917:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 25 pid: 14049 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.179929:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466479872:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147193.181062:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 321 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.181072:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 321 pid: 14049 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.181081:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466480000:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147193.181366:0:14049:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 14 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.181375:0:14049:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 14 pid: 14125 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.181383:0:14049:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466480128:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147193.181403:0:14049:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.184349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.184625:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466479872:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.186929:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938048 00000100:00100000:3.0:1746147193.186949:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938048 00010000:00010000:3.0:1746147193.186986:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 26 pid: 14049 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.187021:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6032 00000100:00100000:3.0:1746147193.187029:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463938048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.187043:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.187048:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 26 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.187060:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 26 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.187081:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7c8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7676 expref: 26 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.187110:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.187114:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147193.187122:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:3.0:1746147193.187127:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.188225:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463938048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1193us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.188233:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6032 00000100:00100000:0.0:1746147193.190820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.190842:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466480000:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147193.190855:0:14049:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14049:1830967466480128:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.190871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1746147193.190883:0:14049:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000100:00100000:3.0:1746147193.190893:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938304 00000100:00100000:0.0:1746147193.190893:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938176 00000100:00100000:3.0:1746147193.190899:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938304 00000100:00100000:0.0:1746147193.190899:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938176 00000100:00080000:1.0:1746147193.190927:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147193.190927:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 322 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.190928:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 15 pid: 14125 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.191811:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6033 00000100:00100000:0.0:1746147193.191820:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6034 00000100:00100000:2.0:1746147193.191821:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463938304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147193.191825:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+322:1959:x1830967463938176:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.191836:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.191836:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.191842:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 15 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.191842:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 322 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.191852:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 322 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.191861:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 15 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.191885:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b172c00/0xb4b2209fbdac7c1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7629 expref: 322 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.191889:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7b8b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ab expref: 15 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.191901:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147193.191905:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147193.191920:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:2.0:1746147193.191926:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.191934:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147193.191951:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147193.191958:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.191988:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463938304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 169us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.191988:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1959:x1830967463938176:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 162us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.191994:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6033 00000100:00100000:0.0:1746147193.191996:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6034 00010000:00010000:1.0:1746147193.192378:0:14049:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.192387:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147193.192407:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147193.192539:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217000/0xb4b2209fbdac7c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 322 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.192570:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 321 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.192577:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147193.192580:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147193.192583:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e216a00, rc 0) 00000100:00100000:1.0:1746147193.192886:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+321:29155:x1830967463937920:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12991us (14122us total) trans 8589944364 rc 0/0 00000100:00100000:1.0:1746147193.192892:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10598 00000100:00100000:0.0:1746147193.223681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.223757:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938560 00000100:00100000:1.0:1746147193.223769:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938560 00000100:00100000:1.0:1746147193.223837:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10599 00000100:00100000:1.0:1746147193.223846:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29159:x1830967463938560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147193.223878:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.223899:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7cb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7684 expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.224045:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224060:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224071:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224082:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224087:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224092:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224265:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216800/0xb4b2209fbdac7cc6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224279:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216800/0xb4b2209fbdac7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224288:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216800/0xb4b2209fbdac7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:1.0:1746147193.224300:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:1.0:1746147193.224426:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224432:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224438:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224443:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e216000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147193.224446:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224451:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224460:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:1.0:1746147193.224463:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147193.224465:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224470:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216000/0xb4b2209fbdac7cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224599:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224608:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224612:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224615:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e217400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:1.0:1746147193.224617:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224621:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224626:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f98f900) 00010000:00010000:1.0:1746147193.224628:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147193.224629:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224633:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217400/0xb4b2209fbdac7cbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:1.0:1746147193.224668:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e217600/0xb4b2209fbdac7cb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7684 expref: 28 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.224678:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216800/0xb4b2209fbdac7cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7684 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.224684:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147193.224686:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147193.224688:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e216800, rc 0) 00000100:00100000:1.0:1746147193.224994:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29159:x1830967463938560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1149us (1323us total) trans 8589944365 rc 0/0 00000100:00100000:1.0:1746147193.225002:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10599 00000100:00100000:0.0:1746147193.232810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.232906:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938688 00000100:00100000:2.0:1746147193.232917:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938688 00000100:00100000:2.0:1746147193.232996:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 598 00000100:00100000:2.0:1746147193.233031:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463938688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.233046:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.233069:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216800/0xb4b2209fbdac7cc6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7684 expref: 27 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.233097:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147193.233101:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.233141:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463938688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.233147:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 598 00000100:00100000:2.0:1746147193.233553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.234043:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938816 00000100:00100000:3.0:1746147193.234048:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938816 00000100:00100000:3.0:1746147193.234386:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12121 00000100:00100000:3.0:1746147193.234392:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463938816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.234408:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.234422:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e768b expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.234440:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.234442:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.234450:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.234463:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 18 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.234472:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d65e00, rc 0) 00000100:00100000:3.0:1746147193.234510:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463938816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 118us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.234516:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12121 00000100:00100000:2.0:1746147193.236724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.236751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.236800:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463938944 00000100:00100000:0.0:1746147193.236808:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463938944 00000100:00100000:0.0:1746147193.236849:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939072 00000100:00100000:0.0:1746147193.236851:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939072 00000100:00100000:0.0:1746147193.236877:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12122 00000100:00100000:0.0:1746147193.236883:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463938944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147193.236898:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.236913:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7692 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.236934:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.236952:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.236960:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 19 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.236973:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 19 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.236982:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dc800, rc 0) 00000100:00100000:0.0:1746147193.237016:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463938944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.237022:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12122 00000100:00100000:0.0:1746147193.237035:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12123 00000100:00100000:0.0:1746147193.237039:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463939072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147193.237046:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.237054:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd000/0xb4b2209fbdac7ce2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7699 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.237098:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466480256:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147193.237156:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f63c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746147193.237179:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1746147193.241435:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime: 1746147192 -> 1746147193 00002000:00010000:2.0:1746147193.241443:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime: 1746147192 -> 1746147193 00000100:00100000:2.0:1746147193.241467:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466480256:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147193.241505:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd000/0xb4b2209fbdac7ce2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7699 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.241520:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd000/0xb4b2209fbdac7ce2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7699 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.241538:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dd000, rc 0) 00000100:00100000:2.0:1746147193.241622:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:1956:x1830967463939072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4580us (4868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147193.241630:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12123 00000100:00100000:3.0:1746147193.255043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.255914:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939328 00000100:00100000:1.0:1746147193.255923:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939328 00002000:00100000:1.0:1746147193.255988:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8801312a6680 x1830967463939328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.256002:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967463939328 ext(1048576->2097151) 00002000:00010000:1.0:1746147193.256008:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6680 00000100:00100000:1.0:1746147193.256029:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4712 00000100:00100000:1.0:1746147193.256035:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463939328:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.273223:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463939328:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17176us (18179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.273237:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4712 00002000:00100000:1.0:1746147193.273250:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8801312a6680 x1830967463939328/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.273260:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312a6680 with x1830967463939328 ext(1048576->2097151) 00002000:00010000:1.0:1746147193.273267:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312a6680 00000100:00100000:0.0:1746147193.284002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.284046:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939584 00000100:00100000:1.0:1746147193.284056:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939584 00002000:00100000:1.0:1746147193.284112:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f36b480 x1830967463939584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.284123:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b480 with x1830967463939584 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.284128:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f36b480 00000100:00100000:1.0:1746147193.284161:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4713 00000100:00100000:1.0:1746147193.284169:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463939584:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.296374:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463939584:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12194us (12372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.296386:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4713 00002000:00100000:1.0:1746147193.296399:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f36b480 x1830967463939584/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.296409:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b480 with x1830967463939584 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.296415:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f36b480 00000100:00100000:0.0:1746147193.300553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.300692:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939712 00000100:00100000:2.0:1746147193.300702:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939712 00000100:00100000:0.0:1746147193.300744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.301046:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939840 00000100:00100000:2.0:1746147193.301049:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939840 00000100:00100000:2.0:1746147193.301068:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12124 00000100:00100000:2.0:1746147193.301077:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+12:29159:x1830967463939712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.301097:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.301114:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76a0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.301145:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.301146:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12125 00010000:00010000:2.0:1746147193.301153:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746147193.301155:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29152:x1830967463939840:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147193.301155:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.301159:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 13 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.301164:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.301175:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76a7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.301189:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.301192:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.301201:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 31 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.301203:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.301208:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.301210:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.301213:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2224128->3145727] (req 2224128->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.301214:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466480384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.301228:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.301236:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 680 lvb_type: 1 00000100:00100000:3.0:1746147193.301243:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466480512:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.301701:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147193.301783:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.301791:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 18 pid: 8481 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.301799:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466480640:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.301831:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.303424:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466480512:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.303430:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466480384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.303453:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 13 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.303467:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b800, rc 0) 00000100:00100000:2.0:1746147193.303509:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29159:x1830967463939712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2433us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.303516:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12124 00000100:00100000:0.0:1746147193.304511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.304794:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463939968 00000100:00100000:1.0:1746147193.304800:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463939968 00002000:00100000:1.0:1746147193.304842:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2674688->3747839) req@ffff88009f368a80 x1830967463939968/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.304851:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368a80 with x1830967463939968 ext(2674688->3747839) 00010000:00010000:1.0:1746147193.304858:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 32 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.304869:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 32 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.304875:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f368a80 00000100:00100000:1.0:1746147193.304909:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1609 00000100:00100000:1.0:1746147193.304916:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1959:x1830967463939968:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147193.305254:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466480640:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.305264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147193.305281:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2224128->3145727] (req 2224128->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 20 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.305281:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463940096 00000100:00100000:0.0:1746147193.305284:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463940096 00010000:00010000:3.0:1746147193.305294:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64400, rc 0) 00010000:00010000:0.0:1746147193.305302:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 21 pid: 4445 timeout: 680 lvb_type: 1 00000100:00100000:3.0:1746147193.305329:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+21:29152:x1830967463939840:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4176us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.305332:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6035 00000100:00100000:3.0:1746147193.305335:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12125 00000100:00100000:0.0:1746147193.305338:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463940096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.305347:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.305364:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 680 lvb_type: 1 00010000:00010000:0.0:1746147193.305373:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 680 lvb_type: 1 00010000:00010000:0.0:1746147193.305392:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac7cdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7692 expref: 20 pid: 4445 timeout: 680 lvb_type: 1 00010000:00010000:0.0:1746147193.305408:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.305428:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463940096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.305433:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6035 00000100:00100000:0.0:1746147193.309831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.309881:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463940224 00000100:00100000:2.0:1746147193.309893:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463940224 00010000:00010000:2.0:1746147193.309925:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.309981:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6036 00000100:00100000:2.0:1746147193.309989:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463940224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.310005:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.310023:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.310033:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.310053:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5ddc00/0xb4b2209fbdac7c72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e766f expref: 19 pid: 8481 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.310075:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.310077:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.310085:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.310093:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.310123:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.310136:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466480768:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147193.310203:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.311953:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1959:x1830967463939968:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7013us (7447us total) trans 17179873275 rc 0/0 00000100:00100000:1.0:1746147193.311966:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1609 00002000:00100000:1.0:1746147193.311982:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2674688->3747839) req@ffff88009f368a80 x1830967463939968/t17179873275(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.311992:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f368a80 with x1830967463939968 ext(2674688->3747839) 00010000:00010000:1.0:1746147193.312001:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.312015:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.312021:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f368a80 00000100:00100000:3.0:1746147193.313030:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466480768:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.313054:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.313084:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967463940224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3096us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.313092:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6036 00000100:00100000:2.0:1746147193.313488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.313626:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463940480 00000100:00100000:1.0:1746147193.313632:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463940480 00002000:00100000:1.0:1746147193.313663:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2224128->2228223) req@ffff8800936dd180 x1830967463940480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.313672:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830967463940480 ext(2224128->2228223) 00002000:00010000:1.0:1746147193.313675:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:1.0:1746147193.313697:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4714 00000100:00100000:1.0:1746147193.313703:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463940480:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147193.313838:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463940480:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 135us (351us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147193.313843:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4714 00002000:00100000:1.0:1746147193.313847:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2224128->2228223) req@ffff8800936dd180 x1830967463940480/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.313854:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830967463940480 ext(2224128->2228223) 00002000:00010000:1.0:1746147193.313857:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:0.0:1746147193.318732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.318798:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463940608 00000100:00100000:3.0:1746147193.318808:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463940608 00010000:00010000:3.0:1746147193.318849:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.319325:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6037 00000100:00100000:3.0:1746147193.319333:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463940608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.319347:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.319368:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.319380:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.319402:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b173600/0xb4b2209fbdac7c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3747839) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7637 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.319690:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.319692:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.319701:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.319708:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.319741:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 12 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.319752:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466480896:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147193.320495:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.322234:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466480896:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.322264:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.322321:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1958:x1830967463940608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2986us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.322333:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6037 00000100:00100000:0.0:1746147193.330639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.330680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.330715:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463940992 00000100:00100000:0.0:1746147193.330724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.330725:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463940992 00002000:00100000:2.0:1746147193.330771:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ee5fb80 x1830967463940992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147193.330778:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941120 00002000:00100000:2.0:1746147193.330781:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5fb80 with x1830967463940992 ext(2097152->3145727) 00000100:00100000:3.0:1746147193.330782:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941120 00002000:00010000:2.0:1746147193.330786:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5fb80 00002000:00100000:3.0:1746147193.330802:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ee5ed80 x1830967463941120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147193.330811:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941376 00000100:00100000:2.0:1746147193.330813:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941376 00002000:00100000:3.0:1746147193.330816:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967463941120 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.330819:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ed80 00002000:00100000:2.0:1746147193.330828:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ee5d880 x1830967463941376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147193.330834:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4715 00002000:00100000:2.0:1746147193.330835:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d880 with x1830967463941376 ext(3145728->4194303) 00002000:00010000:2.0:1746147193.330838:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5d880 00000100:00100000:3.0:1746147193.330841:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463940992:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147193.330857:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4716 00000100:00100000:3.0:1746147193.330862:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4717 00000100:00100000:2.0:1746147193.330863:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463941120:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.330866:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463941376:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.338840:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463941120:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 7965us (8147us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.338854:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4716 00002000:00100000:3.0:1746147193.338867:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ee5ed80 x1830967463941120/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.338877:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ed80 with x1830967463941120 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.338883:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ed80 00000100:00100000:3.0:1746147193.340185:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463941376:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9312us (9454us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.340193:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4717 00002000:00100000:3.0:1746147193.340201:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009ee5d880 x1830967463941376/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.340209:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d880 with x1830967463941376 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.340214:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5d880 00000100:00100000:2.0:1746147193.343127:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463940992:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 12277us (12490us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.343138:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4715 00002000:00100000:2.0:1746147193.343148:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009ee5fb80 x1830967463940992/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.343156:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5fb80 with x1830967463940992 ext(2097152->3145727) 00002000:00010000:2.0:1746147193.343164:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5fb80 00000100:00100000:0.0:1746147193.350395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.351355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.351447:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941504 00000100:00100000:3.0:1746147193.351458:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941504 00000100:00100000:2.0:1746147193.351472:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941632 00000100:00100000:2.0:1746147193.351483:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941632 00000100:00100000:3.0:1746147193.351509:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12126 00000100:00100000:3.0:1746147193.351517:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+13:29152:x1830967463941504:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147193.351538:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.351563:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76ae expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.351596:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.351603:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.351605:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.351609:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.351645:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.351659:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.351672:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466481024:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.351918:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.352274:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12127 00000100:00100000:2.0:1746147193.352283:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463941632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.352297:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.352313:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdac7cfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76b5 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.352340:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdac7cfe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76b5 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.352350:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4aa00/0xb4b2209fbdac7cfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76b5 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.352364:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4aa00, rc 0) 00000100:00100000:2.0:1746147193.352466:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463941632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 185us (1112us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147193.352472:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12127 00000100:00100000:3.0:1746147193.355837:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466481024:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.356018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.356044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147193.356084:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 14 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.356102:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d64800, rc 0) 00000100:00100000:1.0:1746147193.356117:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941760 00000100:00100000:1.0:1746147193.356123:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941760 00000100:00100000:3.0:1746147193.356151:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29152:x1830967463941504:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 4634us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.356155:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463941888 00000100:00100000:1.0:1746147193.356156:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463941888 00000100:00100000:3.0:1746147193.356158:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12126 00000100:00100000:1.0:1746147193.356169:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12128 00000100:00100000:1.0:1746147193.356174:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463941760:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147193.356182:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12129 00000100:00100000:3.0:1746147193.356187:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463941888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147193.356188:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.356196:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.356203:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129efec00/0xb4b2209fbdac7d05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76bc expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.356205:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7d0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76c3 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.356219:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.356225:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129efec00/0xb4b2209fbdac7d05 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76bc expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.356226:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7d0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76c3 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.356233:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129efec00/0xb4b2209fbdac7d05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76bc expref: 20 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.356234:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7d0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76c3 expref: 15 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.356244:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129efec00, rc 0) 00010000:00010000:3.0:1746147193.356247:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a47b1600, rc 0) 00000100:00100000:1.0:1746147193.356261:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463941760:12345-192.168.203.36@tcp:101:cat.0 Request processed in 87us (245us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.356265:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1957:x1830967463941888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 78us (220us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147193.356266:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12128 00000100:00100000:3.0:1746147193.356271:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12129 00000100:00100000:0.0:1746147193.357736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.357821:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942016 00000100:00100000:3.0:1746147193.357828:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942016 00010000:00010000:3.0:1746147193.357856:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.357879:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6038 00000100:00100000:3.0:1746147193.357885:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1958:x1830967463942016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.357900:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.357922:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.357933:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.358292:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4b800/0xb4b2209fbdac7ce9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a0 expref: 14 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.358307:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.358309:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.358316:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.358324:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.358354:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 13 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.358368:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466481152:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147193.358443:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.361340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.361373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.361447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.361636:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942144 00000100:00100000:1.0:1746147193.361646:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942144 00000100:00100000:1.0:1746147193.361688:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942272 00000100:00100000:1.0:1746147193.361689:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942272 00000100:00100000:1.0:1746147193.361706:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12130 00000100:00100000:1.0:1746147193.361713:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463942144:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147193.361732:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.361755:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129eff200/0xb4b2209fbdac7d13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76ca expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.361775:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12131 00000100:00100000:0.0:1746147193.361781:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463942272:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147193.361788:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.361797:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xb4b2209fbdac7d1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76d1 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.361849:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466481152:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.361870:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.361877:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942528 00000100:00100000:2.0:1746147193.361882:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942528 00002000:00100000:2.0:1746147193.361910:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2105344->2109439) req@ffff88009ee5f800 x1830967463942528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147193.361911:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463942016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4026us (4181us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147193.361919:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f800 with x1830967463942528 ext(2105344->2109439) 00000100:00100000:3.0:1746147193.361920:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6038 00002000:00010000:2.0:1746147193.361923:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f800 00000100:00100000:2.0:1746147193.361958:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4718 00000100:00100000:2.0:1746147193.361964:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463942528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.362127:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463942528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 163us (679us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147193.362133:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4718 00002000:00100000:2.0:1746147193.362138:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2105344->2109439) req@ffff88009ee5f800 x1830967463942528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.362151:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5f800 with x1830967463942528 ext(2105344->2109439) 00002000:00010000:2.0:1746147193.362153:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5f800 00010000:00010000:1.0:1746147193.362185:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129eff200/0xb4b2209fbdac7d13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ca expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.362195:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129eff200/0xb4b2209fbdac7d13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ca expref: 20 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.362205:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129eff200, rc 0) 00000100:00100000:1.0:1746147193.362224:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967463942144:12345-192.168.203.36@tcp:101:cat.0 Request processed in 512us (895us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147193.362229:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12130 00000100:00100000:1.0:1746147193.362594:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481280:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147193.362672:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.365651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.365815:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942784 00000100:00100000:3.0:1746147193.365823:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942784 00000100:00100000:3.0:1746147193.365871:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4221 00000100:00100000:3.0:1746147193.365880:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29152:x1830967463942784:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147193.366161:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29152:x1830967463942784:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 282us (519us total) trans 8589944366 rc 0/0 00000100:00100000:3.0:1746147193.366168:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4221 00002000:00010000:0.0:1746147193.367781:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147192 -> 1746147193 00000100:00100000:0.0:1746147193.367803:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481280:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147193.367832:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xb4b2209fbdac7d1a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d1 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.367850:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xb4b2209fbdac7d1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d1 expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.367871:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344000, rc 0) 00000100:00100000:0.0:1746147193.368382:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1956:x1830967463942272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6598us (7004us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.368390:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12131 00000100:00100000:1.0:1746147193.368677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.368791:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463942912 00000100:00100000:0.0:1746147193.368797:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463942912 00000100:00100000:0.0:1746147193.368834:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12132 00000100:00100000:0.0:1746147193.368841:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+33:29165:x1830967463942912:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147193.368857:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.368870:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76d8 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.368892:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.368899:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147193.368901:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147193.368905:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3194880->3645439] (req 3194880->3645439) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.368931:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 12 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.368968:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 12 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.368979:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481408:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.369040:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.371284:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481408:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.371315:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [3194880->3645439] (req 3194880->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 34 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.371329:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344200, rc 0) 00000100:00100000:2.0:1746147193.371377:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+34:29165:x1830967463942912:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2535us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.371384:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12132 00000100:00100000:1.0:1746147193.372106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.372149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.372159:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463943040 00000100:00100000:3.0:1746147193.372167:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463943040 00002000:00100000:3.0:1746147193.372201:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2109439) req@ffff88012ba58e00 x1830967463943040/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 12776/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.372212:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58e00 with x1830967463943040 ext(2097152->2109439) 00010000:00010000:3.0:1746147193.372219:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 13 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.372232:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 13 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:3.0:1746147193.372238:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba58e00 00000100:00100000:3.0:1746147193.372252:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1610 00000100:00100000:3.0:1746147193.372258:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+13:1957:x1830967463943040:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147193.372347:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463943296 00000100:00100000:0.0:1746147193.372351:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463943296 00000100:00100000:0.0:1746147193.372381:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4222 00000100:00100000:0.0:1746147193.372387:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:29159:x1830967463943296:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147193.372527:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29159:x1830967463943296:12345-192.168.203.36@tcp:35:cat.0 Request processed in 139us (376us total) trans 8589944367 rc 0/0 00000100:00100000:0.0:1746147193.372533:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4222 00000100:00100000:3.0:1746147193.372663:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463943040:12345-192.168.203.36@tcp:4:cat.0 Request processed in 404us (558us total) trans 17179873276 rc 0/0 00000100:00100000:3.0:1746147193.372673:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1610 00002000:00100000:3.0:1746147193.372678:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->2109439) req@ffff88012ba58e00 x1830967463943040/t17179873276(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 12776/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.372685:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58e00 with x1830967463943040 ext(2097152->2109439) 00010000:00010000:3.0:1746147193.372690:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.372699:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:3.0:1746147193.372705:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba58e00 00000100:00100000:1.0:1746147193.375799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.376662:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463943424 00000100:00100000:3.0:1746147193.376674:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463943424 00010000:00010000:3.0:1746147193.376714:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.378611:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6039 00000100:00100000:3.0:1746147193.378630:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463943424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.378650:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.378677:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.378691:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.378726:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d64800/0xb4b2209fbdac7cf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ae expref: 15 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.378744:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.378745:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.378754:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.378762:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.378796:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.378808:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466481536:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147193.378913:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.380718:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466481536:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.380740:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.380790:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463943424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2167us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.380800:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6039 00000100:00100000:0.0:1746147193.382213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.382656:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463943680 00000100:00100000:3.0:1746147193.382664:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463943680 00002000:00100000:3.0:1746147193.382705:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3194880->3198975) req@ffff88008daad880 x1830967463943680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.382721:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463943680 ext(3194880->3198975) 00002000:00010000:3.0:1746147193.382726:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:3.0:1746147193.382758:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4719 00000100:00100000:3.0:1746147193.382765:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463943680:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.382965:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463943680:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 198us (755us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147193.382970:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4719 00002000:00100000:3.0:1746147193.382976:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3194880->3198975) req@ffff88008daad880 x1830967463943680/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.382983:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daad880 with x1830967463943680 ext(3194880->3198975) 00002000:00010000:3.0:1746147193.382985:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daad880 00000100:00100000:0.0:1746147193.390524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.391884:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463943936 00000100:00100000:2.0:1746147193.391896:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463943936 00002000:00100000:2.0:1746147193.391977:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3641344->3645439) req@ffff88008daae300 x1830967463943936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.391988:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae300 with x1830967463943936 ext(3641344->3645439) 00002000:00010000:2.0:1746147193.391994:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daae300 00000100:00100000:2.0:1746147193.392061:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4720 00000100:00100000:2.0:1746147193.392070:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463943936:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147193.392246:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1957:x1830967463943936:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 176us (1737us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147193.392252:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4720 00002000:00100000:2.0:1746147193.392258:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3641344->3645439) req@ffff88008daae300 x1830967463943936/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.392270:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae300 with x1830967463943936 ext(3641344->3645439) 00002000:00010000:2.0:1746147193.392273:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daae300 00000100:00100000:0.0:1746147193.406364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.407095:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944064 00000100:00100000:2.0:1746147193.407105:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944064 00000100:00100000:2.0:1746147193.407161:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12133 00000100:00100000:2.0:1746147193.407171:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463944064:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.407191:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.407208:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7d28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76df expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.407240:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7d28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76df expref: 19 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.407250:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4ae00/0xb4b2209fbdac7d28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76df expref: 19 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.407274:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4ae00, rc 0) 00000100:00100000:2.0:1746147193.407333:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1959:x1830967463944064:12345-192.168.203.36@tcp:101:cat.0 Request processed in 164us (979us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147193.407339:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12133 00000100:00100000:0.0:1746147193.432452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.432748:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944192 00000100:00100000:2.0:1746147193.432758:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944192 00000100:00100000:2.0:1746147193.432818:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12134 00000100:00100000:2.0:1746147193.432827:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29171:x1830967463944192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.432847:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.432867:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76e6 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.432899:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.432907:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.432908:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.432912:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.432982:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.432995:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 18 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.433007:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466481664:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.433100:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.443605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.443993:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466481664:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.444023:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.444039:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa4b600, rc 0) 00000100:00100000:2.0:1746147193.444997:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:29171:x1830967463944192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 12166us (12550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.445007:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12134 00000100:00100000:3.0:1746147193.445279:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944320 00000100:00100000:3.0:1746147193.445287:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944320 00002000:00100000:3.0:1746147193.445331:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2224128->3145727) req@ffff88008daac700 x1830967463944320/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.445341:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac700 with x1830967463944320 ext(2224128->3145727) 00010000:00010000:3.0:1746147193.445349:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 19 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.445363:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 19 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:3.0:1746147193.445370:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daac700 00000100:00100000:3.0:1746147193.445394:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1611 00000100:00100000:3.0:1746147193.445402:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463944320:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147193.475754:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463944320:12345-192.168.203.36@tcp:4:cat.0 Request processed in 30340us (32149us total) trans 21474840686 rc 0/0 00000100:00100000:2.0:1746147193.475768:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1611 00002000:00100000:2.0:1746147193.475782:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2224128->3145727) req@ffff88008daac700 x1830967463944320/t21474840686(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.475793:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac700 with x1830967463944320 ext(2224128->3145727) 00010000:00010000:2.0:1746147193.475804:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.475821:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.475829:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008daac700 00000100:00100000:0.0:1746147193.478831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.479596:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944448 00000100:00100000:3.0:1746147193.479606:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944448 00010000:00010000:3.0:1746147193.479646:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.479676:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6040 00000100:00100000:3.0:1746147193.479683:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463944448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.479697:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147193.479715:0:7121:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147192 -> 1746147193 00002000:00010000:3.0:1746147193.479717:0:7121:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147192 -> 1746147193 00010000:00010000:3.0:1746147193.479722:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.479734:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.479757:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d64400/0xb4b2209fbdac7cf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2224128->4194303] (req 2224128->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76a7 expref: 21 pid: 6881 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.479792:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.479794:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.479802:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.479810:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.479851:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.479865:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466481792:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147193.481650:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.487487:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466481792:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.487568:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.488180:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5802050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1958:x1830967463944448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8493us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.488192:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6040 00000100:00100000:1.0:1746147193.501993:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.502015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.502029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.502064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.502102:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944960 00000100:00100000:1.0:1746147193.502111:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944960 00002000:00100000:1.0:1746147193.502159:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012ba58700 x1830967463944960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.502175:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58700 with x1830967463944960 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.502181:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58700 00000100:00100000:1.0:1746147193.502197:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463944832 00000100:00100000:1.0:1746147193.502199:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463944832 00002000:00100000:1.0:1746147193.502209:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ba58000 x1830967463944832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.502215:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58000 with x1830967463944832 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.502217:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58000 00000100:00100000:1.0:1746147193.502225:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463945216 00000100:00100000:1.0:1746147193.502227:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463945216 00002000:00100000:1.0:1746147193.502236:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba5aa00 x1830967463945216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.502242:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5aa00 with x1830967463945216 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.502246:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5aa00 00000100:00100000:1.0:1746147193.502254:0:21470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463945344 00000100:00100000:1.0:1746147193.502255:0:21470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463945344 00002000:00100000:1.0:1746147193.502265:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ba58a80 x1830967463945344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.502271:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58a80 with x1830967463945344 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.502273:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58a80 00000100:00100000:1.0:1746147193.502283:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4721 00000100:00100000:1.0:1746147193.502290:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1958:x1830967463944960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.503077:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4722 00000100:00100000:1.0:1746147193.503084:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463944832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.504365:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4723 00000100:00100000:1.0:1746147193.504372:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463945216:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147193.505285:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4724 00000100:00100000:0.0:1746147193.505295:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463945344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.507856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.509835:0:14049:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463945728 00000100:00100000:0.0:1746147193.509848:0:14049:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463945728 00000100:00100000:0.0:1746147193.509905:0:14049:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10600 00000100:00100000:0.0:1746147193.509913:0:14049:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29173:x1830967463945728:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147193.509953:0:14049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.509971:0:14049:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7d36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76ed expref: -99 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.510070:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510081:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510091:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510101:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510105:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510110:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510197:0:14049:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac7d4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510204:0:14049:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac7d4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510208:0:14049:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac7d4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14049 initiator: MDT0 00000004:00200000:0.0:1746147193.510215:0:14049:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147193.510285:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510294:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510300:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510305:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092904a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147193.510308:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510314:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510323:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147193.510326:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.510330:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510335:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904a00/0xb4b2209fbdac7d3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510351:0:14049:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510356:0:14049:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510361:0:14049:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510364:0:14049:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092904e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147193.510366:0:14049:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510373:0:14049:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510378:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db13d00) 00010000:00010000:0.0:1746147193.510379:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.510381:0:14049:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510385:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904e00/0xb4b2209fbdac7d44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14049 initiator: MDT0 00010000:00010000:0.0:1746147193.510414:0:14049:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7d36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ed expref: 31 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.510423:0:14049:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac7d4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ed expref: 30 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.510428:0:14049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147193.510430:0:14049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147193.510432:0:14049:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905400, rc 0) 00000100:00100000:0.0:1746147193.510477:0:14049:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29173:x1830967463945728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 566us (2629us total) trans 8589944368 rc 0/0 00000100:00100000:0.0:1746147193.510483:0:14049:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10600 00000100:00100000:1.0:1746147193.519609:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1958:x1830967463944960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17308us (17614us total) trans 0 rc 598016/598016 00000100:00100000:1.0:1746147193.519623:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4721 00002000:00100000:1.0:1746147193.519635:0:21470:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88012ba58700 x1830967463944960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 504/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 598016/598016 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.519645:0:21470:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58700 with x1830967463944960 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.519651:0:21470:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58700 00000100:00100000:1.0:1746147193.524357:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1958:x1830967463944832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21260us (22327us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.524371:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4722 00002000:00100000:1.0:1746147193.524384:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88012ba58000 x1830967463944832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.524395:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58000 with x1830967463944832 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.524401:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba58000 00000100:00100000:0.0:1746147193.525392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.525468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.525710:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463945984 00000100:00100000:3.0:1746147193.525720:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463945984 00000100:00100000:3.0:1746147193.525760:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10601 00000100:00100000:3.0:1746147193.525768:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29176:x1830967463945984:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.525792:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.525809:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558800/0xb4b2209fbdac7d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76f4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.525915:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.525928:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.525969:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.525986:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.525991:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.525996:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:2.0:1746147193.526033:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463946112 00000100:00100000:2.0:1746147193.526037:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463946112 00000100:00100000:2.0:1746147193.526067:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 599 00000100:00100000:2.0:1746147193.526073:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967463946112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.526081:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.526097:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092905400/0xb4b2209fbdac7d4b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76ed expref: 32 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.526104:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7d6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526112:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7d6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526118:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7d6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147193.526123:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000004:00200000:3.0:1746147193.526126:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147193.526128:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.526165:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463946112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.526176:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 599 00010000:00010000:3.0:1746147193.526207:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526213:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526219:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526225:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6558200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.526228:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526234:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526242:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147193.526245:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.526248:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526253:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558200/0xb4b2209fbdac7d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526265:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526270:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526274:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526278:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6558600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.526280:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526285:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526291:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76e00) 00010000:00010000:3.0:1746147193.526293:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.526296:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526300:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.526331:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6558800/0xb4b2209fbdac7d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76f4 expref: 32 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.526342:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7d6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76f4 expref: 31 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.526348:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.526351:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147193.526353:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6559a00, rc 0) 00000100:00100000:3.0:1746147193.526375:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29176:x1830967463945984:12345-192.168.203.36@tcp:101:cat.0 Request processed in 608us (989us total) trans 8589944369 rc 0/0 00000100:00100000:3.0:1746147193.526381:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10601 00000100:00100000:1.0:1746147193.526833:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463945344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21540us (24767us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.526841:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4724 00002000:00100000:1.0:1746147193.526849:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88012ba58a80 x1830967463945344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.526858:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba58a80 with x1830967463945344 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.526862:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba58a80 00000100:00100000:1.0:1746147193.529511:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463945216:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25130us (27470us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.529522:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4723 00002000:00100000:1.0:1746147193.529534:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88012ba5aa00 x1830967463945216/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.529543:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba5aa00 with x1830967463945216 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.529549:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba5aa00 00000100:00100000:0.0:1746147193.531759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.531802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.531847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.531889:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463946496 00000100:00100000:0.0:1746147193.531898:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463946496 00000100:00100000:0.0:1746147193.531997:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 600 00000100:00100000:0.0:1746147193.532007:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967463946496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.532023:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147193.532035:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463946240 00000100:00100000:2.0:1746147193.532044:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463946240 00010000:00010000:0.0:1746147193.532050:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6559a00/0xb4b2209fbdac7d6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76f4 expref: 31 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.532071:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147193.532076:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.532086:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463946368 00000100:00100000:2.0:1746147193.532088:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463946368 00000100:00100000:2.0:1746147193.532107:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12135 00000100:00100000:0.0:1746147193.532114:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463946496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.532115:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967463946240:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147193.532121:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 600 00010000:00010000:2.0:1746147193.532130:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.532144:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e76fb expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.532163:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.532164:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.532172:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.532185:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.532193:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569400, rc 0) 00000100:00100000:2.0:1746147193.532235:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463946240:12345-192.168.203.36@tcp:101:cat.0 Request processed in 121us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.532241:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12135 00000100:00100000:2.0:1746147193.532255:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12136 00000100:00100000:2.0:1746147193.532259:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463946368:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.532267:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.532275:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f569600/0xb4b2209fbdac7d83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7702 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.532310:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481920:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147193.532368:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.536422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.540695:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463946752 00000100:00100000:1.0:1746147193.540710:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463946752 00002000:00100000:1.0:1746147193.540760:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff880134d00e00 x1830967463946752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.540770:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00e00 with x1830967463946752 ext(4194304->4947967) 00002000:00010000:1.0:1746147193.540776:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00e00 00000100:00100000:1.0:1746147193.540807:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4725 00000100:00100000:1.0:1746147193.540815:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463946752:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.542648:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466481920:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147193.542683:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f569600/0xb4b2209fbdac7d83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7702 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.542697:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f569600/0xb4b2209fbdac7d83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7702 expref: 15 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.542708:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569600, rc 0) 00000100:00100000:3.0:1746147193.542751:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1956:x1830967463946368:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10490us (10948us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.542759:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12136 00000100:00100000:1.0:1746147193.547543:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1959:x1830967463946752:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6717us (11120us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746147193.547568:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4725 00002000:00100000:1.0:1746147193.547580:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff880134d00e00 x1830967463946752/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.547590:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00e00 with x1830967463946752 ext(4194304->4947967) 00002000:00010000:1.0:1746147193.547597:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00e00 00000100:00100000:0.0:1746147193.566126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.566564:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947008 00000100:00100000:1.0:1746147193.566574:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947008 00002000:00100000:1.0:1746147193.566622:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008daac380 x1830967463947008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.566634:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac380 with x1830967463947008 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.566639:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac380 00000100:00100000:1.0:1746147193.566674:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4726 00000100:00100000:1.0:1746147193.566681:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463947008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.579209:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967463947008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12513us (13078us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.579224:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4726 00002000:00100000:1.0:1746147193.579449:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008daac380 x1830967463947008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.579460:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daac380 with x1830967463947008 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.579466:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daac380 00000100:00100000:0.0:1746147193.591885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.591985:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947136 00000100:00100000:3.0:1746147193.591997:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947136 00000100:00100000:3.0:1746147193.592058:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12137 00000100:00100000:3.0:1746147193.592067:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+14:29176:x1830967463947136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.592085:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.592104:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7709 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.592134:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.592141:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.592143:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.592147:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.592177:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.592189:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 33 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.592201:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466482048:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.593182:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.596446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.596525:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947264 00000100:00100000:1.0:1746147193.596533:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947264 00002000:00100000:1.0:1746147193.596579:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3194880->3645439) req@ffff88008daae680 x1830967463947264/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.596588:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae680 with x1830967463947264 ext(3194880->3645439) 00010000:00010000:1.0:1746147193.596596:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.596748:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 34 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.596755:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008daae680 00000100:00100000:1.0:1746147193.596773:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1612 00000100:00100000:1.0:1746147193.596780:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+34:1956:x1830967463947264:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147193.596996:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466482048:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.597027:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.597043:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6558600, rc 0) 00000100:00100000:2.0:1746147193.597913:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29176:x1830967463947136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5844us (6034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.597923:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12137 00000100:00100000:1.0:1746147193.615175:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1956:x1830967463947264:12345-192.168.203.36@tcp:4:cat.0 Request processed in 18388us (18729us total) trans 17179873277 rc 0/0 00000100:00100000:1.0:1746147193.615186:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1612 00002000:00100000:1.0:1746147193.615195:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3194880->3645439) req@ffff88008daae680 x1830967463947264/t17179873277(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.615204:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daae680 with x1830967463947264 ext(3194880->3645439) 00010000:00010000:1.0:1746147193.615213:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.615226:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.615232:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008daae680 00000100:00100000:0.0:1746147193.633421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.633692:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947392 00000100:00100000:3.0:1746147193.633703:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947392 00010000:00010000:3.0:1746147193.633733:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.633761:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6041 00000100:00100000:3.0:1746147193.633767:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463947392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.633777:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.633796:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.633806:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.633824:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344200/0xb4b2209fbdac7d21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3645439) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76d8 expref: 36 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.635195:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.635198:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.635205:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.635213:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.635241:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.635251:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466482176:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147193.635693:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.638352:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466482176:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147193.638369:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.638402:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463947392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4635us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.638410:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6041 00000100:00100000:0.0:1746147193.644260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.645777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.645809:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947648 00000100:00100000:1.0:1746147193.645820:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947648 00002000:00100000:1.0:1746147193.645867:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daafb80 x1830967463947648/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.645877:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daafb80 with x1830967463947648 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.645883:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daafb80 00000100:00100000:0.0:1746147193.646252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.646272:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463947904 00000100:00100000:1.0:1746147193.646275:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463947904 00002000:00100000:1.0:1746147193.646288:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008daaf100 x1830967463947904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.646301:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf100 with x1830967463947904 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.646304:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daaf100 00000100:00100000:1.0:1746147193.646318:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4727 00000100:00100000:1.0:1746147193.646325:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1958:x1830967463947648:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.647897:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4728 00000100:00100000:1.0:1746147193.647909:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463947904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.650297:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948160 00000100:00100000:2.0:1746147193.650310:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948160 00002000:00100000:2.0:1746147193.650356:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008daaf480 x1830967463948160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.650366:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf480 with x1830967463948160 ext(3145728->4194303) 00002000:00010000:2.0:1746147193.650371:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf480 00000100:00100000:2.0:1746147193.650393:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4729 00000100:00100000:2.0:1746147193.650399:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463948160:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.656788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.656828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.656869:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948416 00000100:00100000:2.0:1746147193.656928:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948288 00000100:00100000:2.0:1746147193.656948:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948288 00000100:00100000:2.0:1746147193.656995:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12138 00000100:00100000:2.0:1746147193.657003:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29173:x1830967463948288:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147193.657022:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.657040:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7710 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657069:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657079:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.657086:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657092:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.657094:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.657097:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [724992->1048575] (req 724992->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 24 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657129:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657142:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 18 pid: 21080 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.657154:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482304:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147193.657498:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948416 00000100:00100000:1.0:1746147193.657525:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12139 00000100:00100000:1.0:1746147193.657529:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:29179:x1830967463948416:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147193.657537:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147193.657549:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7717 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.657578:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.657585:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.657591:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.657596:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.657598:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.657600:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1122304->1609727] (req 1122304->1609727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.657615:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 9 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.657622:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 9 pid: 21080 timeout: 680 lvb_type: 1 00000100:00100000:1.0:1746147193.657629:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482432:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.657886:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 10 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.657895:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 10 pid: 8481 timeout: 680 lvb_type: 1 00000100:00100000:2.0:1746147193.657903:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482560:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147193.657907:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.657914:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 680 lvb_type: 1 00000100:00100000:1.0:1746147193.657921:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482688:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.657929:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.657951:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 24 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.657957:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.657959:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482816:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147193.657964:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 18 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.657971:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482944:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.657983:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.657983:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.662743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.664799:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948544 00000100:00100000:3.0:1746147193.664809:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948544 00000100:00100000:3.0:1746147193.666308:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10602 00000100:00100000:3.0:1746147193.666318:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:29180:x1830967463948544:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147193.667634:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.667652:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e771e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.667707:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667717:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667724:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667734:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667738:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667743:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667821:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667831:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.667836:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.667863:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 320 pid: 14049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.667871:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 320 pid: 14049 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.667878:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967463947904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19971us (22103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.667881:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466483072:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147193.667887:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4728 00002000:00100000:1.0:1746147193.667895:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88008daaf100 x1830967463947904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.667902:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf100 with x1830967463947904 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.667906:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daaf100 00000100:00100000:3.0:1746147193.667921:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.667986:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482304:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147193.668550:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1958:x1830967463947648:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22224us (24297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147193.668568:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4727 00002000:00100000:0.0:1746147193.668575:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88008daafb80 x1830967463947648/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.668582:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daafb80 with x1830967463947648 ext(2097152->3145727) 00002000:00010000:0.0:1746147193.668586:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008daafb80 00000100:00100000:1.0:1746147193.669087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.669231:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482432:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.669241:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482688:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.669248:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466482944:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.669279:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1122304->1609727] (req 1122304->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 36 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.669292:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea35e00, rc 0) 00000100:00100000:2.0:1746147193.669316:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:29179:x1830967463948416:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 11785us (12540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.669322:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12139 00000100:00100000:1.0:1746147193.669574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.669589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.669603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.669616:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948928 00000100:00100000:1.0:1746147193.669620:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948928 00010000:00010000:1.0:1746147193.669640:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 25 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.669657:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948800 00000100:00100000:1.0:1746147193.669659:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948800 00000100:00100000:3.0:1746147193.669860:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463948672 00000100:00100000:3.0:1746147193.669864:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463948672 00000100:00100000:2.0:1746147193.670000:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949056 00000100:00100000:2.0:1746147193.670003:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949056 00010000:00010000:2.0:1746147193.670019:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.670258:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 680 lvb_type: 1 00000100:00100000:2.0:1746147193.670323:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6042 00000100:00100000:2.0:1746147193.670332:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463948928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.670443:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.670464:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 25 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670466:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6043 00010000:00010000:2.0:1746147193.670474:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 25 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670474:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1959:x1830967463949056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.670483:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.670491:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147193.670495:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 680 lvb_type: 1 00010000:00010000:0.0:1746147193.670504:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 680 lvb_type: 1 00000100:00100000:2.0:1746147193.670517:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463948928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 186us (1434us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147193.670517:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a310800/0xb4b2209fbdac7ba7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75c7 expref: 36 pid: 4445 timeout: 680 lvb_type: 1 00000100:00100000:2.0:1746147193.670522:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6042 00010000:00010000:0.0:1746147193.670532:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.670549:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1959:x1830967463949056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.670565:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6043 00000100:00100000:2.0:1746147193.670570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.670576:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949184 00000100:00100000:0.0:1746147193.670579:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949184 00010000:00010000:0.0:1746147193.670589:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 19 pid: 21080 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670612:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6044 00000100:00100000:0.0:1746147193.670617:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463949184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147193.670622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147193.670623:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147193.670632:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949312 00010000:00010000:0.0:1746147193.670632:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 19 pid: 21080 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.670635:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949312 00010000:00010000:0.0:1746147193.670641:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 19 pid: 21080 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.670647:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 15 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.670652:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f864e00/0xb4b2209fbdac794d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e744d expref: 19 pid: 21080 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.670659:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6045 00010000:00010000:0.0:1746147193.670660:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.670663:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463949312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.670669:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.670676:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 15 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670682:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463949184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (112us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147193.670684:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 15 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670687:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6044 00010000:00010000:2.0:1746147193.670701:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e33200/0xb4b2209fbdac7aea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7550 expref: 15 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.670713:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.670727:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463949312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.670732:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6045 00000100:00100000:0.0:1746147193.670733:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482560:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147193.670743:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f865e00/0xb4b2209fbdac7946 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7446 expref: 24 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.670758:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466482816:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147193.670776:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [724992->1048575] (req 724992->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.670784:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568c00, rc 0) 00000100:00100000:0.0:1746147193.670804:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29173:x1830967463948288:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 13802us (13975us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.670809:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12138 00000100:00100000:1.0:1746147193.671102:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6046 00000100:00100000:1.0:1746147193.671108:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463948800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147193.671115:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.671123:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671131:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671142:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930f3800/0xb4b2209fbdac7b3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7573 expref: 10 pid: 21080 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671154:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.671155:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.671160:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 34 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.671167:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 34 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.671190:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 34 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.671199:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466483200:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147193.671236:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cb40 going to sleep for 11 seconds 00000100:00080000:1.0:1746147193.671256:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147193.671258:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147193.671275:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466483072:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147193.671286:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:1.0:1746147193.671304:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 680 lvb_type: 1 00000100:00100000:1.0:1746147193.671320:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6047 00000100:00100000:1.0:1746147193.671324:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463948672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147193.671330:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.671337:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671343:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671352:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e32200/0xb4b2209fbdac7b37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e756c expref: 11 pid: 8481 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.671360:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.671361:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.671364:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.671370:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.671385:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.671392:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466483328:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147193.671410:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.673091:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463948160:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22688us (26835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.673106:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4729 00002000:00100000:2.0:1746147193.673114:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008daaf480 x1830967463948160/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.673121:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008daaf480 with x1830967463948160 ext(3145728->4194303) 00002000:00010000:2.0:1746147193.673126:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008daaf480 00000100:00100000:0.0:1746147193.673853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.673989:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466483200:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147193.674001:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.674022:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+9:1957:x1830967463948800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2913us (4448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.674028:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6046 00000100:00100000:0.0:1746147193.674042:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949440 00000100:00100000:0.0:1746147193.674046:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949440 00010000:00010000:0.0:1746147193.674064:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 321 pid: 14049 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.674080:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6048 00000100:00100000:0.0:1746147193.674086:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+321:1956:x1830967463949440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.674095:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.674101:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 321 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.674110:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 321 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.674126:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e216a00/0xb4b2209fbdac7ca3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e767d expref: 321 pid: 14049 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.674137:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147193.674142:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674150:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674156:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674172:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.674185:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+320:1956:x1830967463949440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.674191:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6048 00010000:00010000:0.0:1746147193.674213:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674219:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:0.0:1746147193.674251:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:0.0:1746147193.674254:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147193.674267:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674275:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674284:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674289:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674294:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674300:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4678200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147193.674302:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674308:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674316:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147193.674318:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.674321:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674325:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7da6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674335:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674340:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674344:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674348:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2e3000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147193.674350:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674354:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674366:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76400) 00010000:00010000:0.0:1746147193.674368:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.674371:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674375:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7dad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147193.674401:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.674410:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466483328:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147193.674412:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 15 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.674419:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147193.674420:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147193.674421:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147193.674423:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2e2200, rc 0) 00000100:00100000:1.0:1746147193.674437:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463948672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3112us (4847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.674442:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6047 00000100:00100000:0.0:1746147193.674446:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:29180:x1830967463948544:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 8130us (11712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.674452:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10602 00000100:00100000:2.0:1746147193.676711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.676765:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949696 00000100:00100000:2.0:1746147193.676771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.676772:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949696 00002000:00100000:3.0:1746147193.676803:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (724992->729087) req@ffff880134d00380 x1830967463949696/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.676813:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00380 with x1830967463949696 ext(724992->729087) 00002000:00010000:3.0:1746147193.676818:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00380 00000100:00100000:3.0:1746147193.676919:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463949952 00000100:00100000:3.0:1746147193.676923:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463949952 00002000:00100000:3.0:1746147193.676949:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1122304->1126399) req@ffff880134d01f80 x1830967463949952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.676957:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01f80 with x1830967463949952 ext(1122304->1126399) 00000100:00100000:1.0:1746147193.676957:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4730 00002000:00010000:3.0:1746147193.676960:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d01f80 00000100:00100000:1.0:1746147193.676965:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463949696:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.676978:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4731 00000100:00100000:3.0:1746147193.676984:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463949952:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.677099:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1957:x1830967463949952:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 114us (326us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147193.677105:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4731 00002000:00100000:3.0:1746147193.677111:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1122304->1126399) req@ffff880134d01f80 x1830967463949952/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.677117:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01f80 with x1830967463949952 ext(1122304->1126399) 00002000:00010000:3.0:1746147193.677120:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d01f80 00000100:00100000:1.0:1746147193.677231:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463949696:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 265us (524us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147193.677237:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4730 00002000:00100000:1.0:1746147193.677242:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (724992->729087) req@ffff880134d00380 x1830967463949696/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.677249:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00380 with x1830967463949696 ext(724992->729087) 00002000:00010000:1.0:1746147193.677252:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00380 00000100:00100000:0.0:1746147193.681406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.681441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.681463:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950208 00000100:00100000:0.0:1746147193.681465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.681470:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950208 00000100:00100000:0.0:1746147193.681477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.681497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.681915:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950464 00000100:00100000:2.0:1746147193.681919:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950464 00000100:00100000:3.0:1746147193.681923:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950080 00000100:00100000:3.0:1746147193.681927:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950080 00000100:00100000:2.0:1746147193.681929:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950336 00000100:00100000:2.0:1746147193.681931:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950336 00000100:00100000:3.0:1746147193.681962:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950592 00000100:00100000:3.0:1746147193.681964:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950592 00000100:00100000:3.0:1746147193.681979:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12140 00000100:00100000:3.0:1746147193.681986:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463950208:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147193.682000:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.682015:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac7dbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e772c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.682058:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466483456:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147193.682111:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.682130:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12141 00000100:00100000:3.0:1746147193.682136:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463950080:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147193.682143:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.682152:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e99f400/0xb4b2209fbdac7dc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7725 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.682175:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466483584:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147193.682192:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.682206:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12142 00000100:00100000:3.0:1746147193.682211:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463950592:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147193.682216:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.682222:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7741 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.682231:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.682232:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.682239:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.682250:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.682257:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99e800, rc 0) 00000100:00100000:3.0:1746147193.682273:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463950592:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 62us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.682278:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12142 00000100:00100000:2.0:1746147193.682434:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12143 00000100:00100000:2.0:1746147193.682440:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463950336:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147193.682447:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.682455:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7733 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.682470:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.682472:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.682476:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.682485:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.682492:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4ae200, rc 0) 00000100:00100000:2.0:1746147193.682508:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463950336:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 69us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.682513:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12143 00000100:00100000:2.0:1746147193.682546:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12144 00000100:00100000:2.0:1746147193.682550:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463950464:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147193.682566:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.682572:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e773a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.682581:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.682582:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147193.682586:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.682594:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.682605:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c77c00, rc 0) 00000100:00100000:2.0:1746147193.682620:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463950464:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 70us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.682625:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12144 00000100:00100000:1.0:1746147193.683412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.683571:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950720 00000100:00100000:3.0:1746147193.683577:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950720 00000100:00100000:3.0:1746147193.683604:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12145 00000100:00100000:3.0:1746147193.683610:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+14:1959:x1830967463950720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.683618:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.683627:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99ee00/0xb4b2209fbdac7dde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7748 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.683708:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466483712:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147193.683765:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.686534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.686730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:3.0:1746147193.686762:0:21080:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147191 -> 1746147193 00002000:00010000:3.0:1746147193.686766:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147191 -> 1746147193 00002000:00010000:3.0:1746147193.686768:0:21080:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147191 -> 1746147193 00000100:00100000:3.0:1746147193.686786:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466483584:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147193.686801:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463950848 00000100:00100000:2.0:1746147193.686807:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463950848 00010000:00010000:3.0:1746147193.686812:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99f400/0xb4b2209fbdac7dc2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7725 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.686823:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99f400/0xb4b2209fbdac7dc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7725 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.686836:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99f400, rc 0) 00000100:00100000:2.0:1746147193.686849:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12146 00000100:00100000:2.0:1746147193.686856:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29173:x1830967463950848:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147193.686869:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147193.686872:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463950080:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4735us (5405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.686878:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12141 00010000:00010000:2.0:1746147193.686882:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e774f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.686901:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 34 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.686907:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.686909:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746147193.687044:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463951104 00000100:00100000:1.0:1746147193.687048:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463951104 00002000:00100000:1.0:1746147193.687073:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1605632->1609727) req@ffff880090740e00 x1830967463951104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.687081:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463951104 ext(1605632->1609727) 00010000:00010000:1.0:1746147193.687086:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.687093:0:31324:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147193.687102:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740e00 00000100:00100000:1.0:1746147193.687116:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1613 00010000:00010000:2.0:1746147193.687266:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.687271:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463951104:12345-192.168.203.36@tcp:3:multiop.0 00002000:00010000:3.0:1746147193.687276:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147192 -> 1746147193 00002000:00010000:3.0:1746147193.687279:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147192 -> 1746147193 00002000:00010000:3.0:1746147193.687281:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147192 -> 1746147193 00000100:00100000:3.0:1746147193.687295:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466483456:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147193.687300:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.687310:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.687324:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466483840:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.687327:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac7dbb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e772c expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.687335:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d54a00/0xb4b2209fbdac7dbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e772c expref: 11 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.687343:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d54a00, rc 0) 00000100:00100000:2.0:1746147193.687361:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.687363:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463950208:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 5377us (5965us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.687368:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12140 00000100:00100000:1.0:1746147193.687388:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463951104:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 266us (658us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147193.687394:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1613 00002000:00100000:1.0:1746147193.687398:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1605632->1609727) req@ffff880090740e00 x1830967463951104/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.687748:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463951104 ext(1605632->1609727) 00010000:00010000:1.0:1746147193.687754:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.687764:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.687770:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740e00 00000100:00100000:3.0:1746147193.688920:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466483712:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147193.688969:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99ee00/0xb4b2209fbdac7dde lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7748 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.688980:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99ee00/0xb4b2209fbdac7dde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7748 expref: 17 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.688989:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99ee00, rc 0) 00000100:00100000:3.0:1746147193.689029:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463950720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5418us (5619us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.689035:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12145 00000100:00100000:2.0:1746147193.690038:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466483840:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.690056:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 15 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.690067:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4ae000, rc 0) 00000100:00100000:2.0:1746147193.690246:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29173:x1830967463950848:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3389us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.690253:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12146 00000100:00100000:0.0:1746147193.691153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.691587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.691610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.691682:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463951488 00000100:00100000:1.0:1746147193.691689:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463951488 00002000:00100000:1.0:1746147193.691720:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1122304->1609727) req@ffff880090740000 x1830967463951488/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.691729:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740000 with x1830967463951488 ext(1122304->1609727) 00010000:00010000:1.0:1746147193.691736:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.691751:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 35 pid: 11147 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.691757:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740000 00000100:00100000:3.0:1746147193.691806:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463951360 00000100:00100000:3.0:1746147193.691810:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463951360 00000100:00100000:3.0:1746147193.691834:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4223 00000100:00100000:3.0:1746147193.691840:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+320:29179:x1830967463951360:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147193.692022:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+321:29179:x1830967463951360:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 181us (411us total) trans 8589944370 rc 0/0 00000100:00100000:3.0:1746147193.692029:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4223 00000100:00100000:0.0:1746147193.692197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.692545:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463951744 00000100:00100000:2.0:1746147193.692549:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463951744 00000100:00100000:2.0:1746147193.692582:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10603 00000100:00100000:1.0:1746147193.692585:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1614 00000100:00100000:2.0:1746147193.692587:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:29180:x1830967463951744:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147193.692590:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+35:1956:x1830967463951488:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:2.0:1746147193.692595:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.692608:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac7dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7756 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.692658:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147193.692670:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.692676:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147193.692698:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.692707:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 16 pid: 14125 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.692716:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466483968:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.692756:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.692830:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463951872 00000100:00100000:3.0:1746147193.692833:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463951872 00000100:00100000:3.0:1746147193.692860:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12147 00000100:00100000:3.0:1746147193.692865:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463951872:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.692872:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.692881:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99f800/0xb4b2209fbdac7dfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e775d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.692905:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466484096:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147193.692925:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.694329:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466483968:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.694350:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:3.0:1746147193.694506:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466484096:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147193.694525:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99f800/0xb4b2209fbdac7dfa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e775d expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.694534:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99f800/0xb4b2209fbdac7dfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e775d expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.694543:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99f800, rc 0) 00000100:00100000:3.0:1746147193.694590:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463951872:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1720us (2389us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.694596:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12147 00000100:00100000:0.0:1746147193.695410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.695585:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463952000 00000100:00100000:3.0:1746147193.695590:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463952000 00010000:00010000:3.0:1746147193.695609:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 17 pid: 14125 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.695660:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6049 00000100:00100000:3.0:1746147193.695666:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+17:1957:x1830967463952000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.695675:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147193.695679:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 17 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.695686:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 17 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.695699:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7db4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e771e expref: 17 pid: 14125 timeout: 680 lvb_type: 0 00010000:00010000:3.0:1746147193.695709:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.695713:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.695721:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.695726:0:7119:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.695749:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.695769:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+16:1957:x1830967463952000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.695775:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6049 00010000:00010000:2.0:1746147193.696040:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147193.696048:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147193.696063:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147193.696311:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4bbc00/0xb4b2209fbdac7dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7756 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.696323:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7756 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.696329:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.696331:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147193.696333:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4ba200, rc 0) 00000100:00100000:3.0:1746147193.696364:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:29180:x1830967463951744:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3776us (5213us total) trans 8589944371 rc 0/0 00000100:00100000:3.0:1746147193.696370:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10603 00000100:00100000:0.0:1746147193.698667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.699440:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463952128 00000100:00100000:3.0:1746147193.699447:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463952128 00000100:00100000:3.0:1746147193.699478:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12148 00000100:00100000:3.0:1746147193.699484:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463952128:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.699497:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.699510:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7764 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147193.699549:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466484224:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147193.699619:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.700971:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466484224:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147193.701174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147193.701316:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e08 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7764 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.701328:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7764 expref: 16 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.701337:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99e400, rc 0) 00000100:00100000:3.0:1746147193.701367:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463952128:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1883us (2705us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.701374:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12148 00000100:00100000:2.0:1746147193.701482:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1956:x1830967463951488:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 8889us (9893us total) trans 17179873278 rc 0/0 00000100:00100000:2.0:1746147193.701490:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1614 00002000:00100000:2.0:1746147193.701498:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1122304->1609727) req@ffff880090740000 x1830967463951488/t17179873278(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.701505:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740000 with x1830967463951488 ext(1122304->1609727) 00010000:00010000:2.0:1746147193.701512:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.701528:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.701533:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740000 00000100:00100000:3.0:1746147193.701870:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463952384 00000100:00100000:3.0:1746147193.701875:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463952384 00000100:00100000:3.0:1746147193.701909:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10604 00000100:00100000:3.0:1746147193.701916:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:29180:x1830967463952384:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147193.701929:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.701931:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147193.701964:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ba200/0xb4b2209fbdac7df3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7756 expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.701976:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.701980:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147193.701988:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e776b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.702046:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702056:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702062:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702071:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702076:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702081:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702085:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e99fc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.702088:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702093:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702097:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.702099:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147193.702101:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702105:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e16 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.702120:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e0f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e776b expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.702126:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e776b expref: 16 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.702131:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99fa00, rc 0) 00000100:00100000:3.0:1746147193.702510:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:29180:x1830967463952384:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 593us (1335us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147193.702516:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10604 00000100:00100000:0.0:1746147193.708180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.708216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.708259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.708276:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463952768 00000100:00100000:2.0:1746147193.708283:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463952768 00000100:00100000:2.0:1746147193.708315:0:16234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953024 00000100:00100000:2.0:1746147193.708317:0:16234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953024 00000100:00100000:2.0:1746147193.708330:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4224 00000100:00100000:2.0:1746147193.708336:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:29180:x1830967463952768:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147193.708498:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:29180:x1830967463952768:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 162us (281us total) trans 8589944372 rc 0/0 00000100:00100000:2.0:1746147193.708504:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4224 00000100:00100000:2.0:1746147193.708515:0:16234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4225 00000100:00100000:2.0:1746147193.708519:0:16234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29176:x1830967463953024:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147193.708584:0:16234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29176:x1830967463953024:12345-192.168.203.36@tcp:35:cat.0 Request processed in 63us (324us total) trans 8589944373 rc 0/0 00000100:00100000:2.0:1746147193.708588:0:16234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4225 00000100:00100000:1.0:1746147193.708766:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463952512 00000100:00100000:1.0:1746147193.708777:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463952512 00010000:00010000:1.0:1746147193.708800:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.708831:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6050 00000100:00100000:1.0:1746147193.708841:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463952512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147193.708850:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.708865:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.708875:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.708893:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea35e00/0xb4b2209fbdac7d98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1609727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7717 expref: 37 pid: 11147 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.708914:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.708917:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.708923:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.708930:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.708985:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.708994:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466484352:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147193.709378:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.712983:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466484352:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147193.713005:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147193.713040:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463952512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4203us (4868us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.713049:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6050 00000100:00100000:0.0:1746147193.715294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.715797:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953280 00000100:00100000:2.0:1746147193.715804:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953280 00002000:00100000:2.0:1746147193.715840:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1515520->1519615) req@ffff880090743100 x1830967463953280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.715849:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743100 with x1830967463953280 ext(1515520->1519615) 00002000:00010000:2.0:1746147193.715853:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743100 00000100:00100000:2.0:1746147193.715882:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4732 00000100:00100000:2.0:1746147193.715888:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463953280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.716138:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463953280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 249us (849us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147193.716144:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4732 00002000:00100000:2.0:1746147193.716149:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1515520->1519615) req@ffff880090743100 x1830967463953280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.716155:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743100 with x1830967463953280 ext(1515520->1519615) 00002000:00010000:2.0:1746147193.716158:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743100 00000100:00100000:0.0:1746147193.718812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.718878:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953536 00000100:00100000:3.0:1746147193.718886:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953536 00000100:00100000:2.0:1746147193.719031:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4226 00000100:00100000:2.0:1746147193.719040:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29173:x1830967463953536:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147193.719257:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:29173:x1830967463953536:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 218us (449us total) trans 8589944374 rc 0/0 00000100:00100000:2.0:1746147193.719263:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4226 00000100:00100000:0.0:1746147193.786588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.786637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.786724:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953664 00000100:00100000:2.0:1746147193.786731:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953664 00000100:00100000:2.0:1746147193.786764:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953792 00000100:00100000:2.0:1746147193.786766:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953792 00000100:00100000:2.0:1746147193.786967:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12149 00000100:00100000:2.0:1746147193.786975:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463953664:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.786989:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.787003:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8521600/0xb4b2209fbdac7e1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7772 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147193.787049:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466484480:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147193.787109:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.787330:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12150 00000100:00100000:0.0:1746147193.787338:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+36:1957:x1830967463953792:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147193.787345:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.787354:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac7e24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7779 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.787378:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466484608:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147193.787414:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.789503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.789605:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463953920 00000100:00100000:1.0:1746147193.789611:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463953920 00000100:00100000:1.0:1746147193.789654:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12151 00000100:00100000:0.0:1746147193.789656:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466484608:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147193.789661:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463953920:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147193.789673:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.789681:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac7e24 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7779 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.789684:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7780 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.789691:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092904200/0xb4b2209fbdac7e24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7779 expref: 38 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.789698:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.789700:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.789709:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 39 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.789720:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 39 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147193.789728:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487600, rc 0) 00000100:00100000:1.0:1746147193.789760:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463953920:12345-192.168.203.36@tcp:101:cat.0 Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.789765:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12151 00000100:00100000:2.0:1746147193.789841:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466484480:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147193.789858:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8521600/0xb4b2209fbdac7e1d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7772 expref: 19 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.789866:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8521600/0xb4b2209fbdac7e1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7772 expref: 19 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147193.789878:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8521600, rc 0) 00000100:00100000:2.0:1746147193.789896:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967463953664:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2923us (3316us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147193.789901:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12149 00010000:00010000:0.0:1746147193.789960:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904200, rc 0) 00000100:00100000:0.0:1746147193.789984:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463953792:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2649us (3347us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.789989:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12150 00000100:00100000:0.0:1746147193.793074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.793698:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463954048 00000100:00100000:2.0:1746147193.793707:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463954048 00000100:00100000:2.0:1746147193.794165:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12152 00000100:00100000:2.0:1746147193.794173:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29187:x1830967463954048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.794189:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.794204:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7787 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.794227:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.794233:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.794234:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.794237:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.794263:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.794272:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 20 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.794282:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466484736:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.794610:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.797616:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466484736:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.797644:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.797658:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930f2c00, rc 0) 00000100:00100000:2.0:1746147193.797696:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+19:29187:x1830967463954048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3524us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.797704:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12152 00000100:00100000:0.0:1746147193.798060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.798765:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463954176 00000100:00100000:2.0:1746147193.798771:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463954176 00002000:00100000:2.0:1746147193.798800:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (724992->1048575) req@ffff880090741f80 x1830967463954176/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.798807:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741f80 with x1830967463954176 ext(724992->1048575) 00010000:00010000:2.0:1746147193.798813:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 21 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.798826:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 21 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.798832:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090741f80 00000100:00100000:2.0:1746147193.798858:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1615 00000100:00100000:2.0:1746147193.798865:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967463954176:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147193.817228:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463954176:12345-192.168.203.36@tcp:4:cat.0 Request processed in 18355us (19160us total) trans 21474840687 rc 0/0 00000100:00100000:2.0:1746147193.817239:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1615 00002000:00100000:2.0:1746147193.817248:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (724992->1048575) req@ffff880090741f80 x1830967463954176/t21474840687(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.817257:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741f80 with x1830967463954176 ext(724992->1048575) 00010000:00010000:2.0:1746147193.817267:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:2.0:1746147193.817281:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:2.0:1746147193.817288:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090741f80 00000100:00100000:0.0:1746147193.825639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.825688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.825824:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463954560 00000100:00100000:1.0:1746147193.825832:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463954560 00010000:00010000:1.0:1746147193.825859:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.825885:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6051 00000100:00100000:1.0:1746147193.825893:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463954560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147193.825906:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.825926:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.825964:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.825981:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f568c00/0xb4b2209fbdac7d91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7710 expref: 23 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.826000:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.826002:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.826007:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.826014:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.826038:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 18 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.826048:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466484864:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147193.826112:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147193.826285:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463954432 00000100:00100000:3.0:1746147193.826290:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463954432 00000100:00100000:3.0:1746147193.826317:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10605 00000100:00100000:3.0:1746147193.826323:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+321:29189:x1830967463954432:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147193.826337:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.826349:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e200/0xb4b2209fbdac7e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e778e expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.826424:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.826434:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.826442:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147193.826450:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147193.826538:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e200/0xb4b2209fbdac7e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 324 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.826571:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 323 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.826579:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.826581:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147193.826587:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99f200, rc 0) 00000100:00100000:3.0:1746147193.827077:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+323:29189:x1830967463954432:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 304us (995us total) trans 8589944375 rc 0/0 00000100:00100000:3.0:1746147193.827087:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10605 00000100:00100000:0.0:1746147193.839187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.839342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.839368:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955072 00000100:00100000:2.0:1746147193.839374:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955072 00002000:00100000:2.0:1746147193.839408:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d03100 x1830967463955072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.839422:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03100 with x1830967463955072 ext(0->1048575) 00002000:00010000:2.0:1746147193.839427:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d03100 00000100:00100000:2.0:1746147193.839449:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4733 00000100:00100000:2.0:1746147193.839457:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463955072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.842738:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466484864:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147193.842759:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147193.842791:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463954560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 16899us (17101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.842800:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6051 00000100:00100000:3.0:1746147193.843045:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463954816 00000100:00100000:0.0:1746147193.843048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.843051:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463954816 00000100:00100000:3.0:1746147193.843077:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10606 00000100:00100000:3.0:1746147193.843084:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+32:29192:x1830967463954816:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.843100:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.843114:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdac7e4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7795 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843205:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843216:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843224:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843233:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843238:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843242:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843326:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843334:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843340:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147193.843348:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147193.843419:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843425:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843431:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843436:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e99e600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.843440:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843445:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843454:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147193.843456:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.843459:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843464:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843477:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843482:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843614:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843619:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e99fa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.843621:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843625:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843632:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76400) 00010000:00010000:3.0:1746147193.843634:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.843636:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843639:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.843670:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99ec00/0xb4b2209fbdac7e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7795 expref: 35 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843681:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7795 expref: 34 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843687:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.843689:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147193.843691:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99fc00, rc 0) 00000100:00100000:3.0:1746147193.843733:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+34:29192:x1830967463954816:12345-192.168.203.36@tcp:101:cat.0 Request processed in 649us (4552us total) trans 8589944376 rc 0/0 00000100:00100000:3.0:1746147193.843739:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10606 00000100:00100000:3.0:1746147193.843764:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955200 00000100:00100000:3.0:1746147193.843767:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955200 00000100:00100000:3.0:1746147193.843784:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12153 00000100:00100000:3.0:1746147193.843788:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:29189:x1830967463955200:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147193.843796:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.843805:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e779c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843821:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843829:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.843836:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.843842:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.843843:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.843846:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2400256->2490367] (req 2400256->2490367) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.843869:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 21 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.843879:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 21 pid: 17548 timeout: 680 lvb_type: 1 00000100:00100000:3.0:1746147193.843894:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466484992:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.843976:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 11 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147193.843983:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 11 pid: 17548 timeout: 680 lvb_type: 1 00000100:00100000:3.0:1746147193.843991:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466485120:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.844019:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.844026:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 22 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.844034:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466485248:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.844054:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147193.848349:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147193.851004:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466484992:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.851019:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466485120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.851560:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463955072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12095us (12209us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.851570:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4733 00002000:00100000:2.0:1746147193.851579:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d03100 x1830967463955072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.851587:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03100 with x1830967463955072 ext(0->1048575) 00002000:00010000:2.0:1746147193.851591:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d03100 00000100:00100000:0.0:1746147193.851866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.853266:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955328 00000100:00100000:1.0:1746147193.853275:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955328 00010000:00010000:1.0:1746147193.853305:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 12 pid: 17548 timeout: 680 lvb_type: 1 00000100:00100000:1.0:1746147193.853863:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6052 00000100:00100000:1.0:1746147193.853870:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463955328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147193.854007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.854024:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955456 00000100:00100000:0.0:1746147193.854027:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955456 00000100:00100000:0.0:1746147193.854047:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 601 00000100:00100000:0.0:1746147193.854835:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1956:x1830967463955456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.854848:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.854866:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99fc00/0xb4b2209fbdac7e63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7795 expref: 34 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.854898:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147193.854901:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.854994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.855006:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955584 00000100:00100000:3.0:1746147193.855009:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955584 00010000:00010000:3.0:1746147193.855032:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 22 pid: 17548 timeout: 680 lvb_type: 1 00000100:00100000:3.0:1746147193.855058:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6053 00000100:00100000:3.0:1746147193.855063:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463955584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147193.855070:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147193.855074:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967463955456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1022us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.855079:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 601 00010000:00010000:3.0:1746147193.855087:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 22 pid: 17548 timeout: 680 lvb_type: 1 00010000:00010000:3.0:1746147193.855095:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 22 pid: 17548 timeout: 680 lvb_type: 1 00010000:00010000:3.0:1746147193.855107:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f569400/0xb4b2209fbdac7d7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76fb expref: 22 pid: 17548 timeout: 680 lvb_type: 1 00000100:00100000:0.0:1746147193.855108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147193.855188:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147193.855204:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1958:x1830967463955584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.855213:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6053 00000100:00100000:0.0:1746147193.855226:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955712 00000100:00100000:0.0:1746147193.855229:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955712 00000100:00100000:0.0:1746147193.855246:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12154 00000100:00100000:0.0:1746147193.855250:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967463955712:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147193.855259:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.855268:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77a3 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.855284:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.855286:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.855291:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.855301:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.855308:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905e00, rc 0) 00000100:00100000:0.0:1746147193.855324:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463955712:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.855329:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12154 00010000:00010000:1.0:1746147193.855402:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.855411:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 12 pid: 17548 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.855419:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 12 pid: 17548 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.855429:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c77c00/0xb4b2209fbdac7dd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e773a expref: 12 pid: 17548 timeout: 680 lvb_type: 1 00010000:00010000:1.0:1746147193.855450:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147193.855467:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463955328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1597us (3601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.855472:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6052 00000100:00100000:3.0:1746147193.856805:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.856854:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955840 00000100:00100000:1.0:1746147193.856859:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955840 00000100:00100000:0.0:1746147193.857257:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12155 00000100:00100000:0.0:1746147193.857265:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463955840:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147193.857369:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466485248:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147193.857398:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->2490367] (req 2400256->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.857409:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99e400, rc 0) 00000100:00100000:2.0:1746147193.857448:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+20:29189:x1830967463955200:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 13659us (14400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.857454:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12153 00010000:00010000:0.0:1746147193.858072:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.858084:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac7e7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77aa expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.858098:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.858105:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac7e7f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77aa expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.858112:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac7e7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77aa expref: 23 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.858119:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904200, rc 0) 00000100:00100000:3.0:1746147193.858183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.858247:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463955968 00000100:00100000:1.0:1746147193.858251:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463955968 00010000:00010000:1.0:1746147193.858267:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 20 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:1.0:1746147193.858283:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6054 00000100:00100000:1.0:1746147193.858287:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463955968:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147193.858294:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147193.858310:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 20 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.858323:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 20 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.858337:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa4b600/0xb4b2209fbdac7d2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e76e6 expref: 20 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.858345:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.858346:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147193.858351:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.858357:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147193.858381:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 19 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147193.858389:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466485376:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147193.858441:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.858629:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463955840:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1363us (1825us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.858635:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12155 00000100:00100000:0.0:1746147193.859313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.859419:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463956096 00000100:00100000:2.0:1746147193.859423:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463956096 00000100:00100000:2.0:1746147193.859445:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12156 00000100:00100000:2.0:1746147193.859451:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+37:29187:x1830967463956096:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.859462:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.859472:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77b1 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.859488:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.859494:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.859495:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.859498:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 38 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.859516:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.859525:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 14 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:2.0:1746147193.859533:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466485504:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147193.859902:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.860036:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466485376:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147193.860048:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147193.860067:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463955968:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1779us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.860074:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6054 00000100:00100000:0.0:1746147193.861422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.861511:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463956352 00000100:00100000:2.0:1746147193.861516:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463956352 00002000:00100000:2.0:1746147193.861544:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2404351) req@ffff88008f81bb80 x1830967463956352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.861560:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81bb80 with x1830967463956352 ext(2400256->2404351) 00002000:00010000:2.0:1746147193.861564:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81bb80 00000100:00100000:2.0:1746147193.861578:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4734 00000100:00100000:2.0:1746147193.861584:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463956352:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147193.861762:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967463956352:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 177us (341us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147193.861769:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4734 00002000:00100000:2.0:1746147193.861773:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2404351) req@ffff88008f81bb80 x1830967463956352/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.861780:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81bb80 with x1830967463956352 ext(2400256->2404351) 00002000:00010000:2.0:1746147193.861782:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f81bb80 00000100:00100000:3.0:1746147193.862164:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466485504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147193.862168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147193.862181:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 38 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.862193:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1aade00, rc 0) 00000100:00100000:0.0:1746147193.862201:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463956480 00000100:00100000:0.0:1746147193.862205:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463956480 00000100:00100000:3.0:1746147193.862214:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+38:29187:x1830967463956096:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2763us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.862220:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12156 00002000:00100000:0.0:1746147193.862221:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1519615) req@ffff88009f76df80 x1830967463956480/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.862228:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76df80 with x1830967463956480 ext(1048576->1519615) 00010000:00010000:0.0:1746147193.862233:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 15 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.862243:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 15 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:0.0:1746147193.862249:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f76df80 00000100:00100000:0.0:1746147193.862258:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1616 00000100:00100000:0.0:1746147193.862262:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463956480:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147193.864444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.864491:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463956736 00000100:00100000:2.0:1746147193.864498:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463956736 00002000:00100000:2.0:1746147193.864526:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008f818a80 x1830967463956736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.864534:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463956736 ext(0->1048575) 00002000:00010000:2.0:1746147193.864538:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818a80 00000100:00100000:2.0:1746147193.864571:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4735 00000100:00100000:2.0:1746147193.864578:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463956736:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147193.869350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.869578:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463956992 00000100:00100000:1.0:1746147193.871024:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463956480:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8756us (8850us total) trans 17179873279 rc 0/0 00000100:00100000:1.0:1746147193.871034:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1616 00002000:00100000:1.0:1746147193.871042:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1519615) req@ffff88009f76df80 x1830967463956480/t17179873279(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.871051:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76df80 with x1830967463956480 ext(1048576->1519615) 00010000:00010000:1.0:1746147193.871059:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.871070:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.871077:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f76df80 00000100:00100000:3.0:1746147193.871142:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463956992 00002000:00100000:3.0:1746147193.871168:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2486272->2490367) req@ffff88008f818e00 x1830967463956992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.871175:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818e00 with x1830967463956992 ext(2486272->2490367) 00002000:00010000:3.0:1746147193.871177:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818e00 00000100:00100000:3.0:1746147193.871190:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4736 00000100:00100000:3.0:1746147193.871195:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463956992:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147193.871284:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463956992:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 89us (1943us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147193.871289:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4736 00002000:00100000:3.0:1746147193.871293:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2486272->2490367) req@ffff88008f818e00 x1830967463956992/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.871299:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818e00 with x1830967463956992 ext(2486272->2490367) 00002000:00010000:3.0:1746147193.871301:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818e00 00000100:00100000:2.0:1746147193.881052:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463956736:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16467us (16951us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.881061:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4735 00002000:00100000:2.0:1746147193.881070:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008f818a80 x1830967463956736/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.881078:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f818a80 with x1830967463956736 ext(0->1048575) 00002000:00010000:2.0:1746147193.881082:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f818a80 00000100:00100000:1.0:1746147193.882131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.882247:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463957120 00000100:00100000:0.0:1746147193.882259:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463957120 00010000:00010000:0.0:1746147193.882285:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.882320:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6055 00000100:00100000:0.0:1746147193.882327:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463957120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.882339:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.882360:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.882370:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.882389:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4ae000/0xb4b2209fbdac7de5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e774f expref: 17 pid: 17548 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.882683:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.882685:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.882693:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 37 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.882700:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 37 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.882726:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 37 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.882735:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f818700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466485632:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147193.882798:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147193.888964:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f818700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466485632:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147193.888983:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147193.889038:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463957120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6710us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147193.889048:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6055 00000100:00100000:0.0:1746147193.891726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.891819:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463957248 00000100:00100000:3.0:1746147193.891826:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463957248 00000100:00100000:3.0:1746147193.891861:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12157 00000100:00100000:3.0:1746147193.891867:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29192:x1830967463957248:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.891882:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.891896:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77b8 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.891919:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.891921:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147193.891927:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.891960:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.891968:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99e600, rc 0) 00000100:00100000:3.0:1746147193.892111:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29192:x1830967463957248:12345-192.168.203.36@tcp:101:cat.0 Request processed in 242us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.892117:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12157 00000100:00100000:0.0:1746147193.893124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.893805:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463957504 00000100:00100000:2.0:1746147193.893812:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463957504 00002000:00100000:2.0:1746147193.893844:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f81a680 x1830967463957504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.893852:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81a680 with x1830967463957504 ext(1048576->2097151) 00002000:00010000:2.0:1746147193.893856:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81a680 00000100:00100000:2.0:1746147193.893881:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4737 00000100:00100000:2.0:1746147193.893887:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463957504:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147193.895141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.895348:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463957760 00000100:00100000:1.0:1746147193.895354:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463957760 00002000:00100000:1.0:1746147193.895375:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f81ad80 x1830967463957760/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.895383:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81ad80 with x1830967463957760 ext(1048576->2097151) 00002000:00010000:1.0:1746147193.895387:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81ad80 00000100:00100000:1.0:1746147193.895413:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4738 00000100:00100000:1.0:1746147193.895419:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463957760:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147193.903885:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463957504:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 9987us (10752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.903895:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4737 00002000:00100000:2.0:1746147193.903906:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f81a680 x1830967463957504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.903915:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81a680 with x1830967463957504 ext(1048576->2097151) 00002000:00010000:2.0:1746147193.903920:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81a680 00000100:00100000:1.0:1746147193.906226:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463957760:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10800us (11081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.906237:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4738 00002000:00100000:1.0:1746147193.906393:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88008f81ad80 x1830967463957760/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.906403:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81ad80 with x1830967463957760 ext(1048576->2097151) 00002000:00010000:1.0:1746147193.906407:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f81ad80 00000100:00100000:0.0:1746147193.912630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.912725:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463957888 00000100:00100000:3.0:1746147193.912733:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463957888 00000100:00100000:3.0:1746147193.912769:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12158 00000100:00100000:3.0:1746147193.912776:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+19:29187:x1830967463957888:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147193.912792:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.912807:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77bf expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.912828:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.912835:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.912837:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147193.912840:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.912866:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.912877:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:3.0:1746147193.912886:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466485760:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147193.913559:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.914022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.914137:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463958016 00000100:00100000:2.0:1746147193.914143:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463958016 00000100:00100000:2.0:1746147193.914313:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12159 00000100:00100000:2.0:1746147193.914320:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29192:x1830967463958016:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147193.914329:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147193.914338:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77c6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.914353:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147193.914357:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.914366:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.914374:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c52f200, rc 0) 00000100:00100000:2.0:1746147193.914407:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29192:x1830967463958016:12345-192.168.203.36@tcp:101:cat.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.914412:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12159 00000100:00100000:3.0:1746147193.914872:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f36b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466485760:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147193.914887:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.914895:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99fa00, rc 0) 00000100:00100000:3.0:1746147193.914913:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:29187:x1830967463957888:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2137us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147193.914918:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12158 00000100:00100000:0.0:1746147193.916483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.916815:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463958144 00000100:00100000:1.0:1746147193.916822:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463958144 00002000:00100000:1.0:1746147193.916855:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2490367) req@ffff88008f81aa00 x1830967463958144/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.916862:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81aa00 with x1830967463958144 ext(2400256->2490367) 00010000:00010000:1.0:1746147193.916869:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.916880:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 20 pid: 4445 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.916886:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f81aa00 00000100:00100000:1.0:1746147193.916956:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1617 00000100:00100000:1.0:1746147193.916964:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463958144:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147193.918740:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463958144:12345-192.168.203.36@tcp:4:cat.0 Request processed in 1773us (2257us total) trans 21474840688 rc 0/0 00000100:00100000:1.0:1746147193.918751:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1617 00002000:00100000:1.0:1746147193.918757:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2400256->2490367) req@ffff88008f81aa00 x1830967463958144/t21474840688(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.918764:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f81aa00 with x1830967463958144 ext(2400256->2490367) 00010000:00010000:1.0:1746147193.918771:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:1.0:1746147193.918782:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00002000:00010000:1.0:1746147193.918788:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f81aa00 00000100:00100000:0.0:1746147193.923836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.924325:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463958272 00000100:00100000:1.0:1746147193.924333:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463958272 00010000:00010000:0.0:1746147193.924411:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00000100:00100000:0.0:1746147193.924450:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6056 00000100:00100000:0.0:1746147193.924458:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463958272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.924469:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147193.924486:0:7121:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147192 -> 1746147193 00010000:00010000:0.0:1746147193.924492:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.924502:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.924520:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99e400/0xb4b2209fbdac7e71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [2400256->4194303] (req 2400256->2490367) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e779c expref: 22 pid: 4445 timeout: 680 lvb_type: 0 00010000:00010000:0.0:1746147193.924547:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.924558:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.924563:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.924571:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.924583:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.924584:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.924588:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.924594:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.924619:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.924629:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f819500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466485888:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147193.924701:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.924709:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486016:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147193.924726:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147193.927378:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f819500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466485888:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147193.927390:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486016:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147193.927405:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.927455:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463958272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2997us (3627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.927463:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6056 00000100:00100000:0.0:1746147193.933776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.933827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147193.933889:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463958656 00000100:00100000:1.0:1746147193.933898:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463958656 00002000:00100000:1.0:1746147193.933932:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e5e1f80 x1830967463958656/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.933963:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1f80 with x1830967463958656 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.933968:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1f80 00000100:00100000:1.0:1746147193.934076:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463958528 00000100:00100000:1.0:1746147193.934079:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463958528 00002000:00100000:1.0:1746147193.934093:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e5e2300 x1830967463958528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.934099:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2300 with x1830967463958528 ext(2097152->3145727) 00002000:00010000:1.0:1746147193.934102:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e2300 00000100:00100000:2.0:1746147193.934161:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4739 00000100:00100000:2.0:1746147193.934171:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463958656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.935012:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4740 00000100:00100000:1.0:1746147193.935019:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463958528:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147193.945736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147193.948118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.948159:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463959040 00000100:00100000:2.0:1746147193.948166:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463959040 00002000:00100000:2.0:1746147193.948202:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e5e3b80 x1830967463959040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.948212:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3b80 with x1830967463959040 ext(2097152->3145727) 00002000:00010000:2.0:1746147193.948216:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3b80 00000100:00100000:2.0:1746147193.948247:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4741 00000100:00100000:2.0:1746147193.948253:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463959040:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147193.951757:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463959296 00000100:00100000:1.0:1746147193.951768:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463959296 00002000:00100000:1.0:1746147193.951808:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e5e3100 x1830967463959296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.951816:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3100 with x1830967463959296 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.951820:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3100 00000100:00100000:1.0:1746147193.951854:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4742 00000100:00100000:1.0:1746147193.951861:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463959296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.951983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.952021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.952040:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463959552 00000100:00100000:3.0:1746147193.952043:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463959552 00002000:00100000:3.0:1746147193.952059:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f36b100 x1830967463959552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.952067:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b100 with x1830967463959552 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.952070:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f36b100 00000100:00100000:3.0:1746147193.952094:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463959808 00000100:00100000:3.0:1746147193.952096:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463959808 00002000:00100000:3.0:1746147193.952106:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ee5ce00 x1830967463959808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.952111:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967463959808 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.952113:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:3.0:1746147193.952123:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4743 00000100:00100000:3.0:1746147193.952127:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463959552:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.953749:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4744 00000100:00100000:3.0:1746147193.953759:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463959808:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147193.954991:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463958528:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19968us (21160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.954999:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4740 00002000:00100000:3.0:1746147193.955008:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e5e2300 x1830967463958528/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.955016:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2300 with x1830967463958528 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.955020:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e2300 00000100:00100000:2.0:1746147193.960507:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463958656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26330us (26728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147193.960517:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4739 00002000:00100000:2.0:1746147193.960527:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e5e1f80 x1830967463958656/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147193.960536:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1f80 with x1830967463958656 ext(3145728->4194303) 00002000:00010000:2.0:1746147193.960541:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1f80 00000100:00100000:0.0:1746147193.965492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.965595:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960064 00000100:00100000:3.0:1746147193.965608:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960064 00000100:00100000:3.0:1746147193.965679:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10607 00000100:00100000:3.0:1746147193.965688:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+33:29196:x1830967463960064:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147193.965715:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147193.965735:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4de00/0xb4b2209fbdac7ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77cd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.965855:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.965867:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.965877:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.965890:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.965896:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.965900:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966035:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194600/0xb4b2209fbdac7eb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966044:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194600/0xb4b2209fbdac7eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966049:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194600/0xb4b2209fbdac7eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147193.966056:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147193.966138:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966144:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966153:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966159:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da4ca00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.966162:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966169:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966178:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147193.966181:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.966185:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.966190:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4ca00/0xb4b2209fbdac7ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969322:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969338:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969346:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969352:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a47b1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147193.969356:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969364:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969386:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76400) 00010000:00010000:3.0:1746147193.969389:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147193.969393:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969398:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a47b1600/0xb4b2209fbdac7eb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147193.969468:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da4de00/0xb4b2209fbdac7ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77cd expref: 36 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.969484:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194600/0xb4b2209fbdac7eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77cd expref: 35 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147193.969490:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147193.969492:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147193.969494:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194600, rc 0) 00000100:00100000:3.0:1746147193.969575:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+35:29196:x1830967463960064:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3886us (4087us total) trans 8589944377 rc 0/0 00000100:00100000:3.0:1746147193.969585:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10607 00000100:00100000:3.0:1746147193.969998:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463959040:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21744us (24269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.970006:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4741 00002000:00100000:3.0:1746147193.970015:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009e5e3b80 x1830967463959040/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.970023:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3b80 with x1830967463959040 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.970028:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3b80 00000100:00100000:1.0:1746147193.970136:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463959296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 18268us (22016us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147193.970146:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4742 00002000:00100000:1.0:1746147193.970155:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009e5e3100 x1830967463959296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147193.970164:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e3100 with x1830967463959296 ext(3145728->4194303) 00002000:00010000:1.0:1746147193.970169:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e3100 00000100:00100000:3.0:1746147193.974289:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463959552:12345-192.168.203.36@tcp:3:cat.0 Request processed in 22150us (22296us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.974301:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4743 00002000:00100000:3.0:1746147193.974314:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009f36b100 x1830967463959552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.974323:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f36b100 with x1830967463959552 ext(2097152->3145727) 00002000:00010000:3.0:1746147193.974330:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f36b100 00000100:00100000:3.0:1746147193.978958:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463959808:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25169us (26904us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147193.978970:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4744 00002000:00100000:3.0:1746147193.978982:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009ee5ce00 x1830967463959808/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.978991:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5ce00 with x1830967463959808 ext(3145728->4194303) 00002000:00010000:3.0:1746147193.978996:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5ce00 00000100:00100000:0.0:1746147193.980070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.980801:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960320 00000100:00100000:2.0:1746147193.980809:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960320 00000100:00100000:2.0:1746147193.981325:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4227 00000100:00100000:2.0:1746147193.981334:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+35:29192:x1830967463960320:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1746147193.981516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147193.981729:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+36:29192:x1830967463960320:12345-192.168.203.36@tcp:35:cat.0 Request processed in 395us (1664us total) trans 8589944378 rc 0/0 00000100:00100000:2.0:1746147193.981736:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4227 00000100:00100000:2.0:1746147193.981756:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960448 00000100:00100000:2.0:1746147193.981759:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960448 00000100:00100000:2.0:1746147193.982123:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 602 00000100:00100000:2.0:1746147193.982129:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1957:x1830967463960448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147193.982138:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147193.982155:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f194600/0xb4b2209fbdac7eb7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77cd expref: 36 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147193.982167:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147193.982171:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147193.982201:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+35:1957:x1830967463960448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 72us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147193.982207:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 602 00000100:00100000:0.0:1746147193.991544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147193.992117:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960704 00000100:00100000:3.0:1746147193.992124:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960704 00002000:00100000:3.0:1746147193.992159:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009e5e1880 x1830967463960704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147193.992168:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1880 with x1830967463960704 ext(4194304->4947967) 00002000:00010000:3.0:1746147193.992172:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1880 00000100:00100000:3.0:1746147193.992197:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4745 00000100:00100000:3.0:1746147193.992204:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463960704:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.005064:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463960704:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12853us (13522us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147194.005077:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4745 00002000:00100000:3.0:1746147194.005085:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009e5e1880 x1830967463960704/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.005094:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1880 with x1830967463960704 ext(4194304->4947967) 00002000:00010000:3.0:1746147194.005099:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1880 00000100:00100000:0.0:1746147194.149202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.149600:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960832 00000100:00100000:3.0:1746147194.149607:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960832 00000100:00100000:3.0:1746147194.149660:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12160 00000100:00100000:3.0:1746147194.149668:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:29200:x1830967463960832:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147194.149682:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.149697:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77d4 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.149719:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.149727:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.149733:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.149735:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.149738:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [200704->532479] (req 200704->532479) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.149767:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.149781:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.149791:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486144:192.168.203.36@tcp:104: 00000100:00080000:1.0:1746147194.150100:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746147194.150602:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.150612:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.150621:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.150655:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.155831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.155922:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463960960 00000100:00100000:2.0:1746147194.155933:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463960960 00010000:00010000:2.0:1746147194.156004:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 23 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.156033:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6057 00000100:00100000:2.0:1746147194.156041:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463960960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.156053:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.156073:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 23 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.156082:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 23 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.156103:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.156169:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463960960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.156176:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6057 00010000:00010000:3.0:1746147194.156279:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092905e00/0xb4b2209fbdac7e78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77a3 expref: 22 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.156308:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486144:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.157591:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486272:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.157611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147194.157623:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [200704->532479] (req 200704->532479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.157637:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f194c00, rc 0) 00000100:00100000:0.0:1746147194.157662:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961088 00000100:00100000:0.0:1746147194.157667:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961088 00000100:00100000:3.0:1746147194.157685:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+23:29200:x1830967463960832:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 8018us (8490us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147194.157689:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.157696:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12160 00000100:00100000:0.0:1746147194.157717:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6058 00000100:00100000:0.0:1746147194.157723:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463961088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.157733:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.157751:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.157771:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.157793:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930f2c00/0xb4b2209fbdac7e32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7787 expref: 22 pid: 4445 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.157813:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.157815:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.157822:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.157830:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.157857:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.157870:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486400:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147194.157961:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.160289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.160320:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486400:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147194.160338:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.160377:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961344 00000100:00100000:2.0:1746147194.160381:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463961088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2657us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.160384:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961344 00000100:00100000:2.0:1746147194.160390:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6058 00002000:00100000:3.0:1746147194.160416:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (200704->204799) req@ffff88009f76c700 x1830967463961344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.160424:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76c700 with x1830967463961344 ext(200704->204799) 00002000:00010000:3.0:1746147194.160429:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76c700 00000100:00100000:3.0:1746147194.160449:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4746 00000100:00100000:3.0:1746147194.160455:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463961344:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147194.161197:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463961344:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 739us (912us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147194.161204:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4746 00002000:00100000:3.0:1746147194.161210:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (200704->204799) req@ffff88009f76c700 x1830967463961344/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.161217:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76c700 with x1830967463961344 ext(200704->204799) 00002000:00010000:3.0:1746147194.161220:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76c700 00000100:00100000:0.0:1746147194.166237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.166324:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961600 00000100:00100000:3.0:1746147194.166333:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961600 00002000:00100000:3.0:1746147194.166373:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (528384->532479) req@ffff88009e5e2680 x1830967463961600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.166383:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2680 with x1830967463961600 ext(528384->532479) 00002000:00010000:3.0:1746147194.166387:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e2680 00000100:00100000:3.0:1746147194.166763:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4747 00000100:00100000:3.0:1746147194.166770:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463961600:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147194.167795:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463961600:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1023us (1565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147194.167802:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4747 00002000:00100000:3.0:1746147194.167809:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (528384->532479) req@ffff88009e5e2680 x1830967463961600/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.167817:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e2680 with x1830967463961600 ext(528384->532479) 00002000:00010000:3.0:1746147194.167821:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e2680 00000100:00100000:1.0:1746147194.175477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.175656:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961728 00000100:00100000:3.0:1746147194.175665:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961728 00000100:00100000:3.0:1746147194.175711:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12161 00000100:00100000:3.0:1746147194.175718:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29196:x1830967463961728:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147194.175734:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.175752:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77db expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.175779:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.175788:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.175794:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.175799:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.175802:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.175805:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.175831:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.175842:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.175853:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.176429:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 10 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.176437:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 10 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.176445:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486656:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.177325:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 20 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.177334:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 20 pid: 8481 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.177343:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486784:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.177368:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.179494:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486528:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.180909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.181005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.181076:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961856 00000100:00100000:2.0:1746147194.181084:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961856 00010000:00010000:2.0:1746147194.181119:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 24 pid: 8481 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.181306:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486656:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.181316:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466486784:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.181345:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 24 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.181360:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e216e00, rc 0) 00000100:00100000:3.0:1746147194.181412:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:29196:x1830967463961728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5694us (6103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.181420:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12161 00000100:00100000:2.0:1746147194.181567:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463961984 00000100:00100000:2.0:1746147194.181571:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463961984 00010000:00010000:2.0:1746147194.181585:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 11 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.182277:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6059 00000100:00100000:3.0:1746147194.182286:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463961856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.182298:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.182320:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182331:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182352:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d65e00/0xb4b2209fbdac7cd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e768b expref: 23 pid: 8481 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182369:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.182403:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463961856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 119us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.182412:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6059 00000100:00100000:3.0:1746147194.182426:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6060 00000100:00100000:3.0:1746147194.182431:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463961984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.182436:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.182443:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 11 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182451:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 11 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182461:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4ae200/0xb4b2209fbdac7dd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7733 expref: 11 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.182469:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.182481:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463961984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.182486:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6060 00000100:00100000:1.0:1746147194.183253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.183314:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463962112 00000100:00100000:3.0:1746147194.183319:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463962112 00010000:00010000:3.0:1746147194.183335:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 21 pid: 8481 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.183364:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6061 00000100:00100000:3.0:1746147194.183369:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463962112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.183376:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.183386:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 21 pid: 8481 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.183395:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 21 pid: 8481 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.183406:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5dd600/0xb4b2209fbdac7c6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7668 expref: 21 pid: 8481 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.183415:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.183417:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.183423:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.183432:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.183459:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 21 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.183470:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486912:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147194.183537:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.187095:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466486912:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.187114:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.187155:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1959:x1830967463962112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3785us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.187165:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6061 00000100:00100000:0.0:1746147194.187731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.187769:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463962368 00000100:00100000:3.0:1746147194.187776:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463962368 00002000:00100000:3.0:1746147194.187809:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1642496->1646591) req@ffff88009e5e0380 x1830967463962368/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.187819:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463962368 ext(1642496->1646591) 00002000:00010000:3.0:1746147194.187824:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e0380 00000100:00100000:3.0:1746147194.187850:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4748 00000100:00100000:3.0:1746147194.187856:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463962368:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147194.188048:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463962368:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 192us (320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147194.188055:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4748 00002000:00100000:3.0:1746147194.188059:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1642496->1646591) req@ffff88009e5e0380 x1830967463962368/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.188066:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e0380 with x1830967463962368 ext(1642496->1646591) 00002000:00010000:3.0:1746147194.188069:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e0380 00000100:00100000:0.0:1746147194.196362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.196527:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463962496 00000100:00100000:3.0:1746147194.196538:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463962496 00000100:00100000:3.0:1746147194.196602:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12162 00000100:00100000:3.0:1746147194.196611:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29196:x1830967463962496:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147194.196631:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.196647:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77e2 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196677:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196690:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196696:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.196698:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.196701:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196729:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196740:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.196751:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466487040:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.196862:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 19 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.196870:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 19 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.196877:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466487168:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.196896:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.199529:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466487040:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.200302:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466487168:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.200332:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.200351:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41a00, rc 0) 00000100:00100000:3.0:1746147194.200409:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29196:x1830967463962496:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3799us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.200418:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12162 00000100:00100000:0.0:1746147194.200795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.200864:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463962624 00000100:00100000:3.0:1746147194.200870:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463962624 00010000:00010000:3.0:1746147194.200895:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.200914:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6062 00000100:00100000:3.0:1746147194.200920:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463962624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.200931:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.200977:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.200987:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.201008:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7e9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77c6 expref: 23 pid: 4445 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.201173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.201186:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463962752 00000100:00100000:0.0:1746147194.201189:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463962752 00010000:00010000:0.0:1746147194.201202:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.201230:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6063 00000100:00100000:0.0:1746147194.201235:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463962752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.201242:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.201250:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.201263:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.201275:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e99fa00/0xb4b2209fbdac7e94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77bf expref: 20 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.201540:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.201542:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.201557:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.201566:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.201597:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.201610:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466487296:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147194.201683:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.201730:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.201805:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967463962752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 567us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.201812:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6063 00000100:00100000:3.0:1746147194.204060:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466487296:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.204082:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.204264:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967463962624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3342us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.204275:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6062 00000100:00100000:0.0:1746147194.205892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.206096:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963008 00000100:00100000:3.0:1746147194.206106:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963008 00000100:00080000:1.0:1746147194.206325:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147194.206352:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10608 00000100:00100000:3.0:1746147194.206361:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+35:29209:x1830967463963008:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.206388:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.206406:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac7eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77e9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.206512:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206527:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206540:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206564:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206569:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206573:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206676:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac7eef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206686:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac7eef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206692:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac7eef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147194.206700:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147194.206788:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206795:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206801:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206810:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea41c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.206813:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206819:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206830:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147194.206832:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.206836:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206841:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41c00/0xb4b2209fbdac7ee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206866:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206872:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206876:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206881:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea40a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.206883:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206888:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206894:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76d00) 00010000:00010000:3.0:1746147194.206896:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.206898:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206902:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40a00/0xb4b2209fbdac7ee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.206960:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea40800/0xb4b2209fbdac7eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e9 expref: 38 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.206973:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac7eef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e9 expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.206979:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.206981:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147194.206983:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea41400, rc 0) 00000100:00100000:3.0:1746147194.207037:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+37:29209:x1830967463963008:12345-192.168.203.36@tcp:101:cat.0 Request processed in 678us (1152us total) trans 8589944379 rc 0/0 00000100:00100000:3.0:1746147194.207763:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10608 00000100:00100000:0.0:1746147194.207763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.207852:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963264 00000100:00100000:1.0:1746147194.207857:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963264 00002000:00100000:1.0:1746147194.207888:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2666496->2670591) req@ffff88009e5e1500 x1830967463963264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.207897:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1500 with x1830967463963264 ext(2666496->2670591) 00002000:00010000:1.0:1746147194.207900:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1500 00000100:00100000:1.0:1746147194.207912:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4749 00000100:00100000:1.0:1746147194.207917:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463963264:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:0.0:1746147194.208994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.209083:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967463963264:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 1163us (1417us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.209090:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4749 00002000:00100000:1.0:1746147194.209096:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2666496->2670591) req@ffff88009e5e1500 x1830967463963264/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.209104:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5e1500 with x1830967463963264 ext(2666496->2670591) 00002000:00010000:1.0:1746147194.209107:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5e1500 00000100:00100000:0.0:1746147194.209226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.209262:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963392 00000100:00100000:3.0:1746147194.209266:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963392 00000100:00100000:3.0:1746147194.209295:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 603 00000100:00100000:3.0:1746147194.209300:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+37:1956:x1830967463963392:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.209312:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.209331:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea41400/0xb4b2209fbdac7eef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e9 expref: 37 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.209344:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.209349:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.209371:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5801050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+36:1956:x1830967463963392:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.209378:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 603 00000100:00100000:0.0:1746147194.209574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.209590:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963520 00000100:00100000:0.0:1746147194.209593:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963520 00000100:00100000:0.0:1746147194.210192:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963648 00000100:00100000:0.0:1746147194.210196:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963648 00000100:00100000:0.0:1746147194.210232:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12163 00000100:00100000:0.0:1746147194.210237:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463963520:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147194.210239:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12164 00010000:00010000:0.0:1746147194.210247:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147194.210252:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463963648:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.210259:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.210260:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac7efd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77f0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.210266:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac7f04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77f7 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.210280:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac7f04 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77f7 expref: 25 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.210288:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea40200/0xb4b2209fbdac7f04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77f7 expref: 25 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.210295:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea40200, rc 0) 00000100:00100000:0.0:1746147194.210302:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466487424:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.210327:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463963648:12345-192.168.203.36@tcp:101:cat.0 Request processed in 80us (753us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.210332:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12164 00000100:00100000:0.0:1746147194.210357:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.211401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.211512:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463963904 00000100:00100000:3.0:1746147194.211518:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463963904 00000100:00100000:3.0:1746147194.211544:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4228 00000100:00100000:3.0:1746147194.211560:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+36:29196:x1830967463963904:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147194.211699:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466487424:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147194.211721:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac7efd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77f0 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.211730:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac7efd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77f0 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.211745:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4ddc00, rc 0) 00000100:00100000:3.0:1746147194.211764:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+37:29196:x1830967463963904:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 214us (364us total) trans 8589944380 rc 0/0 00000100:00100000:0.0:1746147194.211764:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967463963520:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1527us (2539us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.211768:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4228 00000100:00100000:0.0:1746147194.211769:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12163 00000100:00100000:0.0:1746147194.213479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.213562:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463964032 00000100:00100000:2.0:1746147194.213569:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463964032 00000100:00100000:2.0:1746147194.213650:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12165 00000100:00100000:2.0:1746147194.213659:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+22:29209:x1830967463964032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.213673:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.213689:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e77fe expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.213714:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.213722:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.213724:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.213728:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.213754:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 18 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.213766:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 18 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.213778:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466487552:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.214042:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.215602:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466487552:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.215626:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 23 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.215641:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c52f200, rc 0) 00000100:00100000:2.0:1746147194.215691:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:29209:x1830967463964032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2032us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.215698:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12165 00000100:00100000:0.0:1746147194.216258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.216338:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463964160 00000100:00100000:1.0:1746147194.216344:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463964160 00002000:00100000:1.0:1746147194.216385:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (200704->532479) req@ffff88008d5ded80 x1830967463964160/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.216394:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ded80 with x1830967463964160 ext(200704->532479) 00010000:00010000:1.0:1746147194.216401:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 19 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.216413:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 19 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:1.0:1746147194.216421:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5ded80 00000100:00100000:1.0:1746147194.216447:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1618 00000100:00100000:1.0:1746147194.216454:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967463964160:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:1.0:1746147194.223879:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463964160:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7412us (7610us total) trans 21474840689 rc 0/0 00000100:00100000:1.0:1746147194.223892:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1618 00002000:00100000:1.0:1746147194.223905:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (200704->532479) req@ffff88008d5ded80 x1830967463964160/t21474840689(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.223915:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5ded80 with x1830967463964160 ext(200704->532479) 00010000:00010000:1.0:1746147194.223927:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.223967:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:1.0:1746147194.223974:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d5ded80 00000100:00100000:0.0:1746147194.226739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.226832:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463964288 00000100:00100000:1.0:1746147194.226842:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463964288 00010000:00010000:1.0:1746147194.226876:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.226920:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6064 00000100:00100000:1.0:1746147194.226927:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967463964288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.227069:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.227093:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.227106:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.227127:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f194c00/0xb4b2209fbdac7ec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->532479) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77d4 expref: 21 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.227157:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.227159:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.227166:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.227174:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.227205:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.227217:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466487680:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147194.227356:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.230973:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466487680:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147194.230998:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.231044:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967463964288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4116us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.231058:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6064 00000100:00100000:0.0:1746147194.236724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.236774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.236852:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463964544 00000100:00100000:1.0:1746147194.236862:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463964544 00002000:00100000:1.0:1746147194.236908:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008d5dce00 x1830967463964544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.236919:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967463964544 ext(0->1048575) 00002000:00010000:1.0:1746147194.236924:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dce00 00000100:00100000:1.0:1746147194.236969:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463964672 00000100:00100000:1.0:1746147194.236972:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463964672 00002000:00100000:1.0:1746147194.236983:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1642495) req@ffff88008d5dea00 x1830967463964672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.236990:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463964672 ext(1048576->1642495) 00000100:00100000:3.0:1746147194.236992:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4750 00002000:00010000:1.0:1746147194.236993:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:3.0:1746147194.237003:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463964544:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.237020:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4751 00000100:00100000:1.0:1746147194.237026:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967463964672:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.248115:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463964672:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11076us (11327us total) trans 0 rc 593920/593920 00000100:00100000:0.0:1746147194.248127:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4751 00002000:00100000:0.0:1746147194.248141:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1642495) req@ffff88008d5dea00 x1830967463964672/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.248150:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dea00 with x1830967463964672 ext(1048576->1642495) 00002000:00010000:0.0:1746147194.248156:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dea00 00000100:00100000:3.0:1746147194.249002:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463964544:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12000us (12285us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.249010:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4750 00002000:00100000:3.0:1746147194.249016:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88008d5dce00 x1830967463964544/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.249023:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d5dce00 with x1830967463964544 ext(0->1048575) 00002000:00010000:3.0:1746147194.249027:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d5dce00 00000100:00100000:0.0:1746147194.270777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.270909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.271018:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965056 00000100:00100000:3.0:1746147194.271027:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965056 00002000:00100000:3.0:1746147194.271072:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2670592->3719167) req@ffff88009f7cc380 x1830967463965056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.271082:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc380 with x1830967463965056 ext(2670592->3719167) 00002000:00010000:3.0:1746147194.271087:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cc380 00000100:00100000:3.0:1746147194.271112:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965312 00000100:00100000:3.0:1746147194.271113:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965312 00002000:00100000:3.0:1746147194.271121:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3719168->4194303) req@ffff88009f7cd500 x1830967463965312/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.271127:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd500 with x1830967463965312 ext(3719168->4194303) 00002000:00010000:3.0:1746147194.271129:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cd500 00000100:00100000:3.0:1746147194.271138:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4752 00000100:00100000:3.0:1746147194.271144:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1958:x1830967463965056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.273104:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4753 00000100:00100000:0.0:1746147194.273118:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463965312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.281930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.282871:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965440 00000100:00100000:2.0:1746147194.282882:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965440 00000100:00100000:2.0:1746147194.282957:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12166 00000100:00100000:2.0:1746147194.282965:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967463965440:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.282985:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.283000:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7805 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.283022:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.283024:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.283032:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.283047:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.283061:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173400, rc 0) 00000100:00100000:2.0:1746147194.283104:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463965440:12345-192.168.203.36@tcp:101:cat.0 Request processed in 140us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.283109:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12166 00000100:00100000:1.0:1746147194.283221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.283513:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965696 00000100:00100000:3.0:1746147194.283522:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965696 00000100:00100000:3.0:1746147194.283562:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12167 00000100:00100000:3.0:1746147194.283567:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463965696:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.283575:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.283583:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7f19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7813 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.283600:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7f19 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7813 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.283608:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678200/0xb4b2209fbdac7f19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7813 expref: 22 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.283622:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678200, rc 0) 00000100:00100000:3.0:1746147194.283641:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463965696:12345-192.168.203.36@tcp:101:cat.0 Request processed in 73us (420us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.283646:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12167 00000100:00100000:1.0:1746147194.284004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.284454:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463965056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13308us (13687us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.284463:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4752 00002000:00100000:1.0:1746147194.284472:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2670592->3719167) req@ffff88009f7cc380 x1830967463965056/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.284481:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cc380 with x1830967463965056 ext(2670592->3719167) 00002000:00010000:1.0:1746147194.284486:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cc380 00000100:00100000:3.0:1746147194.284705:0:17530:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965568 00000100:00100000:3.0:1746147194.284709:0:17530:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965568 00000100:00100000:3.0:1746147194.284738:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12168 00000100:00100000:3.0:1746147194.284744:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463965568:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.284753:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.284763:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7f20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e780c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.284812:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466487808:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.284879:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.287197:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967463965312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14076us (16279us total) trans 0 rc 475136/475136 00000100:00100000:0.0:1746147194.287211:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4753 00002000:00100000:0.0:1746147194.287221:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3719168->4194303) req@ffff88009f7cd500 x1830967463965312/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.287230:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cd500 with x1830967463965312 ext(3719168->4194303) 00002000:00010000:0.0:1746147194.287234:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cd500 00002000:00010000:3.0:1746147194.292729:0:17548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147192 -> 1746147193 00002000:00010000:3.0:1746147194.292739:0:17548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147192 -> 1746147194 00002000:00010000:3.0:1746147194.292740:0:17548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147192 -> 1746147193 00000100:00100000:3.0:1746147194.292774:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466487808:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147194.292809:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7f20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e780c expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.292824:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4678c00/0xb4b2209fbdac7f20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e780c expref: 22 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.292840:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4678c00, rc 0) 00000100:00100000:3.0:1746147194.294276:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1957:x1830967463965568:12345-192.168.203.36@tcp:101:cat.0 Request processed in 9515us (10255us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.294286:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12168 00000100:00100000:2.0:1746147194.294914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.295060:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463965824 00000100:00100000:3.0:1746147194.295068:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463965824 00000100:00100000:3.0:1746147194.295115:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12169 00000100:00100000:3.0:1746147194.295124:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463965824:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.295141:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.295159:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e781a expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.295186:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e781a expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.295195:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e781a expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.295210:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2e3000, rc 0) 00000100:00100000:3.0:1746147194.295320:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463965824:12345-192.168.203.36@tcp:101:cat.0 Request processed in 196us (407us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.295325:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12169 00000100:00100000:0.0:1746147194.299810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.299879:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966080 00000100:00100000:2.0:1746147194.299888:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966080 00002000:00100000:2.0:1746147194.299970:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f7cce00 x1830967463966080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.299981:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cce00 with x1830967463966080 ext(0->1048575) 00002000:00010000:2.0:1746147194.299986:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cce00 00000100:00100000:2.0:1746147194.300019:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4754 00000100:00100000:2.0:1746147194.300026:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463966080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.302411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.302514:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966208 00000100:00100000:3.0:1746147194.302523:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966208 00000100:00100000:3.0:1746147194.302570:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12170 00000100:00100000:3.0:1746147194.302578:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463966208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.302594:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.302612:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a310800/0xb4b2209fbdac7f2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7821 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.302644:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a310800/0xb4b2209fbdac7f2e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7821 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.302653:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a310800/0xb4b2209fbdac7f2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7821 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.302663:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a310800, rc 0) 00000100:00100000:3.0:1746147194.302713:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967463966208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 137us (310us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.302719:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12170 00000100:00100000:0.0:1746147194.311457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.312182:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966336 00000100:00100000:3.0:1746147194.312193:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966336 00000100:00100000:3.0:1746147194.312240:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12171 00000100:00100000:3.0:1746147194.312250:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463966336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.312269:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.312289:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7828 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.312321:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f35 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7828 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.312331:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2e3000/0xb4b2209fbdac7f35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7828 expref: 24 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.312363:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2e3000, rc 0) 00000100:00100000:3.0:1746147194.312408:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1959:x1830967463966336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 159us (961us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.312414:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12171 00000100:00100000:2.0:1746147194.316825:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1959:x1830967463966080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16787us (17014us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147194.316842:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4754 00002000:00100000:2.0:1746147194.316856:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff88009f7cce00 x1830967463966080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.316865:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cce00 with x1830967463966080 ext(0->1048575) 00002000:00010000:2.0:1746147194.316870:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7cce00 00000100:00100000:0.0:1746147194.321599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.321743:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966592 00000100:00100000:2.0:1746147194.321753:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966592 00000100:00100000:2.0:1746147194.321815:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4229 00000100:00100000:2.0:1746147194.321823:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+37:29209:x1830967463966592:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147194.322086:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+38:29209:x1830967463966592:12345-192.168.203.36@tcp:35:cat.0 Request processed in 262us (496us total) trans 8589944381 rc 0/0 00000100:00100000:2.0:1746147194.322092:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4229 00000100:00100000:0.0:1746147194.335045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.335279:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966720 00000100:00100000:2.0:1746147194.335288:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966720 00000100:00100000:2.0:1746147194.335443:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12172 00000100:00100000:2.0:1746147194.335451:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:29213:x1830967463966720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.335469:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.335485:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e782f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.335516:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.335523:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.335525:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.335528:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.335567:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 22 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.335579:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 22 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.335591:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466487936:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.335687:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.338931:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466487936:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.339004:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.339022:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173e00, rc 0) 00000100:00100000:2.0:1746147194.339083:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:29213:x1830967463966720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3632us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.339092:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12172 00000100:00100000:0.0:1746147194.339589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.339648:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966848 00000100:00100000:3.0:1746147194.339655:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966848 00002000:00100000:3.0:1746147194.339695:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1642496->2097151) req@ffff88009f7cdc00 x1830967463966848/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.339704:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cdc00 with x1830967463966848 ext(1642496->2097151) 00010000:00010000:3.0:1746147194.339712:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 23 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.339724:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 23 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.339730:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cdc00 00000100:00100000:3.0:1746147194.339765:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1619 00000100:00100000:3.0:1746147194.339773:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967463966848:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147194.349413:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463966848:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9629us (9812us total) trans 21474840690 rc 0/0 00000100:00100000:3.0:1746147194.349426:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1619 00002000:00100000:3.0:1746147194.349438:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1642496->2097151) req@ffff88009f7cdc00 x1830967463966848/t21474840690(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.349448:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7cdc00 with x1830967463966848 ext(1642496->2097151) 00010000:00010000:3.0:1746147194.349459:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.349475:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.349482:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7cdc00 00000100:00100000:0.0:1746147194.355568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.355658:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463966976 00000100:00100000:1.0:1746147194.355667:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463966976 00010000:00010000:1.0:1746147194.355704:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.355741:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6065 00000100:00100000:1.0:1746147194.355749:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463966976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.355764:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.355785:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.355796:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.355820:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e216e00/0xb4b2209fbdac7ecc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77db expref: 25 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.355849:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.355851:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.355859:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.355866:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.355899:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.356052:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466488064:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147194.356663:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.358793:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466488064:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147194.358810:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.358852:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1957:x1830967463966976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3103us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.358862:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6065 00000100:00100000:0.0:1746147194.361413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.361480:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463967232 00000100:00100000:3.0:1746147194.361490:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463967232 00002000:00100000:3.0:1746147194.361532:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5c9880 x1830967463967232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.361542:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9880 with x1830967463967232 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.361559:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9880 00000100:00100000:3.0:1746147194.362056:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4755 00000100:00100000:3.0:1746147194.362065:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463967232:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.369388:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463967232:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7312us (7972us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.369402:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4755 00002000:00100000:3.0:1746147194.369414:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88008e5c9880 x1830967463967232/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.369423:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9880 with x1830967463967232 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.369429:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9880 00000100:00100000:0.0:1746147194.378667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.378735:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463967360 00000100:00100000:2.0:1746147194.378745:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463967360 00000100:00100000:2.0:1746147194.378811:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12173 00000100:00100000:2.0:1746147194.378820:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:29213:x1830967463967360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.378841:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.378859:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7836 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.378890:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.378898:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.378900:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.378903:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.378933:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 23 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.378988:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 23 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.379001:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466488192:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.379101:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.385086:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466488192:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.385121:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 23 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.385139:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b173200, rc 0) 00000100:00100000:0.0:1746147194.385932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.386010:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:29213:x1830967463967360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7190us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.386019:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12173 00000100:00100000:3.0:1746147194.386222:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463967488 00000100:00100000:3.0:1746147194.386230:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463967488 00002000:00100000:3.0:1746147194.386269:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2670591) req@ffff88008e5c9c00 x1830967463967488/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.386279:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9c00 with x1830967463967488 ext(2097152->2670591) 00010000:00010000:3.0:1746147194.386287:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 24 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.386300:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 24 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.386307:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9c00 00000100:00100000:3.0:1746147194.386841:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1620 00000100:00100000:3.0:1746147194.386849:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1959:x1830967463967488:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147194.406499:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463967488:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19635us (21554us total) trans 21474840691 rc 0/0 00000100:00100000:3.0:1746147194.406515:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1620 00002000:00100000:3.0:1746147194.406532:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2670591) req@ffff88008e5c9c00 x1830967463967488/t21474840691(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.406558:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9c00 with x1830967463967488 ext(2097152->2670591) 00010000:00010000:3.0:1746147194.406572:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.406591:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.406599:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e5c9c00 00000100:00100000:0.0:1746147194.412617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.413397:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463967616 00000100:00100000:1.0:1746147194.413407:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463967616 00010000:00010000:1.0:1746147194.413443:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.413559:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6066 00000100:00100000:1.0:1746147194.413567:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463967616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.413581:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147194.413599:0:16058:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147193 -> 1746147194 00010000:00010000:1.0:1746147194.413604:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.413616:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.413636:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ea41a00/0xb4b2209fbdac7ed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2670591) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77e2 expref: 26 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.415836:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.415844:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.415858:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.415870:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.415930:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.415960:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466488320:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147194.416163:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.421442:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466488320:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147194.421465:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.421525:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1959:x1830967463967616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7957us (8917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.421536:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6066 00000100:00100000:0.0:1746147194.427366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.427469:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463967872 00000100:00100000:2.0:1746147194.427479:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463967872 00002000:00100000:2.0:1746147194.427530:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c8700 x1830967463967872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.427541:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967463967872 ext(2097152->3145727) 00002000:00010000:2.0:1746147194.427558:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8700 00000100:00100000:2.0:1746147194.427631:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4756 00000100:00100000:2.0:1746147194.427640:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463967872:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.430812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.431884:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968128 00000100:00100000:1.0:1746147194.431895:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968128 00002000:00100000:1.0:1746147194.431952:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e5c9500 x1830967463968128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.431963:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9500 with x1830967463968128 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.431968:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9500 00000100:00100000:1.0:1746147194.432000:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4757 00000100:00100000:1.0:1746147194.432010:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463968128:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.440181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.440354:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968256 00000100:00100000:2.0:1746147194.440364:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968256 00000100:00080000:1.0:1746147194.440471:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147194.442711:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12174 00000100:00100000:2.0:1746147194.442727:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:29216:x1830967463968256:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147194.442746:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.442766:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e783d expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.442797:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.442805:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.442812:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.442813:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.442817:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1327104->1855487] (req 1327104->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 39 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.442844:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 16 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.442856:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 16 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.442867:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466488448:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.443277:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463967872:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15637us (15920us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.443286:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4756 00002000:00100000:3.0:1746147194.443295:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88008e5c8700 x1830967463967872/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.443303:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c8700 with x1830967463967872 ext(2097152->3145727) 00002000:00010000:3.0:1746147194.443307:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c8700 00010000:00010000:2.0:1746147194.443468:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.443480:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.443488:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466488576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.443516:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.443759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.443841:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968512 00000100:00100000:3.0:1746147194.443847:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968512 00000100:00100000:3.0:1746147194.443882:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10609 00000100:00100000:3.0:1746147194.443887:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+38:29218:x1830967463968512:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147194.443900:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.443911:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344600/0xb4b2209fbdac7f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7844 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.444412:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444427:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444438:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444451:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444456:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444461:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444571:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac7f66 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444579:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac7f66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444584:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac7f66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147194.444593:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147194.444668:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444674:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444680:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444689:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5344200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.444693:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444699:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444709:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147194.444711:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.444715:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444720:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344200/0xb4b2209fbdac7f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444750:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444755:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444759:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444763:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2e2200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.444765:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444769:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444775:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76900) 00010000:00010000:3.0:1746147194.444777:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.444779:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444783:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2e2200/0xb4b2209fbdac7f5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.444813:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344600/0xb4b2209fbdac7f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7844 expref: 41 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.444822:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac7f66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7844 expref: 40 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.444828:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.444829:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147194.444831:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fbe00, rc 0) 00000100:00100000:3.0:1746147194.444858:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+40:29218:x1830967463968512:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 970us (1100us total) trans 8589944382 rc 0/0 00000100:00100000:3.0:1746147194.444863:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10609 00000100:00100000:0.0:1746147194.447485:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463968128:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15466us (16673us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147194.447496:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4757 00002000:00100000:0.0:1746147194.447507:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88008e5c9500 x1830967463968128/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.447516:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e5c9500 with x1830967463968128 ext(3145728->4194303) 00002000:00010000:0.0:1746147194.447522:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e5c9500 00000100:00100000:0.0:1746147194.449063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.449107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.450305:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466488448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.450317:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466488576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.450349:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1327104->1855487] (req 1327104->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 39 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.450368:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b172e00, rc 0) 00000100:00100000:2.0:1746147194.450409:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+39:29216:x1830967463968256:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7688us (10238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.450417:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12174 00000100:00100000:0.0:1746147194.451021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.451087:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968640 00000100:00100000:1.0:1746147194.451093:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968640 00010000:00010000:1.0:1746147194.451124:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.451146:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968768 00000100:00100000:1.0:1746147194.451149:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968768 00000100:00100000:2.0:1746147194.451156:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6067 00010000:00010000:1.0:1746147194.451158:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.451162:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463968640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147194.451171:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6068 00010000:00010000:2.0:1746147194.451175:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147194.451175:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463968768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.451180:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.451195:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.451195:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.451204:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.451258:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463968896 00000100:00100000:0.0:1746147194.451261:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463968896 00010000:00010000:2.0:1746147194.451295:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.451314:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 604 00000100:00100000:0.0:1746147194.451319:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+40:1956:x1830967463968896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.451321:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e600/0xb4b2209fbdac7e8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b8 expref: 17 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.451326:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.451338:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb4b2209fbdac7f66 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7844 expref: 40 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.451389:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1aade00/0xb4b2209fbdac7e86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77b1 expref: 39 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.451389:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.451391:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.451398:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.451406:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.451436:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147194.451452:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.451457:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463968640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 296us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.451462:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6067 00000100:00100000:1.0:1746147194.451464:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466488704:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147194.451554:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.451567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.451600:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463969024 00000100:00100000:3.0:1746147194.451604:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463969024 00000100:00100000:3.0:1746147194.451630:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12175 00000100:00100000:3.0:1746147194.451634:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29218:x1830967463969024:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147194.451649:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.451662:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e784b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.451680:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.451691:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.451692:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.451695:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1474560->1515519] (req 1474560->1515519) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.451712:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 22 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.451722:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 22 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.451730:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466488832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.451754:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00010000:00010000:0.0:1746147194.451802:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147194.451806:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.451825:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+39:1956:x1830967463968896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 502us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.451830:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 604 00000100:00100000:0.0:1746147194.452020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.452053:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463969152 00000100:00100000:3.0:1746147194.452056:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463969152 00000100:00100000:3.0:1746147194.452072:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12176 00000100:00100000:3.0:1746147194.452076:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463969152:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.452083:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.452090:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0xb4b2209fbdac7f7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7852 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.452114:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466488960:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.452412:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.453910:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466488704:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147194.453927:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.453990:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463968768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2812us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.453998:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6068 00000100:00100000:3.0:1746147194.454067:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466488832:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.454087:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1474560->1515519] (req 1474560->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.454100:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129efe400, rc 0) 00000100:00100000:3.0:1746147194.454125:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29218:x1830967463969024:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 2489us (2557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.454130:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12175 00000100:00100000:0.0:1746147194.456587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.456639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.456700:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463969536 00000100:00100000:2.0:1746147194.456710:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463969536 00002000:00100000:2.0:1746147194.456754:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1327104->1331199) req@ffff8800a5ba1f80 x1830967463969536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.456763:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1f80 with x1830967463969536 ext(1327104->1331199) 00002000:00010000:2.0:1746147194.456769:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1f80 00000100:00100000:1.0:1746147194.456819:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463969280 00000100:00100000:1.0:1746147194.456823:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463969280 00010000:00010000:1.0:1746147194.456843:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 23 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.456866:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6069 00000100:00100000:1.0:1746147194.456873:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463969280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.456888:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.456909:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 23 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.456927:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 23 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.456978:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b173e00/0xb4b2209fbdac7f3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e782f expref: 23 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.457128:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4758 00000100:00100000:2.0:1746147194.457136:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463969536:12345-192.168.203.36@tcp:3:multiop.0 00010000:00010000:1.0:1746147194.457287:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.457289:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.457296:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.457304:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.457362:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.457373:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466489088:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147194.457532:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463969536:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 395us (891us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.457541:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00002000:00010000:3.0:1746147194.457739:0:4444:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147194.457742:0:4444:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147194.457744:0:4444:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime: 1746147193 -> 1746147194 00000100:00100000:3.0:1746147194.457754:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466488960:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147194.457778:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0xb4b2209fbdac7f7b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7852 expref: 40 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.457788:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0xb4b2209fbdac7f7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7852 expref: 40 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.457800:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5800, rc 0) 00000100:00100000:3.0:1746147194.457821:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463969152:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5744us (5800us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.457828:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12176 00000100:00100000:2.0:1746147194.457874:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4758 00002000:00100000:2.0:1746147194.457881:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1327104->1331199) req@ffff8800a5ba1f80 x1830967463969536/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.457888:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba1f80 with x1830967463969536 ext(1327104->1331199) 00002000:00010000:2.0:1746147194.457891:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba1f80 00000100:00100000:2.0:1746147194.460414:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f76e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466489088:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147194.460434:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.460486:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967463969280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3612us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.460497:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6069 00000100:00100000:0.0:1746147194.463237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.463268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.463295:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463969792 00000100:00100000:2.0:1746147194.463304:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463969792 00002000:00100000:2.0:1746147194.463350:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1474560->1478655) req@ffff8800a5ba0e00 x1830967463969792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.463360:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0e00 with x1830967463969792 ext(1474560->1478655) 00002000:00010000:2.0:1746147194.463366:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0e00 00000100:00100000:2.0:1746147194.463383:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463970176 00000100:00100000:2.0:1746147194.463385:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463970176 00002000:00100000:2.0:1746147194.463398:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a5ba2680 x1830967463970176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147194.463399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1746147194.463404:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2680 with x1830967463970176 ext(4194304->4947967) 00002000:00010000:2.0:1746147194.463407:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba2680 00000100:00100000:2.0:1746147194.463808:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463970304 00000100:00100000:2.0:1746147194.463811:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463970304 00002000:00100000:2.0:1746147194.463825:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1851392->1855487) req@ffff8800a5ba3480 x1830967463970304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.463832:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967463970304 ext(1851392->1855487) 00002000:00010000:2.0:1746147194.463835:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3480 00000100:00100000:2.0:1746147194.463846:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4759 00000100:00100000:2.0:1746147194.463852:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463969792:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147194.464030:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4760 00000100:00100000:1.0:1746147194.464037:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463970176:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.464064:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4761 00000100:00100000:0.0:1746147194.464071:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463970304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.464194:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463970304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 123us (793us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147194.464199:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4761 00002000:00100000:0.0:1746147194.464204:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1851392->1855487) req@ffff8800a5ba3480 x1830967463970304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.464209:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba3480 with x1830967463970304 ext(1851392->1855487) 00002000:00010000:0.0:1746147194.464212:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ba3480 00000100:00100000:2.0:1746147194.464689:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463969792:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 832us (1456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147194.464694:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4759 00002000:00100000:2.0:1746147194.464699:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1474560->1478655) req@ffff8800a5ba0e00 x1830967463969792/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.464705:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba0e00 with x1830967463969792 ext(1474560->1478655) 00002000:00010000:2.0:1746147194.464708:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba0e00 00000100:00100000:1.0:1746147194.469752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.469822:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463970560 00000100:00100000:3.0:1746147194.469832:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463970560 00002000:00100000:3.0:1746147194.469875:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1511424->1515519) req@ffff88009f76dc00 x1830967463970560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.469885:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76dc00 with x1830967463970560 ext(1511424->1515519) 00002000:00010000:3.0:1746147194.469891:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76dc00 00000100:00100000:3.0:1746147194.469923:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4762 00000100:00100000:3.0:1746147194.469930:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463970560:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147194.470122:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1959:x1830967463970560:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 192us (381us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147194.470129:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4762 00002000:00100000:3.0:1746147194.470135:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1511424->1515519) req@ffff88009f76dc00 x1830967463970560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.470142:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f76dc00 with x1830967463970560 ext(1511424->1515519) 00002000:00010000:3.0:1746147194.470145:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f76dc00 00000100:00100000:1.0:1746147194.472163:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463970176:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8119us (8886us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746147194.472174:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4760 00002000:00100000:1.0:1746147194.472185:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a5ba2680 x1830967463970176/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.472193:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ba2680 with x1830967463970176 ext(4194304->4947967) 00002000:00010000:1.0:1746147194.472198:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ba2680 00000100:00100000:0.0:1746147194.473902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.475176:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463970816 00000100:00100000:3.0:1746147194.475188:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463970816 00000100:00100000:3.0:1746147194.475248:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4230 00000100:00100000:3.0:1746147194.475263:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+39:29218:x1830967463970816:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147194.475488:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+40:29218:x1830967463970816:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 231us (1594us total) trans 8589944383 rc 0/0 00000100:00100000:3.0:1746147194.475495:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4230 00000100:00100000:0.0:1746147194.477514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.477676:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463970944 00000100:00100000:3.0:1746147194.477685:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463970944 00000100:00100000:3.0:1746147194.477724:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12177 00000100:00100000:3.0:1746147194.477730:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463970944:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.477748:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.477765:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7f82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7859 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.477817:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466489216:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.479064:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00002000:00010000:3.0:1746147194.482035:0:4444:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147194.482045:0:4444:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147193 -> 1746147194 00000100:00100000:3.0:1746147194.482070:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466489216:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147194.482103:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7f82 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7859 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.482116:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7f82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7859 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.482352:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb1000, rc 0) 00000100:00100000:3.0:1746147194.482505:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463970944:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4771us (4995us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.482514:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12177 00000100:00100000:0.0:1746147194.484581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.484660:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971072 00000100:00100000:3.0:1746147194.484669:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971072 00000100:00100000:3.0:1746147194.484706:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12178 00000100:00100000:3.0:1746147194.484713:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463971072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.484729:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.484744:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7860 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.484798:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466489344:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.484881:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.486126:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466489344:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147194.486152:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f89 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7860 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.486162:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7860 expref: 23 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.486172:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb1600, rc 0) 00000100:00100000:3.0:1746147194.486197:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463971072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1485us (1624us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.486204:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12178 00000100:00100000:0.0:1746147194.522539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.522907:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971200 00000100:00100000:3.0:1746147194.522918:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971200 00000100:00100000:3.0:1746147194.523227:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10610 00000100:00100000:3.0:1746147194.523236:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+16:29222:x1830967463971200:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147194.523261:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.523279:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac7f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7867 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.523340:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523351:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523360:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523374:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523383:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523388:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523593:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523604:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 322 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.523610:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.523640:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 322 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.523651:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 322 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.523662:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466489472:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.523850:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.527163:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466489472:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.527200:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000100:00100000:0.0:1746147194.530658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.531359:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971456 00000100:00100000:2.0:1746147194.531369:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971456 00000100:00100000:2.0:1746147194.531450:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4231 00000100:00100000:2.0:1746147194.531459:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+323:7642:x1830967463971456:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147194.531702:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+324:7642:x1830967463971456:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 243us (1051us total) trans 8589944384 rc 0/0 00000100:00100000:2.0:1746147194.531710:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4231 00000100:00080000:1.0:1746147194.531803:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147194.536579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.536678:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971584 00000100:00100000:2.0:1746147194.536687:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971584 00010000:00010000:2.0:1746147194.536733:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 324 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.536762:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6070 00000100:00100000:2.0:1746147194.536770:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1957:x1830967463971584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.536786:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.536791:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 324 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.536923:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 324 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.538221:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e99f200/0xb4b2209fbdac7e40 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e778e expref: 324 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.538252:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.538257:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.538266:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.538273:0:16058:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.538309:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.538381:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+323:1957:x1830967463971584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1611us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.538390:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6070 00010000:00010000:3.0:1746147194.538732:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538744:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147194.538790:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:3.0:1746147194.538795:0:14125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147194.538812:0:14125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538821:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538830:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538835:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538841:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538846:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094eb0800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.538850:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538855:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538864:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147194.538867:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.538870:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538875:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb0800/0xb4b2209fbdac7f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538904:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538909:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538913:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538916:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094eb1600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.538919:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538924:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538930:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76e00) 00010000:00010000:3.0:1746147194.538932:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.538958:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538963:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac7f9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.538999:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac7f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.539009:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.539015:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.539018:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147194.539020:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb1000, rc 0) 00000100:00100000:3.0:1746147194.539060:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:29222:x1830967463971200:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 15825us (16531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.539067:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10610 00000100:00100000:2.0:1746147194.544678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.544716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.544729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.544760:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971840 00000100:00100000:2.0:1746147194.544762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.544771:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971840 00000100:00100000:2.0:1746147194.544782:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972096 00000100:00100000:2.0:1746147194.544785:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972096 00000100:00100000:3.0:1746147194.544811:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971712 00000100:00100000:3.0:1746147194.544814:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971712 00000100:00100000:2.0:1746147194.545019:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463971968 00000100:00100000:2.0:1746147194.545023:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463971968 00000100:00100000:3.0:1746147194.545029:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12179 00000100:00100000:3.0:1746147194.545038:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463971840:12345-192.168.203.36@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147194.545042:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12180 00000100:00100000:2.0:1746147194.545048:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463972096:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147194.545057:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.545057:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.545073:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5345c00/0xb4b2209fbdac7fac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7875 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.545073:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7883 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.545094:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.545096:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.545105:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.545119:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 13 pid: 4445 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147194.545124:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466489600:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147194.545130:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092905400, rc 0) 00000100:00100000:1.0:1746147194.545188:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12181 00000100:00100000:1.0:1746147194.545194:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967463971712:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147194.545201:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.545208:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e786e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.545216:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.545218:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.545222:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.545230:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 14 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.545236:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131045c00, rc 0) 00000100:00100000:0.0:1746147194.545275:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12182 00000100:00100000:0.0:1746147194.545282:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463971968:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147194.545288:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.545295:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5179000/0xb4b2209fbdac7fc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e787c expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.545318:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466489728:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.545385:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.545385:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.545457:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60817ea3-97af-43a7-ab2a-b628d12800db+15:1959:x1830967463971712:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 262us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.545463:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12181 00000100:00100000:2.0:1746147194.545884:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+14:1959:x1830967463972096:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 833us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.545889:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12180 00000100:00100000:0.0:1746147194.548158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.548207:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972352 00000100:00100000:3.0:1746147194.548214:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972352 00000100:00100000:3.0:1746147194.548256:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10611 00000100:00100000:3.0:1746147194.548264:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+40:29225:x1830967463972352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.548286:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.548304:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac7fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e788a expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.548308:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466489728:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147194.548335:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5179000/0xb4b2209fbdac7fc1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e787c expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.548353:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5179000/0xb4b2209fbdac7fc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e787c expref: 13 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.548370:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5179000, rc 0) 00010000:00010000:3.0:1746147194.548403:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00000100:00100000:1.0:1746147194.548406:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463971968:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 3125us (3643us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.548412:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12182 00010000:00010000:3.0:1746147194.548418:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548427:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548438:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548443:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548448:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548544:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548562:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548568:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:3.0:1746147194.548576:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147194.548656:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548662:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548668:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548676:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.548680:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548686:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548695:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147194.548697:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.548700:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548704:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac7fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548711:0:14125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548715:0:14125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548719:0:14125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548723:0:14125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a4a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147194.548724:0:14125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548728:0:14125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548732:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092d76400) 00010000:00010000:3.0:1746147194.548733:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147194.548736:0:14125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548740:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac7fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.548770:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac7fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 43 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.548778:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 42 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.548784:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.548786:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147194.548787:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4400, rc 0) 00000100:00100000:3.0:1746147194.548821:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+42:29225:x1830967463972352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 557us (675us total) trans 8589944385 rc 0/0 00000100:00100000:3.0:1746147194.548827:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10611 00000100:00100000:1.0:1746147194.549266:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466489600:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147194.549287:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5345c00/0xb4b2209fbdac7fac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7875 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.549297:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5345c00/0xb4b2209fbdac7fac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7875 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.549306:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5345c00, rc 0) 00000100:00100000:1.0:1746147194.549328:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463971840:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 4291us (4661us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.549334:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12179 00000100:00100000:1.0:1746147194.549666:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147194.549680:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466489856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147194.549720:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147194.549807:0:8483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466489856 00000100:00100000:2.0:1746147194.549812:0:8483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466489856 00000100:00100000:2.0:1746147194.549849:0:8483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1746147194.549855:0:8483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466489856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746147194.549870:0:8483:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 532742144 pending 22151168 free 3839885312 avail 3837788160 00000100:00100000:2.0:1746147194.549899:0:8483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466489856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.549905:0:8483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1746147194.549959:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147194.550024:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840672 gen 2 00000004:00080000:0.0:1746147194.550030:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975880, transno 21474840655 00000004:00080000:0.0:1746147194.550043:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f452d80, transno 21474840656 00000004:00080000:0.0:1746147194.550045:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975f80, transno 21474840657 00000004:00080000:0.0:1746147194.550047:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975180, transno 21474840658 00000004:00080000:0.0:1746147194.550050:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e974000, transno 21474840659 00000004:00080000:0.0:1746147194.550052:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977800, transno 21474840660 00000004:00080000:0.0:1746147194.550055:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e975500, transno 21474840661 00000004:00080000:0.0:1746147194.550057:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f450380, transno 21474840662 00000004:00080000:0.0:1746147194.550059:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef7d500, transno 21474840663 00000004:00080000:0.0:1746147194.550062:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcb480, transno 21474840664 00000004:00080000:0.0:1746147194.550064:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc9c00, transno 21474840665 00000004:00080000:0.0:1746147194.550066:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcb100, transno 21474840666 00000004:00080000:0.0:1746147194.550068:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcaa00, transno 21474840667 00000004:00080000:0.0:1746147194.550070:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc8700, transno 21474840668 00000004:00080000:0.0:1746147194.550073:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ecec380, transno 21474840669 00000004:00080000:0.0:1746147194.550076:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6571880, transno 21474840670 00000004:00080000:0.0:1746147194.550078:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc8a80, transno 21474840671 00000004:00080000:0.0:1746147194.550080:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6571500, transno 21474840672 00000100:00100000:0.0:1746147194.550088:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466489856:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1746147194.550376:0:14090:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 16 done 00000100:00100000:0.0:1746147194.551422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.551466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.552242:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972608 00000100:00100000:1.0:1746147194.552250:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972608 00000100:00100000:1.0:1746147194.552289:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972480 00000100:00100000:1.0:1746147194.552291:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972480 00000100:00100000:1.0:1746147194.552307:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12183 00000100:00100000:1.0:1746147194.552313:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463972608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147194.552327:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.552344:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7898 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.552906:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12184 00000100:00100000:3.0:1746147194.552917:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463972480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.552927:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.552956:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bbe00/0xb4b2209fbdac7ff2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7891 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.553012:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466489984:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147194.553098:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147194.553152:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.553154:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.553164:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.553179:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.553190:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb0600, rc 0) 00000100:00100000:1.0:1746147194.553214:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463972608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 901us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.553220:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12183 00000100:00100000:0.0:1746147194.553432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.553449:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972864 00000100:00100000:3.0:1746147194.553454:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972864 00000100:00100000:3.0:1746147194.553520:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10612 00000100:00100000:3.0:1746147194.553525:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+17:29222:x1830967463972864:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147194.553535:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.553554:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac7ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e789f expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.553653:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.553666:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.553672:0:14125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 41 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.553678:0:14125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:3.0:1746147194.553698:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 41 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.553709:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 41 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.553718:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466490112:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.553752:0:14125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.553759:0:14125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 18 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.553767:0:14125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466490240:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.553784:0:14125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.558453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.558494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.558822:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463972992 00000100:00100000:0.0:1746147194.558831:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463972992 00010000:00010000:0.0:1746147194.558869:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 42 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.558895:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973120 00000100:00100000:0.0:1746147194.558898:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973120 00010000:00010000:0.0:1746147194.558908:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.558956:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6071 00000100:00100000:0.0:1746147194.558965:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+42:1957:x1830967463972992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.558979:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.558985:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 42 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.558996:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 42 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.559018:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147194.559023:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147194.559030:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147194.559036:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.559080:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+42:1957:x1830967463972992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 116us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.559087:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6071 00000100:00100000:0.0:1746147194.559102:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6072 00000100:00100000:0.0:1746147194.559107:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463973120:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.559114:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.559119:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.559127:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.559142:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147194.559145:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147194.559152:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147194.559158:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 00010000:00010000:0.0:1746147194.559176:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.559191:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463973120:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.559197:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6072 00010000:00010000:2.0:1746147194.559738:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4400/0xb4b2209fbdac7fdd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e788a expref: 41 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.559770:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466490112:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.559783:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1000/0xb4b2209fbdac7fa5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7867 expref: 18 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.559793:0:14125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14125:1830967466490240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.559821:0:14125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.559830:0:14125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.559834:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147194.559853:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147194.560022:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd9d600/0xb4b2209fbdac7ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e789f expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.560034:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e789f expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.560041:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.560044:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147194.560046:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e48c400, rc 0) 00000100:00100000:2.0:1746147194.560080:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+18:29222:x1830967463972864:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 6555us (6648us total) trans 8589944386 rc 0/0 00000100:00100000:2.0:1746147194.560088:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10612 00000100:00100000:3.0:1746147194.560386:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466489984:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147194.560407:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bbe00/0xb4b2209fbdac7ff2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7891 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.560419:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bbe00/0xb4b2209fbdac7ff2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7891 expref: 17 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.560426:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bbe00, rc 0) 00000100:00100000:3.0:1746147194.560716:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463972480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7800us (9247us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147194.560723:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12184 00000100:00100000:0.0:1746147194.562582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.562660:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973376 00000100:00100000:2.0:1746147194.562668:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973376 00000100:00100000:2.0:1746147194.562714:0:14125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10613 00000100:00100000:2.0:1746147194.562721:0:14125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+18:29222:x1830967463973376:12345-192.168.203.36@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147194.562744:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.562746:0:14125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147194.562768:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48c400/0xb4b2209fbdac8000 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e789f expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.562784:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.562788:0:14125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147194.562799:0:14125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac800e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78a6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.562882:0:14125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.562894:0:14125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 00010000:00010000:2.0:1746147194.562903:0:14125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 00000004:00200000:2.0:1746147194.562913:0:14125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147194.563036:0:14125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904800/0xb4b2209fbdac800e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.563047:0:14125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.563053:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.563056:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147194.563058:0:14125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904200, rc 0) 00000100:00100000:2.0:1746147194.563097:0:14125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60817ea3-97af-43a7-ab2a-b628d12800db+19:29222:x1830967463973376:12345-192.168.203.36@tcp:101:mirror_io.0 Request processed in 376us (521us total) trans 8589944387 rc 0/0 00000100:00100000:2.0:1746147194.563103:0:14125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10613 00000100:00100000:2.0:1746147194.565412:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967466490496:0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.565466:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147194.565496:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147194.565501:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466490368:0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.565530:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147194.565574:0:14045:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466490368 00000100:00100000:2.0:1746147194.565580:0:14045:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466490368 00000100:00100000:2.0:1746147194.565610:0:14045:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1746147194.565617:0:14045:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009343f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967466490368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.565652:0:14045:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009343f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b57d6275-d138-4373-818f-9bad59bb9e6f+18:3296:x1830967466490368:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.565657:0:14045:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1746147194.565697:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b57d6275-d138-4373-818f-9bad59bb9e6f:3296:1830967466490368:0@lo:400:kworker.0 00000100:00100000:0.0:1746147194.566817:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147194.566861:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147194.566905:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147194.566912:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967466490752:0@lo:400:kworker.0 00000100:00100000:3.0:1746147194.566923:0:11221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466490624 00000100:00100000:3.0:1746147194.566928:0:11221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466490624 00000100:00100000:0.0:1746147194.566932:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147194.566979:0:11221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1746147194.566985:0:11221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466490624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746147194.567015:0:11221:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 471269376 pending 22151168 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746147194.567061:0:11221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830967466490624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.567067:0:11221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1746147194.567294:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147194.567357:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873262 gen 2 00000004:00080000:0.0:1746147194.567363:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e587480, transno 17179873247 00000004:00080000:0.0:1746147194.567370:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e977b80, transno 17179873248 00000004:00080000:0.0:1746147194.567372:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e585500, transno 17179873249 00000004:00080000:0.0:1746147194.567374:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e586d80, transno 17179873250 00000004:00080000:0.0:1746147194.567376:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e584a80, transno 17179873251 00000004:00080000:0.0:1746147194.567378:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e585f80, transno 17179873252 00000004:00080000:0.0:1746147194.567380:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e585180, transno 17179873253 00000004:00080000:0.0:1746147194.567384:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e586a00, transno 17179873254 00000004:00080000:0.0:1746147194.567386:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0c380, transno 17179873255 00000004:00080000:0.0:1746147194.567388:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0ce00, transno 17179873256 00000004:00080000:0.0:1746147194.567390:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0fb80, transno 17179873257 00000004:00080000:0.0:1746147194.567392:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0df80, transno 17179873258 00000004:00080000:0.0:1746147194.567394:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0c000, transno 17179873259 00000004:00080000:0.0:1746147194.567396:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0ea00, transno 17179873260 00000004:00080000:0.0:1746147194.567399:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0d880, transno 17179873261 00000004:00080000:0.0:1746147194.567401:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5a0d500, transno 17179873262 00000100:00100000:0.0:1746147194.567410:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746147194.568434:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466490880:0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147194.568491:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147194.568496:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830967466491008:0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568513:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147194.568543:0:14125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466490496 00000100:00100000:2.0:1746147194.568558:0:14125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466490496 00000100:00100000:0.0:1746147194.568558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:2.0:1746147194.568576:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147194.568578:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466490880 00000100:00100000:0.0:1746147194.568581:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466490880 00000100:00100000:2.0:1746147194.568598:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466490752 00000100:00100000:2.0:1746147194.568600:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466490752 00000100:00100000:0.0:1746147194.568603:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973504 00000100:00100000:0.0:1746147194.568605:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973504 00000100:00100000:2.0:1746147194.568618:0:14047:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466491008 00000100:00100000:2.0:1746147194.568619:0:14047:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466491008 00000100:00100000:2.0:1746147194.568628:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1746147194.568632:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967466490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147194.568633:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1746147194.568660:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830967466490496:12345-0@lo:400:kworker.0 Request processed in 28us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.568663:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1746147194.568669:0:14047:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1746147194.568672:0:14047:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830967466491008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568683:0:14047:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830967466491008:12345-0@lo:400:kworker.0 Request processed in 11us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.568685:0:14047:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1746147194.568693:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147194.568704:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830967466490496:0@lo:400:kworker.0 00000100:00100000:0.0:1746147194.568713:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967466490752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568715:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830967466491008:0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568723:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1746147194.568726:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466490880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147194.568740:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3295:x1830967466490880:12345-0@lo:400:kworker.0 Request processed in 14us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.568744:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746147194.568748:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830967466490752:12345-0@lo:400:kworker.0 Request processed in 110us (1814us total) trans 0 rc 0/0 00000004:00080000:3.0:1746147194.568750:0:14094:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 16 done 00000100:00100000:2.0:1746147194.568754:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466490880:0@lo:400:kworker.0 00000100:00100000:0.0:1746147194.568755:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1746147194.568780:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12185 00000100:00100000:0.0:1746147194.568785:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29225:x1830967463973504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147194.568794:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147194.568836:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830967466490752:0@lo:400:kworker.0 00010000:00010000:0.0:1746147194.568892:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78ad expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.568918:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 37 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.568929:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.568931:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.568934:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 17 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.569000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.569014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.569045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.569058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.569073:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973760 00000100:00100000:1.0:1746147194.569075:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973760 00000100:00100000:1.0:1746147194.569091:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974016 00000100:00100000:1.0:1746147194.569093:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974016 00000100:00100000:1.0:1746147194.569102:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974272 00000100:00100000:1.0:1746147194.569104:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974272 00000100:00100000:1.0:1746147194.569112:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973632 00000100:00100000:1.0:1746147194.569113:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973632 00000100:00100000:1.0:1746147194.569131:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12186 00000100:00100000:1.0:1746147194.569136:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463973760:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147194.569165:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.569237:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12187 00000100:00100000:3.0:1746147194.569244:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967463974016:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147194.569264:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569276:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569282:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147194.569283:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147194.569286:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569310:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569322:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.569332:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466491136:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.569384:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.569400:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12188 00000100:00100000:3.0:1746147194.569406:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463974272:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147194.569421:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569432:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569444:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569451:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569456:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.569457:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.569459:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569472:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569480:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 11 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.569488:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491264:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.569513:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 37 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569520:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 37 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.569527:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491392:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.569561:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569569:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.569577:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491520:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.569592:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.569605:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12189 00000100:00100000:3.0:1746147194.569611:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1957:x1830967463973632:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147194.569625:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569635:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569642:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569648:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569653:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.569655:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.569657:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.569675:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 21 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569683:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 21 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.569690:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491648:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.569711:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 13 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.569719:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 13 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.569726:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491776:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.569743:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.569749:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147194.569750:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 26 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.569754:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 17 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.569757:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491904:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147194.569760:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147194.569761:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.569771:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147194.569780:0:8481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 17 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.569789:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.569825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.569888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.570353:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463973888 00000100:00100000:0.0:1746147194.570358:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463973888 00000100:00100000:0.0:1746147194.570375:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974144 00000100:00100000:0.0:1746147194.570377:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974144 00000100:00100000:0.0:1746147194.570390:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12190 00000100:00100000:0.0:1746147194.570395:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463973888:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147194.570412:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570422:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570428:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 37 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570434:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570439:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.570440:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.570442:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570461:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 12 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570470:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 12 pid: 4445 timeout: 681 lvb_type: 1 00000100:00100000:0.0:1746147194.570479:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492160:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.570510:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 37 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570518:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 37 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:0.0:1746147194.570526:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492288:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.570564:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 17 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570572:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 17 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.570579:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492416:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.570596:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.570611:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12191 00000100:00100000:0.0:1746147194.570617:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+14:1957:x1830967463974144:12345-192.168.203.36@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147194.570634:0:8480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570644:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570651:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 26 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570658:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570665:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570670:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.570671:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.570673:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 7/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570687:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570694:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.570703:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492544:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.570729:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570737:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 681 lvb_type: 1 00000100:00100000:0.0:1746147194.570744:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492672:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.570766:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 26 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.570773:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 26 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:0.0:1746147194.570779:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492800:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.570799:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570806:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.570814:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492928:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.570827:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00010000:00010000:0.0:1746147194.570844:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 37 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.570856:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 37 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.570863:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466493056:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.570876:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.573087:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.573099:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491392:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.573342:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466491136:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.573364:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.579685:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492928:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147194.579792:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492160:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.581525:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491648:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.581539:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491776:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.581557:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466491904:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147194.581583:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.581612:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492288:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.581664:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466491520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.581684:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.581728:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466493056:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.581751:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 17 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.581768:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb63a00, rc 0) 00000100:00100000:0.0:1746147194.581818:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29225:x1830967463973504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 13032us (13262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.581828:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12185 00000100:00100000:2.0:1746147194.582818:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466492416:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.582841:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.582930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.582969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.583162:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fa96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492544:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.583169:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492672:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.583176:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466492800:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147194.583194:0:8480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.583313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.583394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.583424:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974656 00000100:00100000:2.0:1746147194.583430:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974656 00010000:00010000:2.0:1746147194.583461:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.583482:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974912 00000100:00100000:2.0:1746147194.583484:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974912 00010000:00010000:2.0:1746147194.583495:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 15 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.583512:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974784 00000100:00100000:2.0:1746147194.583514:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974784 00010000:00010000:2.0:1746147194.583524:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 22 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.583538:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6073 00000100:00100000:2.0:1746147194.583544:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463974656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.583570:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.583592:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.583602:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.583623:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6558600/0xb4b2209fbdac7d8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7709 expref: 17 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.583638:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.583666:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463974656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 122us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.583671:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6073 00000100:00100000:2.0:1746147194.583684:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6074 00000100:00100000:2.0:1746147194.583689:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+15:1958:x1830967463974912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.583698:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.583710:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 15 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583718:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 15 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583730:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131045c00/0xb4b2209fbdac7fba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e786e expref: 15 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583740:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.583753:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463974912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.583758:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6074 00000100:00100000:2.0:1746147194.583767:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6075 00000100:00100000:2.0:1746147194.583772:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463974784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.583778:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.583784:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 22 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583791:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 22 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583801:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b173400/0xb4b2209fbdac7f12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7805 expref: 22 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.583810:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.583822:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463974784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.583827:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6075 00000100:00100000:1.0:1746147194.584064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584110:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975040 00000100:00100000:1.0:1746147194.584112:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975040 00010000:00010000:1.0:1746147194.584126:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 13 pid: 4445 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.584135:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975168 00000100:00100000:1.0:1746147194.584137:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975168 00010000:00010000:1.0:1746147194.584146:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 27 pid: 4444 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.584153:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975552 00000100:00100000:1.0:1746147194.584154:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975552 00010000:00010000:1.0:1746147194.584160:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 28 pid: 6881 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.584166:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975424 00000100:00100000:1.0:1746147194.584168:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975424 00010000:00010000:1.0:1746147194.584175:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 38 pid: 17530 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.584182:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975680 00000100:00100000:1.0:1746147194.584184:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975680 00010000:00010000:1.0:1746147194.584190:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.584197:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6076 00000100:00100000:1.0:1746147194.584201:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463975040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584207:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584216:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 13 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584224:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 13 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584235:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a310c00/0xb4b2209fbdac7b99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75b2 expref: 13 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584247:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584265:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463975040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 63us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584270:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6076 00000100:00100000:1.0:1746147194.584305:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6077 00000100:00100000:1.0:1746147194.584310:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1958:x1830967463975168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584316:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584324:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 28 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584331:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 28 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584341:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c52f200/0xb4b2209fbdac7f0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e77fe expref: 28 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584349:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.584351:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.584356:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.584363:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.584381:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584394:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463975168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584398:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6077 00000100:00100000:1.0:1746147194.584407:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6078 00000100:00100000:1.0:1746147194.584411:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463975552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584415:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584423:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584429:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584439:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac7c33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7630 expref: 26 pid: 6881 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584446:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584456:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1958:x1830967463975552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584461:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6078 00000100:00100000:1.0:1746147194.584469:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6079 00000100:00100000:1.0:1746147194.584473:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1958:x1830967463975424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584479:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584486:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 38 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584494:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 38 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584504:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b0200/0xb4b2209fbdac7bae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e75ce expref: 38 pid: 17530 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584512:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584524:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1958:x1830967463975424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 50us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584528:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6079 00000100:00100000:1.0:1746147194.584539:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6080 00000100:00100000:1.0:1746147194.584543:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967463975680:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584560:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584566:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584574:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584583:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092905400/0xb4b2209fbdac7fb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7883 expref: 14 pid: 4445 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584590:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584602:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967463975680:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584607:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6080 00000100:00100000:1.0:1746147194.584632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584641:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974528 00000100:00100000:1.0:1746147194.584643:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974528 00010000:00010000:1.0:1746147194.584652:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.584661:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6081 00000100:00100000:1.0:1746147194.584665:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967463974528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.584669:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.584676:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584688:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584697:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e800/0xb4b2209fbdac7dc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7741 expref: 12 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.584704:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.584716:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967463974528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 51us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.584721:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6081 00000100:00100000:1.0:1746147194.584749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.584763:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463974400 00000100:00100000:1.0:1746147194.584765:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463974400 00002000:00100000:1.0:1746147194.584788:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1474560->1515519) req@ffff880090741500 x1830967463974400/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.584797:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741500 with x1830967463974400 ext(1474560->1515519) 00010000:00010000:1.0:1746147194.584803:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 25 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.584813:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 25 pid: 17548 timeout: 681 lvb_type: 0 00002000:00010000:1.0:1746147194.584818:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090741500 00000100:00100000:1.0:1746147194.584831:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1621 00000100:00100000:1.0:1746147194.584836:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967463974400:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147194.584993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.585003:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975808 00000100:00100000:1.0:1746147194.585006:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975808 00010000:00010000:1.0:1746147194.585017:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 16 pid: 17530 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.585039:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6082 00000100:00100000:1.0:1746147194.585043:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1956:x1830967463975808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.585049:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.585266:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585275:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585291:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585299:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585305:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585311:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904bae00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147194.585314:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585326:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585336:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.585341:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bae00/0xb4b2209fbdac803f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.585387:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1957:x1830967463973632:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15776us (16328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.585394:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12189 00010000:00010000:1.0:1746147194.585505:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 16 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.585515:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 16 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.585526:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b829e00/0xb4b2209fbdac7b68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e759d expref: 16 pid: 17530 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.585535:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.585537:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.585540:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.585556:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586277:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586286:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586301:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586311:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586316:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586321:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904ec000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147194.586324:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586329:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.586338:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.586370:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1957:x1830967463973888:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 15974us (16543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.586376:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12190 00010000:00010000:1.0:1746147194.586416:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904ec000/0xb4b2209fbdac8046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.586434:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.586446:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463975808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1403us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.586452:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6082 00000100:00100000:1.0:1746147194.586491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.586509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.588096:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975936 00000100:00100000:2.0:1746147194.588108:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975936 00010000:00010000:2.0:1746147194.588143:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.588171:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6083 00000100:00100000:2.0:1746147194.588180:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1958:x1830967463975936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147194.588183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147194.588194:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.588212:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.588222:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.588237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147194.588244:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b173200/0xb4b2209fbdac7f43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7836 expref: 21 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.588259:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.588283:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967463975936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.588289:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6083 00000100:00100000:2.0:1746147194.589069:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976064 00000100:00100000:2.0:1746147194.589073:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976064 00010000:00010000:2.0:1746147194.589085:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.589100:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976192 00000100:00100000:2.0:1746147194.589102:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976192 00010000:00010000:2.0:1746147194.589114:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 37 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.589127:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6084 00000100:00100000:2.0:1746147194.589132:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1958:x1830967463976064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.589139:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.589149:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.589156:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.589168:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac7feb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7898 expref: 27 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.589178:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.589180:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.589184:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589193:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.589201:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463975296 00000100:00100000:3.0:1746147194.589206:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463975296 00010000:00010000:2.0:1746147194.589213:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147194.589233:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1327104->1855487) req@ffff880090740380 x1830967463975296/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147194.589234:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1958:x1830967463976064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 101us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.589240:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6084 00002000:00100000:3.0:1746147194.589243:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740380 with x1830967463975296 ext(1327104->1855487) 00010000:00010000:3.0:1746147194.589249:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.589250:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6085 00000100:00100000:2.0:1746147194.589255:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1959:x1830967463976192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.589259:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.589262:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147194.589266:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740380 00010000:00010000:2.0:1746147194.589275:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 38 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.589279:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1622 00010000:00010000:2.0:1746147194.589282:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 38 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.589285:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463975296:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:2.0:1746147194.589296:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487600/0xb4b2209fbdac7e2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7780 expref: 38 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.589305:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.589306:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.589308:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589313:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589325:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.589342:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1959:x1830967463976192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 86us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.589347:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6085 00010000:00010000:2.0:1746147194.589367:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589375:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589393:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589400:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589412:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589418:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e48c600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147194.589422:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589429:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589439:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.589445:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e48c600/0xb4b2209fbdac8038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.589485:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+9:1956:x1830967463974272:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 20080us (20440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.589493:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12188 00010000:00010000:0.0:1746147194.590341:0:8480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590355:0:8480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590375:0:8480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590381:0:8480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590387:0:8480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590392:0:8480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094761600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147194.590399:0:8480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590405:0:8480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590415:0:8480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.590420:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094761600/0xb4b2209fbdac804d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.590477:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+11:1957:x1830967463974144:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 19860us (20588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.590484:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12191 00000100:00100000:0.0:1746147194.595997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.596021:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976704 00000100:00100000:0.0:1746147194.596028:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976704 00000100:00100000:0.0:1746147194.596065:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10614 00000100:00100000:0.0:1746147194.596072:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+41:29228:x1830967463976704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147194.596093:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.596109:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78b4 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.596196:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596208:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596218:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596229:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596235:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596245:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596331:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596341:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.596348:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.596375:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.596385:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 18 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.596396:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b6ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466493184:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.596459:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.596518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.597998:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976576 00000100:00100000:0.0:1746147194.598005:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976576 00000100:00100000:0.0:1746147194.598033:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10615 00000100:00100000:0.0:1746147194.598039:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+323:29229:x1830967463976576:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:0.0:1746147194.598052:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147194.598053:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463974400:12345-192.168.203.36@tcp:4:cat.0 Request processed in 13215us (13301us total) trans 21474840692 rc 0/0 00010000:00010000:0.0:1746147194.598062:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dcc00/0xb4b2209fbdac8070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78bb expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.598063:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1621 00002000:00100000:2.0:1746147194.598072:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1474560->1515519) req@ffff880090741500 x1830967463974400/t21474840692(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.598081:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741500 with x1830967463974400 ext(1474560->1515519) 00010000:00010000:2.0:1746147194.598089:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.598100:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00002000:00010000:2.0:1746147194.598106:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090741500 00010000:00010000:0.0:1746147194.598127:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.598137:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.598144:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147194.598488:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1956:x1830967463975296:12345-192.168.203.36@tcp:4:cat.0 Request processed in 9201us (11976us total) trans 17179873280 rc 0/0 00000100:00100000:3.0:1746147194.598505:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1622 00002000:00100000:3.0:1746147194.598511:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1327104->1855487) req@ffff880090740380 x1830967463975296/t17179873280(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.598519:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740380 with x1830967463975296 ext(1327104->1855487) 00010000:00010000:3.0:1746147194.598525:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.598535:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.598541:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090740380 00000100:00100000:0.0:1746147194.600410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.600469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.600488:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976832 00000100:00100000:0.0:1746147194.600495:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976832 00010000:00010000:0.0:1746147194.600522:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.600560:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463976960 00000100:00100000:0.0:1746147194.600562:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463976960 00010000:00010000:0.0:1746147194.600573:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:0.0:1746147194.600586:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6086 00000100:00100000:0.0:1746147194.600592:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463976832:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.600604:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.600608:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.600618:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 19 pid: 14125 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.600637:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147194.600641:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.600649:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.600659:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.600666:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.600670:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.600674:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147194.600692:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.600718:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+19:1956:x1830967463976832:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.600723:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6086 00000100:00100000:0.0:1746147194.600734:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6087 00000100:00100000:0.0:1746147194.600738:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1957:x1830967463976960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.600744:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.600761:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.600769:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.600781:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129efe400/0xb4b2209fbdac7f74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e784b expref: 26 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.600794:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.600796:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.600800:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.600808:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.600818:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.600828:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967463976960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.600832:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6087 00010000:00010000:0.0:1746147194.600847:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147194.600853:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147194.600867:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147194.601006:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dcc00/0xb4b2209fbdac8070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 326 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.601018:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 325 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.601025:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147194.601027:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147194.601029:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dc800, rc 0) 00000100:00100000:0.0:1746147194.601048:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+325:29229:x1830967463976576:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3010us (4531us total) trans 8589944388 rc 0/0 00000100:00100000:0.0:1746147194.601054:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10615 00010000:00010000:3.0:1746147194.601178:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601185:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601203:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601211:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601223:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601229:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e48c800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147194.601233:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601240:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601250:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.601256:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e48c800/0xb4b2209fbdac8031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.601310:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967463974016:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 32066us (32294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.601318:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12187 00010000:00010000:2.0:1746147194.601484:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092904200/0xb4b2209fbdac8015 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78a6 expref: 18 pid: 14125 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.601497:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b6ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466493184:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.601518:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601525:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601529:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147194.601539:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147194.601595:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601602:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601606:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601610:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dd000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147194.601614:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601618:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601626:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.601629:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147194.601631:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601635:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd000/0xb4b2209fbdac8069 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601646:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601651:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601655:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.601659:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dd800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147194.601662:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602208:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602216:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147194.602219:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147194.602221:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602228:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac805b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602236:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602240:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602244:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602248:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dc200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147194.602250:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602254:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602259:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e830900) 00010000:00010000:2.0:1746147194.602261:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147194.602263:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602266:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac8062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147194.602298:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8054 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78b4 expref: 43 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.602304:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78b4 expref: 43 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.602316:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4ddc00, rc 0) 00000100:00100000:2.0:1746147194.602349:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+42:29228:x1830967463976704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6277us (6362us total) trans 8589944389 rc 301/301 00000100:00100000:2.0:1746147194.602356:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10614 00000100:00100000:0.0:1746147194.604775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.604848:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463977088 00000100:00100000:2.0:1746147194.604856:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463977088 00010000:00010000:2.0:1746147194.604886:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.604928:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6088 00000100:00100000:2.0:1746147194.604955:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+38:1957:x1830967463977088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.604972:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.604995:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.605008:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.605029:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b172e00/0xb4b2209fbdac7f4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1327104->1855487) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e783d expref: 38 pid: 17548 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.605043:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.605045:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.605052:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.605064:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.605098:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 14 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.605109:0:16058:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 14 pid: 4444 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.605126:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466493312:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147194.605198:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.614813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.614882:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463977344 00000100:00100000:3.0:1746147194.614892:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463977344 00002000:00100000:3.0:1746147194.614959:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009b6ba300 x1830967463977344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.614968:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6ba300 with x1830967463977344 ext(1048576->2097151) 00000100:00100000:2.0:1746147194.614971:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16058:1830967466493312:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.614977:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 15 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.614991:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 15 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.614995:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746147194.614998:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6ba300 00000100:00100000:3.0:1746147194.615017:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1623 00000100:00100000:3.0:1746147194.615024:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b6ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463977344:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147194.615043:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+37:1957:x1830967463977088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10107us (10276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.615053:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6088 00000100:00100000:3.0:1746147194.626728:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b6ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1957:x1830967463977344:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11692us (11913us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.626743:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1623 00002000:00100000:3.0:1746147194.626756:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009b6ba300 x1830967463977344/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.626766:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b6ba300 with x1830967463977344 ext(1048576->2097151) 00010000:00010000:3.0:1746147194.626778:0:31324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 15 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.626792:0:31324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 15 pid: 4444 timeout: 681 lvb_type: 0 00002000:00010000:3.0:1746147194.626800:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b6ba300 00000100:00100000:0.0:1746147194.632051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.632165:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463977472 00000100:00100000:3.0:1746147194.632177:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463977472 00000100:00100000:3.0:1746147194.632222:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12192 00000100:00100000:3.0:1746147194.632230:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+15:29225:x1830967463977472:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.632259:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.632284:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78c2 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147194.632311:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141778, atime: 0x68141778, ctime: 0x68141778, blocks: 0x81d 00010000:00010000:3.0:1746147194.632334:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.632336:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.632345:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.632361:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 16 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.632371:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e99e200, rc 0) 00000100:00100000:3.0:1746147194.632433:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:29225:x1830967463977472:12345-192.168.203.36@tcp:101:cat.0 Request processed in 203us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.632440:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12192 00000100:00100000:1.0:1746147194.632744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.632801:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463977600 00000100:00100000:2.0:1746147194.632806:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463977600 00010000:00010000:2.0:1746147194.632826:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 16 pid: 4444 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.632842:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6089 00000100:00100000:2.0:1746147194.632847:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463977600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.632855:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.632867:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 16 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.632877:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 16 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.632891:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb63a00/0xb4b2209fbdac8023 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ad expref: 16 pid: 4444 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.632917:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.632918:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.632921:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.632927:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.632960:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147194.632970:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.632977:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1959:x1830967463977600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 130us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.632982:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6089 00010000:00010000:1.0:1746147194.632982:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633003:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633009:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633016:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633022:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a4400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147194.633026:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633034:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633044:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.633050:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0xb4b2209fbdac802a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.633687:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+8:1956:x1830967463973760:12345-192.168.203.36@tcp:1:mirror_io.0 Request processed in 64549us (64685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.633798:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12186 00000100:00100000:0.0:1746147194.640632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.640676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.640794:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463978112 00000100:00100000:2.0:1746147194.640805:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463978112 00000100:00100000:2.0:1746147194.640853:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10616 00000100:00100000:2.0:1746147194.640861:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+18:29222:x1830967463978112:12345-192.168.203.36@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147194.640923:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.640980:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edaca00/0xb4b2209fbdac7621 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71ec expref: 18 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.641019:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.641023:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.641085:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+17:29222:x1830967463978112:12345-192.168.203.36@tcp:36:mirror_io.0 Request processed in 225us (407us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147194.641091:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10616 00000100:00100000:3.0:1746147194.641128:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463977856 00000100:00100000:3.0:1746147194.641133:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463977856 00002000:00100000:3.0:1746147194.641164:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880132e10380 x1830967463977856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.641173:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967463977856 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.641178:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:3.0:1746147194.641193:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4763 00000100:00100000:3.0:1746147194.641199:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463977856:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.644780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.645782:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463978368 00000100:00100000:3.0:1746147194.645794:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463978368 00000100:00100000:3.0:1746147194.645851:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4232 00000100:00100000:3.0:1746147194.645859:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+17:29222:x1830967463978368:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147194.646098:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+18:29222:x1830967463978368:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 239us (1327us total) trans 8589944390 rc 0/0 00000100:00100000:3.0:1746147194.646105:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4232 00000100:00100000:3.0:1746147194.647241:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+15:1956:x1830967463977856:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6038us (6614us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.647250:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4763 00002000:00100000:3.0:1746147194.647260:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880132e10380 x1830967463977856/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.647270:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e10380 with x1830967463977856 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.647275:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e10380 00000100:00100000:0.0:1746147194.650056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.650253:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463978624 00000100:00100000:2.0:1746147194.650262:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463978624 00000100:00100000:2.0:1746147194.650313:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4233 00000100:00100000:2.0:1746147194.650321:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+18:29222:x1830967463978624:12345-192.168.203.36@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147194.650536:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+19:29222:x1830967463978624:12345-192.168.203.36@tcp:35:mirror_io.0 Request processed in 215us (489us total) trans 8589944391 rc 0/0 00000100:00100000:2.0:1746147194.650543:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4233 00000100:00100000:0.0:1746147194.651879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.652395:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463978752 00000100:00100000:1.0:1746147194.652403:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463978752 00000100:00100000:1.0:1746147194.652443:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12193 00000100:00100000:1.0:1746147194.652452:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+25:29225:x1830967463978752:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147194.652467:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.652486:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78c9 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147194.652509:0:8481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x821 00010000:00010000:1.0:1746147194.652533:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.652535:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.652542:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.652572:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 26 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.652581:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a200, rc 0) 00000100:00100000:1.0:1746147194.652626:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+26:29225:x1830967463978752:12345-192.168.203.36@tcp:101:cat.0 Request processed in 175us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.652631:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12193 00000100:00100000:0.0:1746147194.655007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.655082:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979008 00000100:00100000:3.0:1746147194.655091:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979008 00002000:00100000:3.0:1746147194.655129:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880132e11880 x1830967463979008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.655139:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11880 with x1830967463979008 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.655144:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11880 00000100:00100000:3.0:1746147194.655161:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4764 00000100:00100000:3.0:1746147194.655168:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463979008:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.663523:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+26:1956:x1830967463979008:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8343us (8513us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.663537:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4764 00002000:00100000:3.0:1746147194.663559:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff880132e11880 x1830967463979008/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.663569:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e11880 with x1830967463979008 ext(1048576->2097151) 00002000:00010000:3.0:1746147194.663575:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e11880 00000100:00100000:0.0:1746147194.671893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.671967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.671992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.672710:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979264 00000100:00100000:3.0:1746147194.672720:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979264 00000100:00100000:3.0:1746147194.672762:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979520 00000100:00100000:3.0:1746147194.672764:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979520 00000100:00100000:3.0:1746147194.672774:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979136 00000100:00100000:3.0:1746147194.672775:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979136 00000100:00100000:3.0:1746147194.672790:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12194 00000100:00100000:3.0:1746147194.672796:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463979264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147194.672815:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147194.672835:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78d7 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147194.672858:0:6881:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x821 00000100:00100000:0.0:1746147194.673103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.673123:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979392 00000100:00100000:0.0:1746147194.673126:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979392 00000100:00100000:0.0:1746147194.673148:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12195 00000100:00100000:0.0:1746147194.673154:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463979520:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147194.673165:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.673176:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78e5 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147194.673190:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x68141779, atime: 0x68141779, ctime: 0x68141779, blocks: 0x1029 00010000:00010000:0.0:1746147194.673203:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673206:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673215:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673231:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673241:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5600, rc 0) 00000100:00100000:0.0:1746147194.673284:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463979520:12345-192.168.203.36@tcp:101:cat.0 Request processed in 130us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.673289:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12195 00000100:00100000:0.0:1746147194.673303:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12196 00000100:00100000:0.0:1746147194.673308:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463979136:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147194.673315:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.673326:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78d0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147194.673340:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x68141779, atime: 0x68141779, ctime: 0x68141779, blocks: 0x7f9 00010000:00010000:0.0:1746147194.673348:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673350:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673353:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673362:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673368:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5800, rc 0) 00000100:00100000:0.0:1746147194.673387:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463979136:12345-192.168.203.36@tcp:101:cat.0 Request processed in 79us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.673392:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12196 00000100:00100000:0.0:1746147194.673403:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12197 00000100:00100000:0.0:1746147194.673408:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967463979392:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147194.673414:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.673422:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78de expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147194.673438:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4945696, mtime: 0x68141779, atime: 0x6814177a, ctime: 0x68141779, blocks: 0x1607 00010000:00010000:0.0:1746147194.673447:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673448:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.673452:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673460:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.673466:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4a00, rc 0) 00000100:00100000:0.0:1746147194.673481:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463979392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 74us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.673487:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12197 00010000:00010000:3.0:1746147194.673808:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.673810:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.673815:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.673827:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147194.673834:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb0600, rc 0) 00000100:00100000:3.0:1746147194.673856:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463979264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1060us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.673865:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12194 00000100:00100000:0.0:1746147194.686026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.686355:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979776 00000100:00100000:0.0:1746147194.686359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.686364:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979776 00000100:00100000:0.0:1746147194.686383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147194.686399:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a0448e00 x1830967463979776/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.686439:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448e00 with x1830967463979776 ext(2097152->3145727) 00002000:00010000:3.0:1746147194.686444:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448e00 00000100:00100000:0.0:1746147194.687140:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.689466:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463979904 00000100:00100000:2.0:1746147194.689467:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463980288 00000100:00100000:3.0:1746147194.689478:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463979904 00000100:00100000:2.0:1746147194.689478:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463980288 00002000:00100000:3.0:1746147194.689523:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a044ad80 x1830967463979904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.689523:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a0448700 x1830967463980288/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.689533:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044ad80 with x1830967463979904 ext(3145728->4194303) 00002000:00100000:2.0:1746147194.689533:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448700 with x1830967463980288 ext(2097152->3145727) 00002000:00010000:3.0:1746147194.689538:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044ad80 00002000:00010000:2.0:1746147194.689538:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448700 00000100:00100000:1.0:1746147194.689567:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463980416 00000100:00100000:1.0:1746147194.689572:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463980416 00000100:00100000:2.0:1746147194.689577:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4765 00002000:00100000:1.0:1746147194.689590:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a044a680 x1830967463980416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147194.689595:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463979776:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:1.0:1746147194.689597:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a680 with x1830967463980416 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.689600:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044a680 00000100:00100000:3.0:1746147194.690197:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4766 00000100:00100000:3.0:1746147194.690204:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463980288:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.690640:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4767 00000100:00100000:0.0:1746147194.690649:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463979904:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.690774:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4768 00000100:00100000:1.0:1746147194.690781:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463980416:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.721809:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967463979904:12345-192.168.203.36@tcp:3:cat.0 Request processed in 31154us (35442us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.721821:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4767 00002000:00100000:1.0:1746147194.721830:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800a044ad80 x1830967463979904/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.721838:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044ad80 with x1830967463979904 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.721843:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a044ad80 00000100:00100000:2.0:1746147194.722142:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463979776:12345-192.168.203.36@tcp:3:cat.0 Request processed in 32548us (36122us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147194.722149:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4765 00002000:00100000:2.0:1746147194.722154:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a0448e00 x1830967463979776/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.722161:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448e00 with x1830967463979776 ext(2097152->3145727) 00002000:00010000:2.0:1746147194.722163:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448e00 00000100:00100000:1.0:1746147194.734249:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967463980416:12345-192.168.203.36@tcp:3:cat.0 Request processed in 43461us (47101us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.734259:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4768 00002000:00100000:1.0:1746147194.734269:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800a044a680 x1830967463980416/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.734276:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044a680 with x1830967463980416 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.734280:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a044a680 00000100:00100000:3.0:1746147194.737990:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463980288:12345-192.168.203.36@tcp:3:cat.0 Request processed in 47779us (51597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.738003:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4766 00002000:00100000:3.0:1746147194.738013:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800a0448700 x1830967463980288/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.738021:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448700 with x1830967463980288 ext(2097152->3145727) 00002000:00010000:3.0:1746147194.738026:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0448700 00000100:00100000:0.0:1746147194.738176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.738252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.738280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.738295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.738306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.738312:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463980672 00000100:00100000:2.0:1746147194.738317:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463980672 00000100:00100000:0.0:1746147194.738324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.738345:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463980800 00000100:00100000:2.0:1746147194.738347:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463980800 00000100:00100000:0.0:1746147194.738347:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463980928 00000100:00100000:0.0:1746147194.738350:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463980928 00000100:00100000:2.0:1746147194.738358:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463981056 00000100:00100000:2.0:1746147194.738359:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463981056 00000100:00100000:0.0:1746147194.738367:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463981184 00000100:00100000:2.0:1746147194.738368:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463981312 00000100:00100000:2.0:1746147194.738369:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463981312 00000100:00100000:0.0:1746147194.738369:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463981184 00000100:00100000:2.0:1746147194.738378:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12198 00000100:00100000:2.0:1746147194.738383:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463980672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.738394:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.738409:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78ec expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.738426:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738428:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738434:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.738447:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.738456:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092904200, rc 0) 00000100:00100000:2.0:1746147194.738482:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463980672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 99us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.738488:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12198 00000100:00100000:2.0:1746147194.738498:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12199 00000100:00100000:2.0:1746147194.738502:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1959:x1830967463980800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.738508:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.738516:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78f3 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.738527:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738528:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738532:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.738540:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.738557:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd600, rc 0) 00000100:00100000:2.0:1746147194.738573:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1959:x1830967463980800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.738578:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12199 00000100:00100000:2.0:1746147194.738587:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12200 00000100:00100000:2.0:1746147194.738592:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463980928:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.738597:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147194.738601:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12201 00010000:00010000:2.0:1746147194.738603:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e78fa expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.738611:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738613:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738617:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147194.738618:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463981056:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.738625:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.738626:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.738631:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8c6a00, rc 0) 00010000:00010000:1.0:1746147194.738634:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7901 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.738644:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147194.738645:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463980928:12345-192.168.203.36@tcp:101:cat.0 Request processed in 53us (364us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147194.738645:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147194.738649:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12200 00010000:00010000:1.0:1746147194.738650:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 23 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.738658:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 23 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147194.738660:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12202 00000100:00100000:2.0:1746147194.738665:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1958:x1830967463981312:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147194.738665:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a400, rc 0) 00010000:00010000:2.0:1746147194.738669:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.738675:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e790f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.738683:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.738684:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147194.738685:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463981056:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (389us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147194.738688:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147194.738690:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12201 00010000:00010000:2.0:1746147194.738695:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.738700:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b194400, rc 0) 00000100:00100000:2.0:1746147194.738715:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463981312:12345-192.168.203.36@tcp:101:cat.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.738723:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12202 00000100:00100000:0.0:1746147194.738759:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12203 00000100:00100000:0.0:1746147194.738765:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1958:x1830967463981184:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147194.738771:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.738778:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7908 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.738788:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.738790:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.738794:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.738803:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.738810:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e987a00, rc 0) 00000100:00100000:0.0:1746147194.738841:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463981184:12345-192.168.203.36@tcp:101:cat.0 Request processed in 76us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.738846:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12203 00000100:00100000:0.0:1746147194.751767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.751803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.751842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.752003:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463981568 00000100:00100000:1.0:1746147194.752011:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463981568 00002000:00100000:1.0:1746147194.752051:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a56b4e00 x1830967463981568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.752060:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463981568 ext(4194304->4947967) 00002000:00010000:1.0:1746147194.752065:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:3.0:1746147194.752073:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463981824 00000100:00100000:3.0:1746147194.752077:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463981824 00000100:00100000:1.0:1746147194.752084:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463982080 00000100:00100000:1.0:1746147194.752087:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463982080 00002000:00100000:3.0:1746147194.752096:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800a56b7800 x1830967463981824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.752103:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a56b7100 x1830967463982080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.752104:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7800 with x1830967463981824 ext(0->1048575) 00002000:00010000:3.0:1746147194.752107:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b7800 00002000:00100000:1.0:1746147194.752110:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7100 with x1830967463982080 ext(1048576->2097151) 00002000:00010000:1.0:1746147194.752114:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b7100 00000100:00100000:3.0:1746147194.752121:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4769 00000100:00100000:3.0:1746147194.752127:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463981568:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.752132:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4770 00000100:00100000:1.0:1746147194.752137:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463981824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147194.752144:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4771 00000100:00100000:2.0:1746147194.752152:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463982080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.754877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.754900:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463982336 00000100:00100000:0.0:1746147194.754906:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463982336 00002000:00100000:0.0:1746147194.754948:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800998e6050 x1830967463982336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.754957:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e6050 with x1830967463982336 ext(1048576->2097151) 00002000:00010000:0.0:1746147194.754961:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800998e6050 00000100:00100000:0.0:1746147194.754978:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4772 00000100:00100000:0.0:1746147194.754985:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463982336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.756021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.756066:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463982592 00000100:00100000:2.0:1746147194.756071:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463982592 00002000:00100000:2.0:1746147194.756093:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009ee5e680 x1830967463982592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.756101:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967463982592 ext(1048576->2097151) 00002000:00010000:2.0:1746147194.756105:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5e680 00000100:00100000:2.0:1746147194.756126:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4773 00000100:00100000:2.0:1746147194.756132:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463982592:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147194.762084:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463981568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9947us (10314us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746147194.762094:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4769 00002000:00100000:2.0:1746147194.762104:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800a56b4e00 x1830967463981568/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.762113:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463981568 ext(4194304->4947967) 00002000:00010000:2.0:1746147194.762118:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:2.0:1746147194.764554:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967463982080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12388us (12696us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147194.764564:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4771 00002000:00100000:2.0:1746147194.764573:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a56b7100 x1830967463982080/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.764587:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7100 with x1830967463982080 ext(1048576->2097151) 00002000:00010000:2.0:1746147194.764592:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b7100 00000100:00100000:1.0:1746147194.767219:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967463981824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15075us (15408us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.767230:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4770 00002000:00100000:1.0:1746147194.767237:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800a56b7800 x1830967463981824/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.767246:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7800 with x1830967463981824 ext(0->1048575) 00002000:00010000:1.0:1746147194.767251:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b7800 00000100:00100000:0.0:1746147194.770622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.771092:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463982720 00000100:00100000:1.0:1746147194.771099:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463982720 00000100:00100000:1.0:1746147194.771136:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12204 00000100:00100000:1.0:1746147194.771142:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:29228:x1830967463982720:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.771160:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.771175:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7916 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.771199:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.771207:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.771212:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.771214:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.771218:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.771245:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 24 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.771255:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 24 pid: 21080 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.771265:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493440:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147194.772428:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.772439:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.772447:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493568:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147194.772496:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.773311:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1958:x1830967463982592:12345-192.168.203.36@tcp:3:cat.0 Request processed in 17176us (17290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147194.773320:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4773 00002000:00100000:2.0:1746147194.773329:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88009ee5e680 x1830967463982592/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.773337:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5e680 with x1830967463982592 ext(1048576->2097151) 00002000:00010000:2.0:1746147194.773342:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee5e680 00000100:00100000:0.0:1746147194.773822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.774001:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463982976 00000100:00100000:3.0:1746147194.774007:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463982976 00000100:00100000:3.0:1746147194.774177:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4234 00000100:00100000:3.0:1746147194.774184:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+42:29225:x1830967463982976:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147194.775983:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+43:29225:x1830967463982976:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1794us (2156us total) trans 8589944392 rc 0/0 00000100:00100000:3.0:1746147194.775993:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4234 00000100:00100000:0.0:1746147194.777113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.777272:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983104 00000100:00100000:2.0:1746147194.777279:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983104 00010000:00010000:2.0:1746147194.777306:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.777330:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.777335:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6090 00000100:00100000:1.0:1746147194.777338:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493568:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.777342:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463983104:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.777353:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.777358:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.777369:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95ac00, rc 0) 00010000:00010000:2.0:1746147194.777374:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.777383:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.777400:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e987a00/0xb4b2209fbdac80d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7908 expref: 23 pid: 21080 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.777415:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.777419:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29228:x1830967463982720:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 6277us (6804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.777426:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12204 00000100:00100000:2.0:1746147194.777433:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5800050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1959:x1830967463983104:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.777438:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6090 00000100:00100000:0.0:1746147194.778113:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1958:x1830967463982336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 23127us (23242us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147194.778120:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4772 00002000:00100000:0.0:1746147194.778127:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff8800998e6050 x1830967463982336/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.778135:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800998e6050 with x1830967463982336 ext(1048576->2097151) 00002000:00010000:0.0:1746147194.778138:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800998e6050 00000100:00100000:2.0:1746147194.780122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.780146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.780249:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983232 00000100:00100000:0.0:1746147194.780256:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983232 00010000:00010000:0.0:1746147194.780278:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:0.0:1746147194.780306:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6091 00000100:00100000:0.0:1746147194.780312:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463983232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.780322:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.780801:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:0.0:1746147194.780812:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:0.0:1746147194.780831:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4a00/0xb4b2209fbdac80af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78de expref: 29 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:0.0:1746147194.780856:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.780858:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.780864:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.780871:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.780895:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 28 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.780906:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a56b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466493696:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147194.781119:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983360 00000100:00100000:1.0:1746147194.781123:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983360 00000100:00100000:1.0:1746147194.781145:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12205 00000100:00100000:1.0:1746147194.781150:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+22:29229:x1830967463983360:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.781161:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.781171:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e791d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.781188:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.781194:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.781199:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.781200:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.781203:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [401408->1048575] (req 401408->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.781218:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 23 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.781228:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 23 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.781235:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493824:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.781279:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00010000:00010000:1.0:1746147194.781602:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 28 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.781609:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 28 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.781617:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493952:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147194.781632:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.786200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.786238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.786247:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983488 00000100:00100000:3.0:1746147194.786254:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983488 00000100:00100000:0.0:1746147194.786254:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983744 00000100:00100000:0.0:1746147194.786257:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983744 00010000:00010000:3.0:1746147194.786281:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 30 pid: 4444 timeout: 681 lvb_type: 1 00002000:00100000:0.0:1746147194.786287:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3850240->3854335) req@ffff8800a56b4e00 x1830967463983744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147194.786293:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a56b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466493696:192.168.203.36@tcp:105: 00002000:00100000:0.0:1746147194.786295:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463983744 ext(3850240->3854335) 00002000:00010000:0.0:1746147194.786299:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:3.0:1746147194.786305:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6092 00010000:00010000:2.0:1746147194.786308:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.786311:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4774 00000100:00100000:3.0:1746147194.786312:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463983488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147194.786316:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463983744:12345-192.168.203.36@tcp:3:cat.0 00010000:00010000:3.0:1746147194.786324:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.786342:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 30 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.786342:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967463983232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6030us (6224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.786349:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6091 00010000:00010000:3.0:1746147194.786356:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 30 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.786378:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.786394:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463983488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.786399:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6092 00000100:00100000:0.0:1746147194.786423:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463983744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 106us (184us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147194.786428:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4774 00002000:00100000:0.0:1746147194.786433:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3850240->3854335) req@ffff8800a56b4e00 x1830967463983744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.786440:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b4e00 with x1830967463983744 ext(3850240->3854335) 00002000:00010000:0.0:1746147194.786442:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b4e00 00000100:00100000:1.0:1746147194.786507:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493824:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147194.786516:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0xb4b2209fbdac80a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d0 expref: 27 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.786920:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466493952:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147194.786957:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [401408->1048575] (req 401408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 23 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.786971:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95a000, rc 0) 00000100:00100000:1.0:1746147194.786990:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:29229:x1830967463983360:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5840us (6843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.786995:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12205 00000100:00100000:0.0:1746147194.789124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.789167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.789214:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984000 00000100:00100000:1.0:1746147194.789219:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984000 00000100:00100000:2.0:1746147194.789239:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463983872 00000100:00100000:2.0:1746147194.789243:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463983872 00000100:00100000:1.0:1746147194.789253:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12206 00000100:00100000:1.0:1746147194.789258:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29233:x1830967463984000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.789263:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 24 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:1.0:1746147194.789269:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.789277:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7924 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.789293:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.789298:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147194.789299:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147194.789301:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.789587:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.789597:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 26 pid: 8480 timeout: 681 lvb_type: 0 00000100:00100000:1.0:1746147194.789612:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466494080:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147194.789901:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.790001:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6093 00000100:00100000:2.0:1746147194.790008:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463983872:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.790016:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.790035:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 25 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.790044:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 25 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.790061:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092904200/0xb4b2209fbdac80b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78ec expref: 25 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.790088:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.790089:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.790094:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.790100:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.790120:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.790127:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466494208:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147194.790171:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.793405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.793439:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466494080:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147194.793461:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.793476:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95be00, rc 0) 00000100:00100000:1.0:1746147194.793513:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29233:x1830967463984000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4254us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.793520:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12206 00000100:00100000:1.0:1746147194.793543:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984128 00000100:00100000:1.0:1746147194.793561:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984128 00000100:00100000:1.0:1746147194.793595:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12207 00000100:00100000:1.0:1746147194.793601:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29228:x1830967463984128:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.793612:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147194.793617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.793640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.793655:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984256 00000100:00100000:0.0:1746147194.793658:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984256 00010000:00010000:1.0:1746147194.793670:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e792b expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147194.793679:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3850240->4194303) req@ffff8800a56b7480 x1830967463984256/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.793688:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7480 with x1830967463984256 ext(3850240->4194303) 00010000:00010000:1.0:1746147194.793690:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.793693:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 27 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.793699:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 39 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.793708:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.793709:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 27 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:1.0:1746147194.793710:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.793712:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147194.793715:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a56b7480 00000100:00100000:0.0:1746147194.793725:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984512 00000100:00100000:0.0:1746147194.793727:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984512 00010000:00010000:1.0:1746147194.793733:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 39 pid: 11147 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746147194.793736:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x416:0x0] (401408->405503) req@ffff8800a56b6a00 x1830967463984512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.793742:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6a00 with x1830967463984512 ext(401408->405503) 00010000:00010000:1.0:1746147194.793743:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 39 pid: 11147 timeout: 681 lvb_type: 1 00002000:00010000:0.0:1746147194.793745:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b6a00 00000100:00100000:1.0:1746147194.793753:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147194.793754:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1624 00000100:00100000:0.0:1746147194.793759:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1956:x1830967463984256:12345-192.168.203.36@tcp:4:cat.0 00010000:00010000:1.0:1746147194.793795:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.793803:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:1.0:1746147194.793957:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494464:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147194.793982:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.793997:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4775 00000100:00100000:1.0:1746147194.794002:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463984512:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.794100:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967463984512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 98us (458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.794109:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4775 00002000:00100000:1.0:1746147194.794114:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (401408->405503) req@ffff8800a56b6a00 x1830967463984512/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.794121:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6a00 with x1830967463984512 ext(401408->405503) 00002000:00010000:1.0:1746147194.794124:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b6a00 00000100:00100000:3.0:1746147194.794304:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466494208:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.794317:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.794343:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967463983872:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4336us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.794350:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6093 00000100:00100000:2.0:1746147194.798904:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494336:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.798959:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494464:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.798984:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.798999:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b95ba00, rc 0) 00000100:00100000:2.0:1746147194.799032:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29228:x1830967463984128:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 5430us (5634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.799042:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12207 00000100:00100000:2.0:1746147194.799086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.799162:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984640 00000100:00100000:2.0:1746147194.799167:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984640 00010000:00010000:2.0:1746147194.799187:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.799206:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6094 00000100:00100000:2.0:1746147194.799212:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463984640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.799222:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.799240:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.799249:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.799266:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b194400/0xb4b2209fbdac80d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e790f expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.802222:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.805786:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463984640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6564us (6689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.805797:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6094 00000100:00100000:0.0:1746147194.805823:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967463984256:12345-192.168.203.36@tcp:4:cat.0 Request processed in 12061us (12204us total) trans 21474840693 rc 0/0 00000100:00100000:0.0:1746147194.805833:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1624 00002000:00100000:0.0:1746147194.805843:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3850240->4194303) req@ffff8800a56b7480 x1830967463984256/t21474840693(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.805853:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b7480 with x1830967463984256 ext(3850240->4194303) 00010000:00010000:0.0:1746147194.805861:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:0.0:1746147194.805873:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00002000:00010000:0.0:1746147194.805884:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a56b7480 00000100:00100000:1.0:1746147194.806000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.806258:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984768 00000100:00100000:2.0:1746147194.806264:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984768 00010000:00010000:2.0:1746147194.806281:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.806304:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6095 00000100:00100000:2.0:1746147194.806311:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463984768:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.806319:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.806336:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.806344:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.806359:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0xb4b2209fbdac80a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78e5 expref: 18 pid: 4444 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.806370:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.806372:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.806377:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.806384:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.806408:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.806418:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466494592:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147194.806462:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.806512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.806721:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463984896 00000100:00100000:2.0:1746147194.806725:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463984896 00000100:00100000:2.0:1746147194.806745:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12208 00000100:00100000:2.0:1746147194.806750:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:29229:x1830967463984896:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147194.806761:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.806770:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7932 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.806790:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.806798:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.806803:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.806805:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.806807:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.806822:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.806831:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.806839:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494720:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.806878:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147194.806885:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.806891:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494848:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.806907:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.809842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.809871:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466494592:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.809888:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.810015:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463985024 00000100:00100000:2.0:1746147194.810020:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463985024 00000100:00100000:1.0:1746147194.810029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147194.810044:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.810054:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1957:x1830967463984768:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3742us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.810061:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6095 00000100:00100000:2.0:1746147194.810062:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463985152 00000100:00100000:2.0:1746147194.810063:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463985152 00010000:00010000:2.0:1746147194.810070:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 681 lvb_type: 1 00000100:00100000:3.0:1746147194.810075:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6096 00000100:00100000:3.0:1746147194.810082:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967463985024:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147194.810083:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6097 00000100:00100000:2.0:1746147194.810086:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463985152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.810091:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.810091:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147194.810106:0:7121:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147194.810108:0:7121:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147193 -> 1746147194 00010000:00010000:2.0:1746147194.810108:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.810112:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.810116:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 17 pid: 6881 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.810123:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.810132:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95ac00/0xb4b2209fbdac80e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7916 expref: 29 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.810134:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147194.810151:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463985152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.810156:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6097 00010000:00010000:3.0:1746147194.810158:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.810160:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.810165:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.810171:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.810180:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494720:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.810187:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac809a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78d7 expref: 16 pid: 6881 timeout: 681 lvb_type: 1 00010000:00010000:3.0:1746147194.810193:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.810195:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466494848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147194.810202:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466494976:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147194.810207:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.810214:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dc600, rc 0) 00000100:00100000:2.0:1746147194.810227:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:29229:x1830967463984896:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3477us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.810232:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12208 00000100:00100000:3.0:1746147194.810239:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.810893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.810963:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463985280 00000100:00100000:2.0:1746147194.810967:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463985280 00010000:00010000:2.0:1746147194.810980:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00000100:00100000:2.0:1746147194.811001:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6098 00000100:00100000:2.0:1746147194.811006:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463985280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147194.811013:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147194.811022:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.811035:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.811045:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac80bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78f3 expref: 40 pid: 11147 timeout: 681 lvb_type: 1 00010000:00010000:2.0:1746147194.811053:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.811054:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147194.811058:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.811064:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.811080:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147194.811088:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466495104:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147194.811141:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.812474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.812519:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463985536 00000100:00100000:1.0:1746147194.812524:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463985536 00000100:00100000:3.0:1746147194.812557:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466494976:192.168.203.36@tcp:105: 00002000:00100000:1.0:1746147194.812558:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3756032->3760127) req@ffff8800a56b6680 x1830967463985536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.812566:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6680 with x1830967463985536 ext(3756032->3760127) 00010000:00010000:3.0:1746147194.812569:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746147194.812569:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b6680 00000100:00100000:3.0:1746147194.812592:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1957:x1830967463985024:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2510us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.812593:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4776 00000100:00100000:3.0:1746147194.812598:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6096 00000100:00100000:1.0:1746147194.812599:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463985536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147194.812720:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1959:x1830967463985536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 121us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.812726:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4776 00002000:00100000:1.0:1746147194.812731:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3756032->3760127) req@ffff8800a56b6680 x1830967463985536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.812738:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6680 with x1830967463985536 ext(3756032->3760127) 00002000:00010000:1.0:1746147194.812740:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b6680 00000100:00100000:0.0:1746147194.814580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.814628:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463985792 00000100:00100000:1.0:1746147194.814633:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463985792 00000100:00100000:2.0:1746147194.814646:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466495104:192.168.203.36@tcp:105: 00002000:00100000:1.0:1746147194.814656:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a56b6300 x1830967463985792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147194.814658:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147194.814664:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6300 with x1830967463985792 ext(2097152->3145727) 00002000:00010000:1.0:1746147194.814667:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b6300 00000100:00100000:1.0:1746147194.814679:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4777 00000100:00100000:1.0:1746147194.814685:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463985792:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147194.814692:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1957:x1830967463985280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3686us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.814699:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6098 00000100:00100000:0.0:1746147194.814994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.815033:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463986048 00000100:00100000:3.0:1746147194.815037:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463986048 00000100:00100000:3.0:1746147194.815065:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4235 00000100:00100000:3.0:1746147194.815071:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+43:29228:x1830967463986048:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147194.815211:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+44:29228:x1830967463986048:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 135us (213us total) trans 8589944393 rc 0/0 00000100:00100000:3.0:1746147194.815217:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4235 00000100:00100000:0.0:1746147194.819311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147194.819333:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463986304 00000100:00100000:0.0:1746147194.819339:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463986304 00002000:00100000:0.0:1746147194.819371:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1269760->1273855) req@ffff8800a56b5180 x1830967463986304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.819380:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463986304 ext(1269760->1273855) 00002000:00010000:0.0:1746147194.819385:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b5180 00000100:00100000:0.0:1746147194.819459:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4778 00000100:00100000:0.0:1746147194.819466:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463986304:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147194.819629:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+39:1956:x1830967463986304:12345-192.168.203.36@tcp:3:cat.0 Request processed in 162us (324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147194.819635:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4778 00002000:00100000:0.0:1746147194.819640:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1269760->1273855) req@ffff8800a56b5180 x1830967463986304/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.819646:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5180 with x1830967463986304 ext(1269760->1273855) 00002000:00010000:0.0:1746147194.819649:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a56b5180 00000100:00100000:2.0:1746147194.824178:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463985792:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9486us (9595us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147194.824189:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4777 00002000:00100000:2.0:1746147194.824199:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800a56b6300 x1830967463985792/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.824207:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b6300 with x1830967463985792 ext(2097152->3145727) 00002000:00010000:2.0:1746147194.824212:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a56b6300 00000100:00100000:0.0:1746147194.833025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.833187:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463986432 00000100:00100000:2.0:1746147194.833196:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463986432 00000100:00100000:2.0:1746147194.833293:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12209 00000100:00100000:2.0:1746147194.833300:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+39:29233:x1830967463986432:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147194.833321:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.833339:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7939 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.833368:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.833376:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.833377:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147194.833380:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.833409:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 15 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.833419:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 15 pid: 8480 timeout: 681 lvb_type: 0 00000100:00100000:2.0:1746147194.833436:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466495232:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147194.834178:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147194.838156:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466495232:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147194.838189:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.838207:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dca00, rc 0) 00000100:00100000:2.0:1746147194.838254:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+40:29233:x1830967463986432:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4953us (5237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147194.838262:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12209 00000100:00100000:0.0:1746147194.839144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.839466:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463986560 00000100:00100000:2.0:1746147194.839473:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463986560 00002000:00100000:2.0:1746147194.839515:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3760127) req@ffff8800a56b5f80 x1830967463986560/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.839525:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5f80 with x1830967463986560 ext(3145728->3760127) 00010000:00010000:2.0:1746147194.839534:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 16 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.839555:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 16 pid: 8480 timeout: 681 lvb_type: 0 00002000:00010000:2.0:1746147194.839564:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b5f80 00000100:00100000:2.0:1746147194.839587:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1625 00000100:00100000:2.0:1746147194.839595:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+16:1957:x1830967463986560:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147194.848497:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463986560:12345-192.168.203.36@tcp:4:cat.0 Request processed in 8895us (9347us total) trans 17179873281 rc 0/0 00000100:00100000:2.0:1746147194.848507:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1625 00002000:00100000:2.0:1746147194.848517:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->3760127) req@ffff8800a56b5f80 x1830967463986560/t17179873281(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.848529:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a56b5f80 with x1830967463986560 ext(3145728->3760127) 00010000:00010000:2.0:1746147194.848538:0:25531:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:2.0:1746147194.848562:0:25531:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00002000:00010000:2.0:1746147194.848569:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a56b5f80 00000100:00100000:0.0:1746147194.853089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147194.853275:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147194.853313:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463986688 00000100:00100000:3.0:1746147194.853322:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463986688 00010000:00010000:3.0:1746147194.853350:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00000100:00100000:3.0:1746147194.853375:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6099 00000100:00100000:3.0:1746147194.853381:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463986688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.853392:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147194.853407:0:11078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147194.853410:0:11078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147193 -> 1746147194 00010000:00010000:3.0:1746147194.853415:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.853426:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.853442:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b95ba00/0xb4b2209fbdac80f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e792b expref: 18 pid: 8480 timeout: 681 lvb_type: 0 00010000:00010000:3.0:1746147194.853716:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.853720:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147194.853726:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.853733:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.853760:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147194.853769:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466495360:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147194.854181:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147194.857178:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466495360:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147194.857195:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.857229:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a56b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463986688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3847us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.857237:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6099 00000100:00100000:0.0:1746147194.861673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.861764:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463987072 00000100:00100000:2.0:1746147194.861772:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463987072 00002000:00100000:2.0:1746147194.861809:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e682300 x1830967463987072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147194.861818:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967463987072 ext(2097152->3145727) 00002000:00010000:2.0:1746147194.861823:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:2.0:1746147194.861859:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4779 00000100:00100000:2.0:1746147194.861866:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463987072:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147194.864079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.864128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147194.864170:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463987200 00000100:00100000:1.0:1746147194.864176:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463987200 00002000:00100000:1.0:1746147194.864208:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880134d03b80 x1830967463987200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.864217:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03b80 with x1830967463987200 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.864221:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d03b80 00000100:00100000:1.0:1746147194.864243:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463987456 00000100:00100000:1.0:1746147194.864245:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463987456 00002000:00100000:1.0:1746147194.864259:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880134d01180 x1830967463987456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.864265:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463987456 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.864268:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:1.0:1746147194.864279:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4780 00000100:00100000:1.0:1746147194.864284:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463987200:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.864372:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4781 00000100:00100000:3.0:1746147194.864380:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463987456:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.876064:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463987072:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14189us (14390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.876074:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4779 00002000:00100000:3.0:1746147194.876085:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009e682300 x1830967463987072/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.876093:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e682300 with x1830967463987072 ext(2097152->3145727) 00002000:00010000:3.0:1746147194.876099:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e682300 00000100:00100000:1.0:1746147194.876537:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463987200:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12250us (12462us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.876552:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4780 00002000:00100000:1.0:1746147194.876558:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff880134d03b80 x1830967463987200/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.876564:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d03b80 with x1830967463987200 ext(3145728->4194303) 00002000:00010000:1.0:1746147194.876567:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d03b80 00000100:00100000:3.0:1746147194.877996:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463987456:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13613us (13863us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147194.878005:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4781 00002000:00100000:3.0:1746147194.878011:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880134d01180 x1830967463987456/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.878019:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d01180 with x1830967463987456 ext(3145728->4194303) 00002000:00010000:3.0:1746147194.878023:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d01180 00000100:00100000:0.0:1746147194.885287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.885576:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463987712 00000100:00100000:3.0:1746147194.885583:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463987712 00002000:00100000:3.0:1746147194.885623:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009e681c00 x1830967463987712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.885633:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463987712 ext(4194304->4947967) 00002000:00010000:3.0:1746147194.885637:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681c00 00000100:00100000:3.0:1746147194.885669:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4782 00000100:00100000:3.0:1746147194.885676:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463987712:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147194.896288:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967463987712:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10090us (10486us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147194.896301:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4782 00002000:00100000:3.0:1746147194.896311:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009e681c00 x1830967463987712/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147194.896320:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e681c00 with x1830967463987712 ext(4194304->4947967) 00002000:00010000:3.0:1746147194.896325:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e681c00 00000100:00100000:0.0:1746147194.952001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147194.952059:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463987968 00000100:00100000:2.0:1746147194.952067:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463987968 00000100:00100000:2.0:1746147194.952107:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10617 00000100:00100000:2.0:1746147194.952113:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+44:29241:x1830967463987968:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147194.952130:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147194.952143:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dde00/0xb4b2209fbdac810a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7940 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.952217:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952226:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952234:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952243:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952248:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952251:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952322:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac811f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952327:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac811f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952332:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac811f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147194.952341:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147194.952395:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952400:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952404:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952408:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4ddc00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147194.952411:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952415:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952422:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147194.952424:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147194.952426:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952430:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4ddc00/0xb4b2209fbdac8111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952451:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952455:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952458:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952465:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dda00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147194.952466:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952470:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952474:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f37ef00) 00010000:00010000:2.0:1746147194.952476:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147194.952477:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952481:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dda00/0xb4b2209fbdac8118 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147194.952505:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dde00/0xb4b2209fbdac810a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7940 expref: 47 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.952513:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac811f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7940 expref: 46 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147194.952518:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147194.952519:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147194.952521:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dd200, rc 0) 00000100:00100000:2.0:1746147194.952573:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+46:29241:x1830967463987968:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 460us (578us total) trans 8589944394 rc 0/0 00000100:00100000:2.0:1746147194.952579:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10617 00000100:00100000:0.0:1746147194.955760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147194.955832:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988096 00000100:00100000:3.0:1746147194.955839:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988096 00000100:00100000:3.0:1746147194.957959:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 605 00000100:00100000:3.0:1746147194.957972:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+46:1958:x1830967463988096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147194.957986:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147194.958006:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac811f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7940 expref: 46 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147194.958444:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147194.958448:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147194.958509:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+45:1958:x1830967463988096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 541us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147194.958520:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 605 00000100:00100000:0.0:1746147195.001979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.002426:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988352 00000100:00100000:2.0:1746147195.002437:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988352 00000100:00100000:2.0:1746147195.002639:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10618 00000100:00100000:2.0:1746147195.002646:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+45:29245:x1830967463988352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.002664:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.002918:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dcc00/0xb4b2209fbdac812d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7947 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.003023:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003034:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003043:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003053:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003059:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003063:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003146:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8142 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003153:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003159:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147195.003165:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147195.003230:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003235:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003240:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003245:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dd800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147195.003247:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003253:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003261:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147195.003263:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147195.003266:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003270:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd800/0xb4b2209fbdac8134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003288:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003293:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003298:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003301:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4dc200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147195.003303:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003307:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003312:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f37e100) 00010000:00010000:2.0:1746147195.003314:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147195.003316:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003320:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc200/0xb4b2209fbdac813b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.003348:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dcc00/0xb4b2209fbdac812d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7947 expref: 48 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.003358:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8142 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7947 expref: 47 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.003363:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.003364:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147195.003366:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dd200, rc 0) 00000100:00100000:2.0:1746147195.005293:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+47:29245:x1830967463988352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2642us (3350us total) trans 8589944395 rc 0/0 00000100:00100000:2.0:1746147195.005301:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10618 00000100:00100000:0.0:1746147195.011270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.011336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.011406:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988608 00000100:00100000:3.0:1746147195.011414:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988608 00000100:00100000:0.0:1746147195.011416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.011483:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988480 00000100:00100000:0.0:1746147195.011489:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988480 00000100:00100000:3.0:1746147195.011520:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988736 00000100:00100000:3.0:1746147195.011523:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988736 00000100:00100000:0.0:1746147195.011530:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 606 00000100:00100000:3.0:1746147195.011539:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12210 00000100:00100000:0.0:1746147195.011540:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+47:1959:x1830967463988480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147195.011553:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+28:1959:x1830967463988608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.011566:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.011566:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.011579:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac8150 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e794e expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.011588:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8142 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7947 expref: 47 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.011609:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147195.011613:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.011617:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495488:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.011664:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+46:1959:x1830967463988480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.011671:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 606 00000100:00100000:3.0:1746147195.011682:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.011709:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12211 00000100:00100000:3.0:1746147195.011715:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463988736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.011721:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.011730:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bae00/0xb4b2209fbdac8157 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7955 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.011751:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466495616:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.011772:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746147195.011862:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746147195.011866:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147195.015266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.015322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.015516:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466495616:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.015538:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bae00/0xb4b2209fbdac8157 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7955 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015562:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bae00/0xb4b2209fbdac8157 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7955 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015571:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bae00, rc 0) 00000100:00100000:0.0:1746147195.015602:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463988736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3887us (4188us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.015608:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12211 00000100:00100000:0.0:1746147195.015628:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988864 00000100:00100000:0.0:1746147195.015632:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988864 00000100:00100000:0.0:1746147195.015649:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463988992 00000100:00100000:0.0:1746147195.015651:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463988992 00000100:00100000:0.0:1746147195.015663:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12212 00000100:00100000:0.0:1746147195.015668:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463988864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.015679:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.015690:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e795c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.015704:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.015706:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.015711:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 31 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015723:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 31 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015730:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb0600, rc 0) 00000100:00100000:0.0:1746147195.015744:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463988864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 77us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.015748:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12212 00000100:00100000:0.0:1746147195.015758:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12213 00000100:00100000:0.0:1746147195.015762:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1959:x1830967463988992:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.015768:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.015775:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7963 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.015783:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.015785:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.015788:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015796:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.015802:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb1800, rc 0) 00000100:00100000:0.0:1746147195.015814:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463988992:12345-192.168.203.36@tcp:101:cat.0 Request processed in 52us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.015818:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12213 00002000:00010000:3.0:1746147195.016256:0:8480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147195.016259:0:8480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147193 -> 1746147194 00002000:00010000:3.0:1746147195.016261:0:8480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime: 1746147193 -> 1746147194 00000100:00100000:3.0:1746147195.016273:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495488:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.016286:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac8150 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e794e expref: 30 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.016299:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac8150 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e794e expref: 30 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.016321:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb200, rc 0) 00000100:00100000:3.0:1746147195.016349:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463988608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4805us (5015us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.016355:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12210 00000100:00100000:0.0:1746147195.020722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.020810:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989120 00000100:00100000:3.0:1746147195.020817:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989120 00000100:00100000:3.0:1746147195.020900:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12214 00000100:00100000:3.0:1746147195.020908:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29245:x1830967463989120:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.020921:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.020933:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e796a expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.021074:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.021081:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.021082:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.021086:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.021110:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 22 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.021119:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 22 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.021129:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495744:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.023555:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.028300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.028425:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495744:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.028448:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 30 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.028461:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb400, rc 0) 00000100:00100000:3.0:1746147195.028497:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29245:x1830967463989120:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7589us (7780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.028504:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12214 00000100:00100000:2.0:1746147195.028575:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989248 00000100:00100000:2.0:1746147195.028580:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989248 00002000:00100000:2.0:1746147195.028607:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (401408->1048575) req@ffff88009e680700 x1830967463989248/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.028620:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967463989248 ext(401408->1048575) 00010000:00010000:2.0:1746147195.028626:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 23 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.028636:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 23 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.028641:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e680700 00000100:00100000:2.0:1746147195.028666:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1626 00000100:00100000:2.0:1746147195.028673:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967463989248:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147195.030012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.030125:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989376 00000100:00100000:3.0:1746147195.030130:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989376 00000100:00100000:3.0:1746147195.030663:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12215 00000100:00100000:3.0:1746147195.030670:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463989376:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.030681:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.030693:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac8173 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7971 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.030728:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495872:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.030771:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.031734:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466495872:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.031750:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac8173 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7971 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.031760:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac8173 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7971 expref: 26 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.031778:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bac00, rc 0) 00000100:00100000:3.0:1746147195.031807:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463989376:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1137us (1796us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.031812:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12215 00000100:00100000:0.0:1746147195.035455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.035675:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989504 00000100:00100000:3.0:1746147195.035682:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989504 00000100:00100000:3.0:1746147195.035769:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12216 00000100:00100000:3.0:1746147195.035777:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29248:x1830967463989504:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.035791:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.035803:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7978 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.035824:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.035947:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.035959:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.035968:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb800, rc 0) 00000100:00100000:3.0:1746147195.036152:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29248:x1830967463989504:12345-192.168.203.36@tcp:101:cat.0 Request processed in 375us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.036163:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12216 00000100:00100000:2.0:1746147195.036352:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463989248:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7678us (8058us total) trans 21474840694 rc 0/0 00000100:00100000:2.0:1746147195.036360:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1626 00002000:00100000:2.0:1746147195.036368:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (401408->1048575) req@ffff88009e680700 x1830967463989248/t21474840694(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.036375:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e680700 with x1830967463989248 ext(401408->1048575) 00010000:00010000:2.0:1746147195.036380:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.036392:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.036397:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e680700 00000100:00100000:0.0:1746147195.038818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.039026:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989632 00000100:00100000:3.0:1746147195.039033:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989632 00010000:00010000:3.0:1746147195.039056:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.039076:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6100 00000100:00100000:3.0:1746147195.039082:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463989632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.039091:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.039111:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.039120:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.039137:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a000/0xb4b2209fbdac80e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 401408->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e791d expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.039149:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.039150:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.039156:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.039163:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.039169:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.039170:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.039172:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.039178:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.039199:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.039208:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466496000:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.039283:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 29 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.039290:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466496128:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.039304:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.045925:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466496000:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.045963:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11078:1830967466496128:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.045980:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.046016:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463989632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6934us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.046024:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6100 00000100:00100000:0.0:1746147195.046697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.046785:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463989888 00000100:00100000:2.0:1746147195.046791:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463989888 00002000:00100000:2.0:1746147195.046822:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880132e13b80 x1830967463989888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.046829:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13b80 with x1830967463989888 ext(0->1048575) 00002000:00010000:2.0:1746147195.046833:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e13b80 00000100:00100000:2.0:1746147195.046920:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4783 00000100:00100000:2.0:1746147195.046928:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463989888:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.048187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.048220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.048416:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990144 00000100:00100000:1.0:1746147195.048420:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990144 00002000:00100000:1.0:1746147195.048440:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880132e12680 x1830967463990144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.048448:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463990144 ext(0->1048575) 00002000:00010000:1.0:1746147195.048451:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:1.0:1746147195.048467:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990400 00000100:00100000:1.0:1746147195.048469:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990400 00002000:00100000:1.0:1746147195.048480:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1273856->2097151) req@ffff880132e13100 x1830967463990400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.048487:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967463990400 ext(1273856->2097151) 00002000:00010000:1.0:1746147195.048490:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13100 00000100:00100000:1.0:1746147195.048501:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4784 00000100:00100000:1.0:1746147195.048506:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463990144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.048904:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4785 00000100:00100000:3.0:1746147195.048912:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463990400:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.049818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.049876:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990528 00000100:00100000:2.0:1746147195.049880:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990528 00000100:00100000:2.0:1746147195.049903:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12217 00000100:00100000:2.0:1746147195.049908:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:29242:x1830967463990528:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147195.049915:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.049928:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e797f expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.049959:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 42 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.049967:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.049973:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.049975:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.049978:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [4100096->4194303] (req 4100096->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 42 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.050001:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.050011:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 17 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.050021:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.050073:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 42 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.050079:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 42 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.050086:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.050100:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.057306:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496256:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.057318:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.057343:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [4100096->4194303] (req 4100096->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.057359:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67ea00, rc 0) 00000100:00100000:2.0:1746147195.057461:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29242:x1830967463990528:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7550us (7642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.057469:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12217 00000100:00100000:0.0:1746147195.058613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.058697:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990656 00000100:00100000:3.0:1746147195.058703:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990656 00010000:00010000:3.0:1746147195.058726:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.058745:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6101 00000100:00100000:3.0:1746147195.058751:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1956:x1830967463990656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.058763:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.058780:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.058789:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.058806:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094eb1800/0xb4b2209fbdac8165 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7963 expref: 18 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.059512:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.059553:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1956:x1830967463990656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 792us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.059560:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6101 00000100:00100000:0.0:1746147195.063852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.064195:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463990400:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15281us (15971us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147195.064209:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4785 00002000:00100000:2.0:1746147195.064219:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1273856->2097151) req@ffff880132e13100 x1830967463990400/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.064227:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13100 with x1830967463990400 ext(1273856->2097151) 00002000:00010000:2.0:1746147195.064231:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e13100 00000100:00100000:3.0:1746147195.064314:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990784 00000100:00100000:3.0:1746147195.064321:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990784 00010000:00010000:3.0:1746147195.064344:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.064365:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6102 00000100:00100000:3.0:1746147195.064371:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463990784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.064384:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.064400:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.064410:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.064434:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dca00/0xb4b2209fbdac8103 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7939 expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.064450:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.064451:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.064457:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.064463:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.064493:0:11078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.064502:0:11078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466496512:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.064539:0:11078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.064635:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463990144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16127us (16449us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.064642:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4784 00002000:00100000:1.0:1746147195.064652:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880132e12680 x1830967463990144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.064659:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12680 with x1830967463990144 ext(0->1048575) 00002000:00010000:1.0:1746147195.064664:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e12680 00000100:00100000:0.0:1746147195.066439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.066518:0:14046:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463990912 00000100:00100000:2.0:1746147195.066526:0:14046:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463990912 00000100:00100000:2.0:1746147195.066574:0:14046:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:2.0:1746147195.066581:0:14046:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009343f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967463990912:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1746147195.066635:0:14046:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009343f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+15:1957:x1830967463990912:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.066641:0:14046:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:3.0:1746147195.073106:0:11078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11078:1830967466496512:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.073123:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.073162:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463990784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8790us (9317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.073170:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6102 00000100:00100000:2.0:1746147195.073558:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463989888:12345-192.168.203.36@tcp:3:cat.0 Request processed in 26629us (26860us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.073565:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4783 00002000:00100000:2.0:1746147195.073572:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880132e13b80 x1830967463989888/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.073580:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e13b80 with x1830967463989888 ext(0->1048575) 00002000:00010000:2.0:1746147195.073584:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132e13b80 00000100:00100000:0.0:1746147195.075522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.075613:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991168 00000100:00100000:2.0:1746147195.075620:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991168 00002000:00100000:2.0:1746147195.075657:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (4100096->4104191) req@ffff880132e12d80 x1830967463991168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.075665:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463991168 ext(4100096->4104191) 00002000:00010000:2.0:1746147195.075669:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:2.0:1746147195.075697:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4786 00000100:00100000:2.0:1746147195.075704:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463991168:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147195.075837:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1956:x1830967463991168:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 133us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147195.075843:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4786 00002000:00100000:2.0:1746147195.075847:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (4100096->4104191) req@ffff880132e12d80 x1830967463991168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.075853:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132e12d80 with x1830967463991168 ext(4100096->4104191) 00002000:00010000:2.0:1746147195.075855:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132e12d80 00000100:00100000:0.0:1746147195.076295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.076359:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991296 00000100:00100000:2.0:1746147195.076363:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991296 00000100:00100000:2.0:1746147195.076409:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10619 00000100:00100000:2.0:1746147195.076414:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+19:29249:x1830967463991296:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147195.076427:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.076441:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f000/0xb4b2209fbdac8188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7986 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.076482:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076492:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076501:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076511:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076517:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076522:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076613:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076623:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 324 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.076629:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.076654:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 324 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.076663:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 324 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.076673:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466496640:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.076733:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c22a900 going to sleep for 11 seconds 00000100:00080000:0.0:1746147195.076774:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147195.081708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.081793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.081813:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991552 00000100:00100000:2.0:1746147195.081820:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991552 00000100:00100000:2.0:1746147195.081861:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12218 00000100:00100000:2.0:1746147195.081869:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+17:29245:x1830967463991552:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.081885:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.081899:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e798d expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.081922:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.081929:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.081931:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.081934:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.081982:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.081992:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 39 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.082002:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496768:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.082197:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991424 00000100:00100000:3.0:1746147195.082201:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991424 00010000:00010000:3.0:1746147195.082218:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 325 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.082234:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6103 00000100:00100000:3.0:1746147195.082238:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+325:1958:x1830967463991424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.082247:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.082252:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 325 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.082260:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 325 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.082275:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.082280:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.082288:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.082293:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.082303:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147195.082529:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dc800/0xb4b2209fbdac8077 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78bb expref: 325 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.082556:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466496640:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.082571:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082577:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082582:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147195.082614:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:0.0:1746147195.082618:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147195.082630:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082638:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082645:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082651:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082656:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082661:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f67f200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147195.082664:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082669:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082676:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147195.082679:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147195.082681:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082685:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f200/0xb4b2209fbdac818f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082693:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082697:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082702:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082705:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f67ec00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147195.082707:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082714:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082719:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f37e700) 00010000:00010000:0.0:1746147195.082721:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147195.082722:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082727:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac8196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.082749:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67f000/0xb4b2209fbdac8188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.082758:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 20 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.082763:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147195.082765:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147195.082766:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67ee00, rc 0) 00000100:00100000:2.0:1746147195.083099:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.083342:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+324:1958:x1830967463991424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1101us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.083349:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6103 00000100:00100000:0.0:1746147195.083414:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+20:29249:x1830967463991296:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6999us (7119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.084964:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10619 00000100:00100000:1.0:1746147195.088838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.088922:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991680 00000100:00100000:2.0:1746147195.088930:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991680 00000100:00100000:2.0:1746147195.088982:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12219 00000100:00100000:2.0:1746147195.088989:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29242:x1830967463991680:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147195.089003:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.089016:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7994 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.089042:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.089049:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.089054:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.089055:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.089058:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 5/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [4194304->4763647] (req 4194304->4763647) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.089081:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 29 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.089091:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 29 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.089101:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466496896:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.089176:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.089183:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.089190:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466497024:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.089206:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.089742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.089759:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991808 00000100:00100000:2.0:1746147195.089762:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991808 00002000:00100000:2.0:1746147195.089785:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1273855) req@ffff880134d02d80 x1830967463991808/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.089793:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02d80 with x1830967463991808 ext(1048576->1273855) 00010000:00010000:2.0:1746147195.089799:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 40 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.089808:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 40 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.089813:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d02d80 00000100:00100000:3.0:1746147195.090007:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466496768:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.090026:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.090035:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67fa00, rc 0) 00000100:00100000:3.0:1746147195.090059:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29245:x1830967463991552:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8191us (8266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.090064:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12218 00000100:00100000:2.0:1746147195.090368:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1627 00000100:00100000:2.0:1746147195.090375:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+40:1957:x1830967463991808:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:0.0:1746147195.091401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.091426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.091447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.091459:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463991936 00000100:00100000:0.0:1746147195.091463:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463991936 00000100:00100000:0.0:1746147195.091486:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992064 00000100:00100000:0.0:1746147195.091488:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992064 00000100:00100000:0.0:1746147195.091498:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992192 00000100:00100000:0.0:1746147195.091499:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992192 00000100:00100000:0.0:1746147195.091532:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12220 00000100:00100000:0.0:1746147195.091537:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463991936:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.091556:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.091568:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e799b expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.091583:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091584:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091591:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091603:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091610:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075800, rc 0) 00000100:00100000:0.0:1746147195.091634:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463991936:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.091639:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12220 00000100:00100000:0.0:1746147195.091650:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12221 00000100:00100000:0.0:1746147195.091655:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463992064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.091661:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.091669:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac81b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79a2 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.091698:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466497152:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.091742:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.091756:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12222 00000100:00100000:0.0:1746147195.091761:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463992192:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.091767:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.091772:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79a9 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.091780:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091781:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091785:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091794:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 11 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091801:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075200, rc 0) 00000100:00100000:0.0:1746147195.091814:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463992192:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.091818:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12222 00000100:00080000:0.0:1746147195.091833:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147195.091836:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147195.091854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.091865:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992320 00000100:00100000:0.0:1746147195.091867:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992320 00000100:00100000:0.0:1746147195.091880:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12223 00000100:00100000:0.0:1746147195.091885:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463992320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.091890:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.091898:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79b0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.091907:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091908:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.091912:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091920:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 12 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.091927:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075000, rc 0) 00000100:00100000:0.0:1746147195.091980:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463992320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 74us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.091985:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12223 00000100:00100000:0.0:1746147195.092019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.092027:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992448 00000100:00100000:0.0:1746147195.092029:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992448 00000100:00100000:0.0:1746147195.092041:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12224 00000100:00100000:0.0:1746147195.092044:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463992448:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.092050:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.092055:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac81ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79b7 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.092063:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.092079:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac81ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b7 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.092093:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f074c00/0xb4b2209fbdac81ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b7 expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.092103:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074c00, rc 0) 00000100:00100000:0.0:1746147195.092115:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463992448:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 69us (96us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.092119:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12224 00000100:00100000:0.0:1746147195.092150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.092158:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992576 00000100:00100000:0.0:1746147195.092161:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992576 00000100:00100000:0.0:1746147195.092178:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12225 00000100:00100000:0.0:1746147195.092182:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463992576:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.092187:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.092192:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f074a00/0xb4b2209fbdac81d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79be expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.092228:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a044b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466497280:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.092257:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.097117:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466496896:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.097225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.097266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.097327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.097382:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463993216 00000100:00100000:3.0:1746147195.097388:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463993216 00010000:00010000:3.0:1746147195.097413:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 30 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.097442:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6104 00000100:00100000:3.0:1746147195.097448:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1958:x1830967463993216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.097461:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.097479:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 30 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.097488:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 30 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.097504:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eb0600/0xb4b2209fbdac815e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e795c expref: 30 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.097521:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.097562:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1958:x1830967463993216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.097568:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6104 00000100:00100000:2.0:1746147195.097699:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992832 00000100:00100000:2.0:1746147195.097702:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992832 00002000:00100000:2.0:1746147195.097726:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090740a80 x1830967463992832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.097734:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740a80 with x1830967463992832 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.097737:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740a80 00000100:00100000:2.0:1746147195.097758:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463992960 00000100:00100000:2.0:1746147195.097761:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463992960 00002000:00100000:2.0:1746147195.097772:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4100095) req@ffff880090743800 x1830967463992960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.097779:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743800 with x1830967463992960 ext(3145728->4100095) 00002000:00010000:2.0:1746147195.097781:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743800 00000100:00100000:2.0:1746147195.097798:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4787 00000100:00100000:2.0:1746147195.097803:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967463992832:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.099237:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4788 00000100:00100000:0.0:1746147195.099250:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1956:x1830967463992960:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.101712:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1957:x1830967463991808:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 11331us (11967us total) trans 17179873282 rc 0/0 00000100:00100000:1.0:1746147195.101721:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1627 00002000:00100000:1.0:1746147195.101730:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1273855) req@ffff880134d02d80 x1830967463991808/t17179873282(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.101739:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d02d80 with x1830967463991808 ext(1048576->1273855) 00010000:00010000:1.0:1746147195.101748:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 45 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.101758:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 45 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:1.0:1746147195.101764:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d02d80 00000100:00100000:0.0:1746147195.101859:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466497152:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.101886:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac81b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a2 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.101901:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f075e00/0xb4b2209fbdac81b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a2 expref: 12 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.101909:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075e00, rc 0) 00000100:00100000:3.0:1746147195.101926:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466497024:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.101931:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+11:1959:x1830967463992064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10276us (10504us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.101949:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12221 00010000:00010000:3.0:1746147195.101960:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [4194304->4763647] (req 4194304->4763647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.101970:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67ec00, rc 0) 00002000:00010000:0.0:1746147195.101972:0:8478:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime: 1746147193 -> 1746147194 00000100:00100000:0.0:1746147195.101979:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a044b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466497280:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.101984:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29242:x1830967463991680:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 12997us (13154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.101990:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12219 00010000:00010000:0.0:1746147195.101990:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f074a00/0xb4b2209fbdac81d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79be expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.101997:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f074a00/0xb4b2209fbdac81d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79be expref: 10 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.102004:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074a00, rc 0) 00000100:00100000:0.0:1746147195.102018:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463992576:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 9835us (9867us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.102022:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12225 00000100:00100000:2.0:1746147195.110533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.110615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.110639:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463993344 00000100:00100000:2.0:1746147195.110645:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463993344 00010000:00010000:2.0:1746147195.110689:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 46 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.110707:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463993472 00000100:00100000:2.0:1746147195.110709:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463993472 00010000:00010000:2.0:1746147195.110726:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.110742:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6105 00000100:00100000:2.0:1746147195.110748:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+46:1956:x1830967463993344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.110758:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.110795:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 46 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.110804:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 46 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.110828:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc600/0xb4b2209fbdac80fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7932 expref: 46 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.110843:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.110845:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.110851:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.110858:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.110884:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 17 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.110895:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466497408:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.110972:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.110985:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6106 00000100:00100000:2.0:1746147195.110991:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967463993472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.110997:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.111010:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.111018:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.111034:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95be00/0xb4b2209fbdac80ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7924 expref: 26 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.111043:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.111044:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.111048:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.111054:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.111070:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.111077:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466497536:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.111096:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.111409:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967463992960:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12162us (14082us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746147195.111417:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4788 00002000:00100000:0.0:1746147195.111430:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4100095) req@ffff880090743800 x1830967463992960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.111442:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743800 with x1830967463992960 ext(3145728->4100095) 00002000:00010000:0.0:1746147195.111446:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090743800 00000100:00100000:0.0:1746147195.112206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.112263:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463993728 00000100:00100000:1.0:1746147195.112268:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463993728 00000100:00100000:1.0:1746147195.112340:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10620 00000100:00100000:1.0:1746147195.112346:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+20:29249:x1830967463993728:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147195.112359:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.112371:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013627ce00/0xb4b2209fbdac81dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79c5 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.112436:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147195.112469:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.112475:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147195.112491:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.112499:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 21 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.112506:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466497664:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.112864:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.118123:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463992832:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20310us (20858us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.118134:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4787 00002000:00100000:2.0:1746147195.118145:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff880090740a80 x1830967463992832/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.118153:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740a80 with x1830967463992832 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.118158:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740a80 00000100:00100000:2.0:1746147195.119206:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466497536:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.119224:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.119259:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1959:x1830967463993472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8265us (8645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.119266:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6106 00000100:00100000:3.0:1746147195.119416:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7120:1830967466497408:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.119426:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.119445:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463993344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8697us (8919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.119451:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6105 00000100:00100000:2.0:1746147195.119688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.119737:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463993856 00000100:00100000:3.0:1746147195.119742:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463993856 00010000:00010000:3.0:1746147195.119767:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 22 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.119798:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6107 00000100:00100000:3.0:1746147195.119810:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+22:1959:x1830967463993856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.119821:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.119825:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 22 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.119835:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 22 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.119852:0:7120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.119856:0:7120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.119864:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.119870:0:7120:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.119880:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.119898:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+22:1959:x1830967463993856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.119903:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6107 00010000:00010000:0.0:1746147195.120030:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac819d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7986 expref: 21 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.120044:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466497664:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.120055:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.120061:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.120066:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:0.0:1746147195.120080:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147195.120186:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013627ce00/0xb4b2209fbdac81dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.120198:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.120204:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147195.120207:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147195.120209:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013627cc00, rc 0) 00000100:00100000:0.0:1746147195.120230:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463993728:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7884us (8025us total) trans 8589944396 rc 0/0 00000100:00100000:0.0:1746147195.120240:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10620 00000100:00100000:0.0:1746147195.123007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.123043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.123096:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463994240 00000100:00100000:1.0:1746147195.123103:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463994240 00002000:00100000:1.0:1746147195.123135:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a0449f80 x1830967463994240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.123144:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463994240 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.123148:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449f80 00000100:00100000:1.0:1746147195.123169:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463994368 00000100:00100000:1.0:1746147195.123171:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463994368 00002000:00100000:1.0:1746147195.123183:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4759552->4763647) req@ffff8800a0448380 x1830967463994368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.123190:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463994368 ext(4759552->4763647) 00002000:00010000:1.0:1746147195.123192:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448380 00000100:00100000:1.0:1746147195.123201:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4789 00000100:00100000:1.0:1746147195.123207:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463994240:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.123985:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4790 00000100:00100000:3.0:1746147195.123992:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463994368:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.124089:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463994368:12345-192.168.203.36@tcp:3:cat.0 Request processed in 97us (1044us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147195.124095:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4790 00002000:00100000:3.0:1746147195.124100:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (4759552->4763647) req@ffff8800a0448380 x1830967463994368/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.124107:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448380 with x1830967463994368 ext(4759552->4763647) 00002000:00010000:3.0:1746147195.124110:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0448380 00000100:00100000:1.0:1746147195.132955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.132993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.133909:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463994752 00000100:00100000:0.0:1746147195.133919:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463994752 00000100:00100000:0.0:1746147195.133987:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10621 00000100:00100000:0.0:1746147195.133995:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463994752:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147195.134016:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.134032:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac81f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79cc expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.134100:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.134113:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.134119:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147195.134142:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.134151:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 22 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.134160:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466497792:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.134224:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.134244:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463994624 00000100:00100000:0.0:1746147195.134248:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463994624 00002000:00100000:0.0:1746147195.134269:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880090740e00 x1830967463994624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.134277:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463994624 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.134281:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090740e00 00000100:00100000:0.0:1746147195.134294:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4791 00000100:00100000:0.0:1746147195.134299:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463994624:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.137434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.137454:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995008 00000100:00100000:3.0:1746147195.137460:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995008 00000100:00100000:3.0:1746147195.137498:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4236 00000100:00100000:3.0:1746147195.137504:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+324:29242:x1830967463995008:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:3.0:1746147195.137767:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+325:29242:x1830967463995008:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 251us (327us total) trans 8589944397 rc 0/0 00000100:00100000:3.0:1746147195.137773:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4236 00000100:00100000:2.0:1746147195.138682:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1958:x1830967463994240:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15468us (15679us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.138690:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4789 00002000:00100000:2.0:1746147195.138697:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800a0449f80 x1830967463994240/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.138705:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0449f80 with x1830967463994240 ext(1048576->2097151) 00002000:00010000:2.0:1746147195.138710:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0449f80 00000100:00100000:2.0:1746147195.140713:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466497792:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.140737:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:0.0:1746147195.144048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.144119:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995136 00000100:00100000:2.0:1746147195.144126:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995136 00010000:00010000:2.0:1746147195.144173:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 23 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.144790:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6108 00000100:00100000:2.0:1746147195.144797:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:1957:x1830967463995136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.144807:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.144813:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 23 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.144829:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 23 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.144845:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013627cc00/0xb4b2209fbdac81e3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79c5 expref: 23 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.144861:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.144866:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.144875:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.144880:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.145652:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.145698:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463994624:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11395us (12768us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147195.145707:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4791 00002000:00100000:0.0:1746147195.145716:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff880090740e00 x1830967463994624/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.145726:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740e00 with x1830967463994624 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.145729:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090740e00 00000100:00100000:2.0:1746147195.145878:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:1957:x1830967463995136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1081us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.145884:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6108 00010000:00010000:2.0:1746147195.145903:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.145910:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147195.145959:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:2.0:1746147195.145963:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147195.145976:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.146006:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac5c00/0xb4b2209fbdac81f1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.146018:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 21 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.146024:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.146026:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147195.146029:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ac4000, rc 0) 00000100:00100000:2.0:1746147195.146052:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463994752:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 12058us (13061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.146057:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10621 00000100:00100000:0.0:1746147195.148420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.148459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.148835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.149144:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995264 00000100:00100000:3.0:1746147195.149152:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995264 00000100:00100000:1.0:1746147195.149215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.149249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.149258:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995392 00000100:00100000:0.0:1746147195.149261:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995392 00000100:00100000:0.0:1746147195.149281:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995648 00000100:00100000:0.0:1746147195.149282:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995648 00000100:00100000:0.0:1746147195.149293:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12226 00000100:00100000:1.0:1746147195.149299:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995776 00000100:00100000:0.0:1746147195.149299:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463995392:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:1.0:1746147195.149302:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995776 00010000:00010000:0.0:1746147195.149312:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147195.149317:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995904 00000100:00100000:1.0:1746147195.149318:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995904 00010000:00010000:0.0:1746147195.149327:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac81ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79da expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.149349:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12227 00000100:00100000:1.0:1746147195.149353:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463995648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147195.149360:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147195.149366:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466497920:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147195.149367:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79e8 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.149380:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.149381:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.149388:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.149400:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.149408:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074800, rc 0) 00000100:00100000:0.0:1746147195.149415:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.149428:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967463995648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 74us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.149428:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12228 00000100:00100000:0.0:1746147195.149433:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463995776:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:1.0:1746147195.149434:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12227 00010000:00010000:0.0:1746147195.149441:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147195.149448:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12229 00010000:00010000:0.0:1746147195.149449:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904ba600/0xb4b2209fbdac820d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79ef expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.149452:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463995904:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1746147195.149457:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.149462:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f074e00/0xb4b2209fbdac8214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79f6 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.149469:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466498048:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.149482:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466498176:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.149485:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.149502:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.149582:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12230 00000100:00100000:3.0:1746147195.149588:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1959:x1830967463995264:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.149595:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.149601:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac821b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79d3 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.149632:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466498304:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.149654:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.153880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.154011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.155302:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466498048:192.168.203.36@tcp:106: 00010000:00010000:1.0:1746147195.155328:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904ba600/0xb4b2209fbdac820d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79ef expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.155340:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904ba600/0xb4b2209fbdac820d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79ef expref: 13 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.155354:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904ba600, rc 0) 00000100:00100000:3.0:1746147195.155355:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463995520 00000100:00100000:3.0:1746147195.155366:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463995520 00000100:00100000:1.0:1746147195.155390:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967463995776:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5956us (6175us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.155396:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12228 00000100:00100000:1.0:1746147195.155418:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996032 00000100:00100000:1.0:1746147195.155422:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996032 00000100:00100000:3.0:1746147195.155427:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12231 00000100:00100000:3.0:1746147195.155434:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29241:x1830967463995520:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:1.0:1746147195.155447:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12232 00010000:00010000:3.0:1746147195.155450:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147195.155453:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463996032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147195.155463:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.155467:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79e1 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.155475:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e79fd expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.155494:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.155495:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.155496:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.155502:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155503:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155510:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.155514:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155516:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.155517:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.155520:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [864256->1048575] (req 864256->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 32 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.155521:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074200, rc 0) 00000100:00100000:1.0:1746147195.155536:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1957:x1830967463996032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 83us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.155540:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12232 00010000:00010000:3.0:1746147195.155562:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 24 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.155579:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 24 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.155590:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466498176:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.155596:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498432:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.155603:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f074e00/0xb4b2209fbdac8214 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79f6 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.155610:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f074e00/0xb4b2209fbdac8214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79f6 expref: 11 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.155616:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f074e00, rc 0) 00000100:00100000:1.0:1746147195.155630:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967463995904:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6178us (6381us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.155634:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12229 00010000:00010000:3.0:1746147195.155682:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155691:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.155698:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498560:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.155727:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 32 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.155734:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 32 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.155742:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498688:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.155758:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.155813:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466498304:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.155831:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac821b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79d3 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155845:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac821b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79d3 expref: 32 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.155858:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9600, rc 0) 00000100:00100000:3.0:1746147195.155886:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463995264:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6298us (7471us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.155892:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12230 00000100:00100000:2.0:1746147195.156527:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466497920:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.156554:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac81ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79da expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.156562:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5dd600/0xb4b2209fbdac81ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79da expref: 19 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.157118:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd600, rc 0) 00000100:00100000:2.0:1746147195.157738:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1959:x1830967463995392:12345-192.168.203.36@tcp:101:cat.0 Request processed in 8437us (9276us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.157744:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12226 00000100:00100000:0.0:1746147195.161021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.161103:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996544 00000100:00100000:2.0:1746147195.161110:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996544 00000100:00100000:2.0:1746147195.161153:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10622 00000100:00100000:2.0:1746147195.161161:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463996544:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147195.161178:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.161193:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67e800/0xb4b2209fbdac8230 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a04 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.161263:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161274:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161282:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161297:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161303:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161308:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161313:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f67ee00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147195.161315:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161321:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161329:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.161331:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147195.161334:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161339:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67ee00/0xb4b2209fbdac8237 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.161362:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67e800/0xb4b2209fbdac8230 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a04 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.161368:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f67e800/0xb4b2209fbdac8230 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a04 expref: 22 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.161375:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67e800, rc 0) 00000100:00100000:2.0:1746147195.162044:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463996544:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 881us (1025us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.162049:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10622 00000100:00100000:0.0:1746147195.162495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.162524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.162556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.162619:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996288 00000100:00100000:3.0:1746147195.162625:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996288 00010000:00010000:3.0:1746147195.162644:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 31 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.162660:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996160 00000100:00100000:3.0:1746147195.162662:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996160 00010000:00010000:3.0:1746147195.162671:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 12 pid: 4444 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.162681:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996672 00000100:00100000:3.0:1746147195.162682:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996672 00010000:00010000:3.0:1746147195.162689:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.162700:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6109 00000100:00100000:3.0:1746147195.162705:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463996288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.162714:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.162730:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 31 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.162740:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 31 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.162755:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.162776:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967463996288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.162781:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6109 00000100:00100000:3.0:1746147195.162812:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6110 00000100:00100000:3.0:1746147195.162816:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463996160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.162822:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.162828:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 12 pid: 4444 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.162835:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 12 pid: 4444 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.162845:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.162856:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967463996160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.162861:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6110 00000100:00100000:3.0:1746147195.162869:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6111 00000100:00100000:3.0:1746147195.162873:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967463996672:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.162878:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.162884:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.162892:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.162901:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.162903:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.162908:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.162915:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.162953:0:7120:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.162963:0:7120:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466498816:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.163002:0:7120:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147195.163027:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb800/0xb4b2209fbdac817a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7978 expref: 25 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.163040:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498432:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.163049:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f075800/0xb4b2209fbdac81b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e799b expref: 11 pid: 4444 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.163056:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498560:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.163063:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb400/0xb4b2209fbdac816c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e796a expref: 30 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.163070:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498688:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.163086:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.163094:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9e00, rc 0) 00000100:00100000:3.0:1746147195.163109:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29241:x1830967463995520:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 7676us (9235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.163115:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12231 00000100:00100000:0.0:1746147195.163529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.163590:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463996800 00000100:00100000:3.0:1746147195.163593:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463996800 00000100:00100000:3.0:1746147195.164239:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12233 00000100:00100000:3.0:1746147195.164246:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+29:29245:x1830967463996800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.164258:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.164269:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a0b expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.164285:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.164290:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.164292:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.164294:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.164311:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.164320:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 24 pid: 21080 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.164328:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498944:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.164575:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.164673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.164849:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997056 00000100:00100000:3.0:1746147195.164853:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997056 00000100:00100000:3.0:1746147195.164873:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4237 00000100:00100000:3.0:1746147195.164878:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+21:29249:x1830967463997056:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147195.165365:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+22:29249:x1830967463997056:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 485us (691us total) trans 8589944398 rc 0/0 00000100:00100000:3.0:1746147195.165371:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4237 00000100:00100000:3.0:1746147195.165399:0:7120:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7120:1830967466498816:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.165409:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.165425:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463996672:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2551us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.165431:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6111 00000100:00100000:0.0:1746147195.166889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.167113:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997312 00000100:00100000:2.0:1746147195.167119:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997312 00002000:00100000:2.0:1746147195.167157:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4763648->4947967) req@ffff880134c57800 x1830967463997312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.167165:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57800 with x1830967463997312 ext(4763648->4947967) 00010000:00010000:2.0:1746147195.167172:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 24 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.167182:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 24 pid: 21080 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.167188:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57800 00000100:00100000:2.0:1746147195.167201:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1628 00000100:00100000:2.0:1746147195.167206:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967463997312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.167306:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466498944:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.167324:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 30 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.167336:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8a00, rc 0) 00000100:00100000:3.0:1746147195.167363:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29245:x1830967463996800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3117us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.167370:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12233 00000100:00100000:0.0:1746147195.167799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.167853:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997440 00000100:00100000:0.0:1746147195.167856:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997440 00002000:00100000:0.0:1746147195.167872:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4763647) req@ffff880134c54a80 x1830967463997440/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.167884:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54a80 with x1830967463997440 ext(4194304->4763647) 00010000:00010000:0.0:1746147195.167888:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.167897:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 682 lvb_type: 0 00002000:00010000:0.0:1746147195.167902:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c54a80 00000100:00100000:0.0:1746147195.167917:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1629 00000100:00100000:0.0:1746147195.167921:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1958:x1830967463997440:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147195.170410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.171304:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997568 00000100:00100000:3.0:1746147195.171311:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997568 00000100:00100000:3.0:1746147195.171354:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12234 00000100:00100000:3.0:1746147195.171360:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29241:x1830967463997568:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147195.171374:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.171386:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a12 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.171408:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.171415:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 41 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.171420:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.171426:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.171427:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.171430:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [1048576->1765375] (req 1048576->1765375) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.171453:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 9 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.171865:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 9 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.171879:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499072:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.171982:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 41 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.171991:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 41 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.171999:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499200:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.172034:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.172041:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 19 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.172049:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499328:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.172066:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.175642:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1958:x1830967463997440:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7712us (7835us total) trans 21474840695 rc 0/0 00000100:00100000:1.0:1746147195.175655:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1629 00002000:00100000:1.0:1746147195.175663:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4763647) req@ffff880134c54a80 x1830967463997440/t21474840695(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.175672:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c54a80 with x1830967463997440 ext(4194304->4763647) 00010000:00010000:1.0:1746147195.175679:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 28 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.175691:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 28 pid: 21080 timeout: 682 lvb_type: 0 00002000:00010000:1.0:1746147195.175696:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c54a80 00000100:00100000:2.0:1746147195.176015:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463997312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8807us (9127us total) trans 0 rc 184320/184320 00000100:00100000:2.0:1746147195.176021:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1628 00002000:00100000:2.0:1746147195.176026:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4763648->4947967) req@ffff880134c57800 x1830967463997312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 184320/184320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.176032:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c57800 with x1830967463997312 ext(4763648->4947967) 00010000:00010000:2.0:1746147195.176037:0:21209:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.176043:0:21209:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 26 pid: 21080 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.176048:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134c57800 00000100:00100000:3.0:1746147195.177484:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499072:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.177493:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499200:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.177647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.177703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.177896:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997696 00000100:00100000:1.0:1746147195.177902:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997696 00010000:00010000:1.0:1746147195.177928:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.179703:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997824 00000100:00100000:2.0:1746147195.179710:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997824 00010000:00010000:2.0:1746147195.179734:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 10 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.179761:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6112 00000100:00100000:2.0:1746147195.179768:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967463997696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.179780:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.179798:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179807:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179824:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f074200/0xb4b2209fbdac8229 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79fd expref: 42 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179846:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.179877:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463997696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 110us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.179883:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6112 00000100:00100000:2.0:1746147195.179897:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6113 00000100:00100000:2.0:1746147195.179902:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1959:x1830967463997824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.179908:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.179915:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 10 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179923:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 10 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179933:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f074800/0xb4b2209fbdac8206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e8 expref: 10 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:2.0:1746147195.179955:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.179969:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+9:1959:x1830967463997824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 67us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.179974:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6113 00000100:00100000:0.0:1746147195.180122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.180175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.180221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.180246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.180247:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463997952 00000100:00100000:3.0:1746147195.180251:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463997952 00000100:00100000:3.0:1746147195.180270:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998208 00000100:00100000:3.0:1746147195.180271:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998208 00000100:00100000:3.0:1746147195.180279:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998336 00000100:00100000:3.0:1746147195.180281:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998336 00000100:00100000:3.0:1746147195.180293:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12235 00000100:00100000:3.0:1746147195.180297:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463997952:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.180309:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.180319:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8200/0xb4b2209fbdac824c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a19 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.180352:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466499456:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.180394:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12236 00000100:00100000:3.0:1746147195.180395:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.180401:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463998208:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.180409:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147195.180410:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12237 00010000:00010000:2.0:1746147195.180415:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f67e600/0xb4b2209fbdac8253 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a20 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.180416:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967463998336:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.180422:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.180426:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.180431:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f67e600/0xb4b2209fbdac8253 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a20 expref: 42 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.180438:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8000/0xb4b2209fbdac825a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a27 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.180439:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f67e600/0xb4b2209fbdac8253 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a20 expref: 42 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.180445:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67e600, rc 0) 00000100:00100000:3.0:1746147195.180459:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466499584:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.180461:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1956:x1830967463998208:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (286us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.180465:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12236 00000100:00100000:3.0:1746147195.180479:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.180482:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998080 00000100:00100000:2.0:1746147195.180484:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998080 00010000:00010000:2.0:1746147195.180494:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 20 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.180505:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499328:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.180507:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6114 00000100:00100000:2.0:1746147195.180511:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967463998080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.180518:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.180524:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->1765375] (req 1048576->1765375) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 20 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.180525:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 20 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.180532:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 20 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.180714:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.180715:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fa00/0xb4b2209fbdac81a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e798d expref: 20 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.180716:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.180722:0:17548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.180730:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.180806:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147195.180815:0:17548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.180822:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499712:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.180823:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967463998080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 311us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.180829:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6114 00000100:00100000:3.0:1746147195.180844:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.181057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.181229:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998464 00000100:00100000:3.0:1746147195.181232:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998464 00010000:00010000:3.0:1746147195.181244:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 30 pid: 21080 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.181267:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6115 00000100:00100000:3.0:1746147195.181272:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967463998464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.181278:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.181289:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 30 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.181297:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 30 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.181307:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.181308:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.181312:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.181318:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.181333:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.181340:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466499840:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.181895:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.187354:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466499456:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.187382:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8200/0xb4b2209fbdac824c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a19 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.187394:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8200/0xb4b2209fbdac824c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a19 expref: 30 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.187400:0:8480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from glimpse AST (req@ffff88009ee5e300 x1830967466499584) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 30 pid: 21080 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.187408:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8200, rc 0) 00010000:00010000:2.0:1746147195.187419:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f67ec00/0xb4b2209fbdac81ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4763647) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7994 expref: 29 pid: 21080 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.187439:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466499584:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.187457:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8000/0xb4b2209fbdac825a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a27 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.187464:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8000/0xb4b2209fbdac825a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a27 expref: 28 pid: 8480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147195.187471:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967463997952:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7171us (7348us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147195.187471:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8000, rc 0) 00000100:00100000:3.0:1746147195.187478:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12235 00000100:00100000:2.0:1746147195.187490:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967463998336:12345-192.168.203.36@tcp:101:cat.0 Request processed in 7074us (7268us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.187496:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12237 00000100:00100000:3.0:1746147195.187513:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17548:1830967466499712:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.187521:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8800, rc 0) 00000100:00100000:3.0:1746147195.187538:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29241:x1830967463997568:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 16178us (17136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.187539:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7121:1830967466499840:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.187554:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12234 00010000:00010000:2.0:1746147195.187560:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.187579:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967463998464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6307us (6521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.187585:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6115 00000100:00100000:0.0:1746147195.187661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.187724:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998720 00000100:00100000:3.0:1746147195.187729:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998720 00002000:00100000:3.0:1746147195.187753:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b209500 x1830967463998720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.187761:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463998720 ext(2097152->3145727) 00002000:00010000:3.0:1746147195.187765:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209500 00000100:00100000:3.0:1746147195.188034:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4792 00000100:00100000:3.0:1746147195.188040:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463998720:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.190454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.191849:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463998848 00000100:00100000:3.0:1746147195.191857:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463998848 00000100:00100000:3.0:1746147195.191907:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12238 00000100:00100000:3.0:1746147195.191915:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29248:x1830967463998848:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.191930:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.191970:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a2e expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.191992:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.191993:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.192000:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.192013:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 26 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.192024:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9000, rc 0) 00000100:00100000:2.0:1746147195.192098:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29248:x1830967463998848:12345-192.168.203.36@tcp:101:cat.0 Request processed in 182us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.192105:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12238 00000100:00100000:0.0:1746147195.195538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.195757:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463999104 00000100:00100000:1.0:1746147195.195765:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463999104 00002000:00100000:1.0:1746147195.195799:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1761280->1765375) req@ffff88009b20b480 x1830967463999104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.195808:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463999104 ext(1761280->1765375) 00002000:00010000:1.0:1746147195.195812:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20b480 00000100:00100000:1.0:1746147195.195835:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4793 00000100:00100000:1.0:1746147195.195841:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463999104:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.196008:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967463999104:12345-192.168.203.36@tcp:3:cat.0 Request processed in 166us (476us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.196014:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4793 00002000:00100000:1.0:1746147195.196019:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41c:0x0] (1761280->1765375) req@ffff88009b20b480 x1830967463999104/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.196026:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b480 with x1830967463999104 ext(1761280->1765375) 00002000:00010000:1.0:1746147195.196028:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20b480 00000100:00100000:1.0:1746147195.196363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.196407:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1959:x1830967463998720:12345-192.168.203.36@tcp:3:cat.0 Request processed in 8365us (8744us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.196415:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4792 00000100:00100000:1.0:1746147195.196418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:3.0:1746147195.196421:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009b209500 x1830967463998720/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.196428:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209500 with x1830967463998720 ext(2097152->3145727) 00002000:00010000:3.0:1746147195.196431:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209500 00000100:00100000:2.0:1746147195.196582:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463999232 00000100:00100000:2.0:1746147195.196586:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463999232 00000100:00100000:2.0:1746147195.196605:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463999360 00000100:00100000:2.0:1746147195.196606:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463999360 00000100:00100000:2.0:1746147195.196748:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12239 00000100:00100000:2.0:1746147195.196754:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463999232:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.196764:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.196782:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f67f600/0xb4b2209fbdac8268 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a35 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.196834:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12240 00000100:00100000:0.0:1746147195.196841:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463999360:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.196848:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.196856:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bb600/0xb4b2209fbdac826f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a3c expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.196886:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466499968:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.197098:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466500096:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.197217:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.197255:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.199031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.199228:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463999616 00000100:00100000:3.0:1746147195.199236:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463999616 00000100:00100000:3.0:1746147195.199270:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4238 00000100:00100000:3.0:1746147195.199276:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+46:29241:x1830967463999616:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:0.0:1746147195.199286:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b20bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466499968:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.199306:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bb600/0xb4b2209fbdac826f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a3c expref: 42 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.199316:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bb600/0xb4b2209fbdac826f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a3c expref: 42 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.199335:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb600, rc 0) 00000100:00100000:0.0:1746147195.199367:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1957:x1830967463999360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2526us (2948us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.199372:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12240 00000100:00100000:3.0:1746147195.199431:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+47:29241:x1830967463999616:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 154us (403us total) trans 8589944399 rc 0/0 00000100:00100000:3.0:1746147195.199437:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4238 00000100:00100000:2.0:1746147195.199581:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8480:1830967466500096:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.199598:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f67f600/0xb4b2209fbdac8268 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a35 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.199608:0:8480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f67f600/0xb4b2209fbdac8268 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a35 expref: 27 pid: 8480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.199620:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67f600, rc 0) 00000100:00100000:2.0:1746147195.199639:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967463999232:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2885us (3276us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.199645:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12239 00000100:00100000:0.0:1746147195.204025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.204071:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464000000 00000100:00100000:0.0:1746147195.204073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.204078:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464000000 00002000:00100000:3.0:1746147195.204118:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4943872->4947967) req@ffff88009b20bb80 x1830967464000000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.204126:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967464000000 ext(4943872->4947967) 00002000:00010000:3.0:1746147195.204131:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20bb80 00000100:00100000:3.0:1746147195.204162:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4794 00000100:00100000:3.0:1746147195.204168:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967464000000:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.204188:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967463999744 00000100:00100000:2.0:1746147195.204192:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967463999744 00000100:00100000:2.0:1746147195.204226:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12241 00000100:00100000:2.0:1746147195.204231:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29245:x1830967463999744:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.204240:0:8480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.204254:0:8480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a43 expref: -99 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.204275:0:8480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.204283:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.204284:0:8480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.204288:0:8480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.204309:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967464000000:12345-192.168.203.36@tcp:3:cat.0 Request processed in 140us (290us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746147195.204311:0:8480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.204314:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4794 00002000:00100000:3.0:1746147195.204319:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x419:0x0] (4943872->4947967) req@ffff88009b20bb80 x1830967464000000/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147195.204321:0:8480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 40 pid: 8480 timeout: 682 lvb_type: 0 00002000:00100000:3.0:1746147195.204325:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20bb80 with x1830967464000000 ext(4943872->4947967) 00002000:00010000:3.0:1746147195.204328:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b20bb80 00000100:00100000:2.0:1746147195.204335:0:8480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466500224:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.204387:0:8480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.209436:0:8480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8480:1830967466500224:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.209463:0:8480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 19 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.209478:0:8480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67fc00, rc 0) 00000100:00100000:2.0:1746147195.209630:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29245:x1830967463999744:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5397us (5554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.209638:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12241 00000100:00100000:0.0:1746147195.210522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.210587:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464000128 00000100:00100000:2.0:1746147195.210593:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464000128 00002000:00100000:2.0:1746147195.210622:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (4100096->4194303) req@ffff88009b20b100 x1830967464000128/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.210630:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967464000128 ext(4100096->4194303) 00010000:00010000:2.0:1746147195.210636:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.210647:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 41 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.210653:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b100 00000100:00100000:2.0:1746147195.210679:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1630 00000100:00100000:2.0:1746147195.210685:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+41:1958:x1830967464000128:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147195.216350:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967464000128:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5658us (5822us total) trans 17179873283 rc 0/0 00000100:00100000:2.0:1746147195.216361:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1630 00002000:00100000:2.0:1746147195.216371:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (4100096->4194303) req@ffff88009b20b100 x1830967464000128/t17179873283(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.216380:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20b100 with x1830967464000128 ext(4100096->4194303) 00010000:00010000:2.0:1746147195.216388:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.216402:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.216408:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b20b100 00000100:00100000:0.0:1746147195.225173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.225414:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464000256 00000100:00100000:2.0:1746147195.225422:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464000256 00010000:00010000:2.0:1746147195.225451:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.225485:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6116 00000100:00100000:2.0:1746147195.225492:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967464000256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.225504:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.225522:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.225533:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.225561:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f67ea00/0xb4b2209fbdac8181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e797f expref: 43 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.225896:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.225898:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.225905:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.225911:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.225960:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.225970:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466500352:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.226046:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.232170:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466500352:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.232197:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.232244:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5847050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1958:x1830967464000256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 6751us (7078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.232257:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6116 00000100:00100000:0.0:1746147195.237127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.237152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.237180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.237346:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464000512 00000100:00100000:2.0:1746147195.237355:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464000512 00002000:00100000:2.0:1746147195.237395:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009b20a680 x1830967464000512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.237409:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967464000512 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.237414:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:3.0:1746147195.237416:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464000768 00000100:00100000:3.0:1746147195.237420:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464000768 00000100:00100000:2.0:1746147195.237437:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4795 00000100:00100000:3.0:1746147195.237440:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001024 00000100:00100000:3.0:1746147195.237442:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001024 00000100:00100000:2.0:1746147195.237444:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967464000512:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:3.0:1746147195.237458:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009b208000 x1830967464001024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.237466:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967464001024 ext(3145728->4194303) 00002000:00010000:3.0:1746147195.237470:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:3.0:1746147195.237486:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4796 00000100:00100000:3.0:1746147195.237491:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967464001024:12345-192.168.203.36@tcp:3:cat.0 00002000:00100000:0.0:1746147195.238740:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b208700 x1830967464000768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.238754:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967464000768 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.238759:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208700 00000100:00100000:0.0:1746147195.238787:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4797 00000100:00100000:0.0:1746147195.238795:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1957:x1830967464000768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.252208:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967464000512:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14758us (15083us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.252217:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4795 00002000:00100000:2.0:1746147195.252227:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff88009b20a680 x1830967464000512/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.252235:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b20a680 with x1830967464000512 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.252240:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b20a680 00000100:00100000:2.0:1746147195.259623:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967464000768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20818us (22457us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.259634:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4797 00002000:00100000:2.0:1746147195.259644:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff88009b208700 x1830967464000768/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.259655:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208700 with x1830967464000768 ext(3145728->4194303) 00002000:00010000:2.0:1746147195.259659:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b208700 00000100:00100000:1.0:1746147195.262282:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967464001024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 24784us (25094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.262291:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4796 00002000:00100000:1.0:1746147195.262299:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009b208000 x1830967464001024/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.262307:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b208000 with x1830967464001024 ext(3145728->4194303) 00002000:00010000:1.0:1746147195.262311:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b208000 00000100:00100000:0.0:1746147195.271373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.271822:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001280 00000100:00100000:1.0:1746147195.271830:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001280 00002000:00100000:1.0:1746147195.271867:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009b209180 x1830967464001280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.271876:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967464001280 ext(4194304->4947967) 00002000:00010000:1.0:1746147195.271881:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209180 00000100:00100000:1.0:1746147195.271912:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4798 00000100:00100000:1.0:1746147195.271918:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464001280:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.279071:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464001280:12345-192.168.203.36@tcp:3:cat.0 Request processed in 7145us (7697us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746147195.279081:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4798 00002000:00100000:1.0:1746147195.279091:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009b209180 x1830967464001280/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.279100:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b209180 with x1830967464001280 ext(4194304->4947967) 00002000:00010000:1.0:1746147195.279105:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b209180 00000100:00100000:0.0:1746147195.290102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.290226:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001536 00000100:00100000:3.0:1746147195.290234:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001536 00000100:00100000:3.0:1746147195.290284:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4239 00000100:00100000:3.0:1746147195.290292:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+47:29245:x1830967464001536:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:3.0:1746147195.290501:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+48:29245:x1830967464001536:12345-192.168.203.36@tcp:35:cat.0 Request processed in 209us (405us total) trans 8589944400 rc 0/0 00000100:00100000:3.0:1746147195.290507:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4239 00000100:00100000:1.0:1746147195.291042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.291294:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001664 00000100:00100000:3.0:1746147195.291298:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001664 00000100:00100000:3.0:1746147195.291330:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10623 00000100:00100000:3.0:1746147195.291336:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+22:29254:x1830967464001664:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.291348:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.291361:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac827d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a4a expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.291400:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291410:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291418:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291429:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291433:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291438:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291517:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291524:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291528:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147195.291558:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:3.0:1746147195.291561:0:14048:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147195.291570:0:14048:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291576:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291581:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291585:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291590:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291595:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b9a00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.291597:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291602:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291609:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147195.291612:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.291614:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291618:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac8284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291627:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291631:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291635:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291638:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b9c00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.291641:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291644:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291649:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48e00) 00010000:00010000:3.0:1746147195.291650:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.291652:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291656:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac828b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.291674:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac827d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a4a expref: 24 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.291683:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a4a expref: 23 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.291688:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.291690:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147195.291692:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9e00, rc 0) 00000100:00100000:3.0:1746147195.291715:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464001664:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 380us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.291720:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10623 00000100:00100000:0.0:1746147195.296529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.296571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.296688:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001792 00000100:00100000:0.0:1746147195.296694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.296695:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001792 00000100:00100000:0.0:1746147195.296720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.296727:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464001920 00000100:00100000:2.0:1746147195.296729:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464001920 00000100:00100000:0.0:1746147195.296745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.296809:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002048 00000100:00100000:2.0:1746147195.296812:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002048 00000100:00100000:3.0:1746147195.296856:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002176 00000100:00100000:3.0:1746147195.296859:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002176 00000100:00100000:3.0:1746147195.296875:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12242 00000100:00100000:3.0:1746147195.296881:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967464001792:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.296897:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.296909:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac8299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a51 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.296979:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466500480:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.297036:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.297050:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12243 00000100:00100000:3.0:1746147195.297054:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967464001920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.297060:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.297067:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9200/0xb4b2209fbdac82a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a58 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.297085:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466500608:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.297100:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.297109:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12244 00000100:00100000:3.0:1746147195.297113:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967464002048:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.297118:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.297122:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a5f expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.297129:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.297131:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.297136:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.297147:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.297156:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8c00, rc 0) 00000100:00100000:3.0:1746147195.297170:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967464002048:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 56us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.297175:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12244 00000100:00100000:3.0:1746147195.297187:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12245 00000100:00100000:3.0:1746147195.297190:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+11:1956:x1830967464002176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.297194:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.297198:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a66 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.297206:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.297207:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.297210:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.297217:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.297222:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8e00, rc 0) 00000100:00100000:3.0:1746147195.297231:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967464002176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.297235:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12245 00000100:00100000:3.0:1746147195.297253:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002304 00000100:00100000:3.0:1746147195.297255:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002304 00000100:00100000:3.0:1746147195.297270:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 607 00000100:00100000:3.0:1746147195.297274:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:1956:x1830967464002304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.297281:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.297292:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac8292 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a4a expref: 23 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.297302:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.297306:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.297321:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+22:1956:x1830967464002304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 46us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.297581:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 607 00002000:00010000:3.0:1746147195.301194:0:21080:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime: 1746147194 -> 1746147195 00000100:00100000:3.0:1746147195.301219:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466500480:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.301247:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac8299 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a51 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.301259:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8600/0xb4b2209fbdac8299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a51 expref: 13 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.301268:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b8600, rc 0) 00000100:00100000:3.0:1746147195.301303:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+12:1956:x1830967464001792:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4420us (4779us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.301309:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12242 00002000:00010000:2.0:1746147195.303734:0:4444:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime: 1746147194 -> 1746147195 00000100:00100000:2.0:1746147195.303761:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466500608:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.303786:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9200/0xb4b2209fbdac82a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a58 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.303978:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9200/0xb4b2209fbdac82a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a58 expref: 11 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.304003:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9200, rc 0) 00000100:00100000:2.0:1746147195.304044:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1956:x1830967464001920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6988us (7472us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.304052:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12243 00000100:00100000:0.0:1746147195.308880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.309099:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002560 00000100:00100000:2.0:1746147195.309107:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002560 00000100:00100000:2.0:1746147195.309156:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10624 00000100:00100000:2.0:1746147195.309163:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+22:29254:x1830967464002560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147195.309178:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.309192:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac82b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a6d expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.309269:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.309283:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 23 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.309289:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.309313:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 23 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.309323:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 23 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.309333:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466500736:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.309418:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.315878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.316144:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466500736:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.316164:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147195.316278:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002688 00000100:00100000:3.0:1746147195.316290:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002688 00010000:00010000:3.0:1746147195.316329:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 24 pid: 14048 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.316376:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6117 00000100:00100000:3.0:1746147195.316384:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967464002688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.316398:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.316403:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 24 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.316413:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 24 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.316434:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ac4000/0xb4b2209fbdac81f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79cc expref: 24 pid: 14048 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.316452:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.316456:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.316464:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.316469:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.316496:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147195.316528:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.316535:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147195.316563:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:1956:x1830967464002688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 178us (690us total) trans 0 rc 0/0 00000004:00200000:2.0:1746147195.316568:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000100:00100000:3.0:1746147195.316571:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6117 00010000:00010000:2.0:1746147195.316698:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac82b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.316726:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.316733:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.316736:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147195.316738:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8c00, rc 0) 00000100:00100000:2.0:1746147195.316788:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464002560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 7625us (7914us total) trans 8589944401 rc 0/0 00000100:00100000:2.0:1746147195.316795:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10624 00000100:00100000:0.0:1746147195.322916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.323265:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002816 00000100:00100000:2.0:1746147195.323273:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002816 00000100:00100000:2.0:1746147195.323319:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10625 00000100:00100000:2.0:1746147195.323326:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464002816:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147195.323487:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.323501:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9200/0xb4b2209fbdac82ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a74 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.323568:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.323581:0:16361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.323587:0:16361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.323610:0:16361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.323620:0:16361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 24 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.323630:0:16361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466500864:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.323688:0:16361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.325813:0:16361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16361:1830967466500864:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.325833:0:16361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:0.0:1746147195.326854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.327274:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464002944 00000100:00100000:3.0:1746147195.327283:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464002944 00010000:00010000:3.0:1746147195.327316:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.327351:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6118 00000100:00100000:3.0:1746147195.327359:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+25:1958:x1830967464002944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.327371:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.327377:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.327387:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.327406:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8c00/0xb4b2209fbdac82bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a6d expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.327437:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.327442:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.327450:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.327456:0:7121:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.327475:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.327524:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:1958:x1830967464002944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 166us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.327530:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6118 00010000:00010000:2.0:1746147195.327693:0:16361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.327701:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147195.327743:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:2.0:1746147195.327748:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147195.327763:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.327790:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9200/0xb4b2209fbdac82ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.327818:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 23 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.327825:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.327827:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147195.327830:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9800, rc 0) 00000100:00100000:2.0:1746147195.327868:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464002816:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4542us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.327875:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10625 00000100:00100000:0.0:1746147195.331024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.331061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.331182:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003200 00000100:00100000:2.0:1746147195.331182:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003072 00000100:00100000:3.0:1746147195.331191:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003200 00000100:00100000:2.0:1746147195.331191:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003072 00000100:00100000:3.0:1746147195.331227:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12246 00000100:00100000:2.0:1746147195.331232:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12247 00000100:00100000:3.0:1746147195.331233:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967464003200:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147195.331238:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464003072:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147195.331250:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.331250:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.331266:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac82d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a82 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.331266:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac82df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a7b expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.331313:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466500992:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.331313:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466501120:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.331890:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.332135:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.336363:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466500992:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.336363:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466501120:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.336396:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac82d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a82 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.336396:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac82df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a7b expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.336410:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac82d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a82 expref: 11 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.336410:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac82df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a7b expref: 13 pid: 4444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.336426:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9000, rc 0) 00010000:00010000:3.0:1746147195.336427:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9400, rc 0) 00000100:00100000:3.0:1746147195.336474:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967464003200:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5240us (5411us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.336483:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12246 00000100:00100000:2.0:1746147195.336553:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464003072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5314us (5537us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.336559:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12247 00000100:00100000:0.0:1746147195.340778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.340967:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003456 00000100:00100000:2.0:1746147195.340977:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003456 00000100:00100000:2.0:1746147195.341121:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10626 00000100:00100000:2.0:1746147195.341131:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464003456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147195.341151:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.341168:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac82e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a89 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.341260:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.341274:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147195.341284:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:2.0:1746147195.341295:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147195.341402:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac82e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 26 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.341416:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 25 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.341423:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.341426:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147195.341429:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9a00, rc 0) 00000100:00100000:2.0:1746147195.341488:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60817ea3-97af-43a7-ab2a-b628d12800db+25:29254:x1830967464003456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 359us (1553us total) trans 8589944402 rc 0/0 00000100:00100000:2.0:1746147195.341494:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10626 00000100:00100000:0.0:1746147195.348635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.348669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.348690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.348715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.348726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.348738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.348741:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003584 00000100:00100000:3.0:1746147195.348754:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003584 00000100:00100000:0.0:1746147195.348755:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003840 00000100:00100000:0.0:1746147195.348762:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003840 00000100:00100000:0.0:1746147195.348790:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004096 00000100:00100000:3.0:1746147195.348868:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003712 00000100:00100000:3.0:1746147195.348871:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003712 00000100:00100000:3.0:1746147195.348886:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464003968 00000100:00100000:3.0:1746147195.348889:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464003968 00000100:00100000:3.0:1746147195.348898:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004224 00000100:00100000:3.0:1746147195.348901:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004224 00000100:00100000:3.0:1746147195.348916:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12248 00000100:00100000:3.0:1746147195.348924:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464003840:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:2.0:1746147195.349063:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12249 00000100:00100000:2.0:1746147195.349072:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967464003584:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147195.349114:0:4444:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349133:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349140:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.349143:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.349146:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349180:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349193:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.349205:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466501248:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.349288:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.349327:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12250 00000100:00100000:2.0:1746147195.349333:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464003712:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147195.349353:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349364:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349369:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.349371:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.349372:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349387:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 18 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349398:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 18 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.349407:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466501376:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.349425:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.349439:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12251 00000100:00100000:2.0:1746147195.349444:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+13:1958:x1830967464003968:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147195.349459:0:6881:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349468:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349474:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.349481:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.349486:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.349487:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.349488:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349502:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 25 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.349511:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 25 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.349519:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501504:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.349533:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12252 00000100:00100000:1.0:1746147195.349550:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464004224:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1746147195.349560:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 13 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.349568:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 13 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.349576:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501632:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.349583:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349599:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 29 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.349601:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.349607:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 29 pid: 8481 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.349608:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147195.349614:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501760:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.349614:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.349616:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.349618:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.349627:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e23dd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147195.349642:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 12 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.349651:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 12 pid: 17548 timeout: 682 lvb_type: 1 00000100:00100000:1.0:1746147195.349662:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466501888:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.349707:0:8481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.349712:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.349718:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.349720:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 18 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.349724:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147195.349728:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090742d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466502016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.349731:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 41 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.349736:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.349737:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.349739:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.349744:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147195.349755:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 41 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.349968:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 41 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.349977:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.350025:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 12 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.350034:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 12 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.350042:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502272:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.350070:0:8481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 18 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.350075:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004096 00010000:00010000:3.0:1746147195.350077:0:8481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 18 pid: 6881 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.350086:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502400:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.350096:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12253 00000100:00100000:0.0:1746147195.350102:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1958:x1830967464004096:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:3.0:1746147195.350103:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147195.350118:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350128:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350134:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.350141:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350146:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.350148:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.350150:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350164:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 25 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350173:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 25 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.350186:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502528:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.350210:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.350217:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 682 lvb_type: 1 00000100:00100000:0.0:1746147195.350223:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502656:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.350236:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.350242:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 29 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.350248:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502784:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.350256:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.350284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.350341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.350379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.350527:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004352 00000100:00100000:3.0:1746147195.350531:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004352 00000100:00100000:3.0:1746147195.350558:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004480 00000100:00100000:3.0:1746147195.350560:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004480 00000100:00100000:3.0:1746147195.350569:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004608 00000100:00100000:3.0:1746147195.350571:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004608 00000100:00100000:3.0:1746147195.350582:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12254 00000100:00100000:3.0:1746147195.350587:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967464004352:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.350596:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.350605:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f895e00/0xb4b2209fbdac8325 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a90 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.350634:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466502912:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.350635:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12255 00000100:00100000:1.0:1746147195.350642:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464004480:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147195.350650:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.350659:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a81bc00/0xb4b2209fbdac832c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a97 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.350662:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.350684:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090743480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466503040:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.350706:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.358729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.358759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.358780:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004992 00000100:00100000:0.0:1746147195.358786:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004992 00010000:00010000:0.0:1746147195.358818:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 30 pid: 8481 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.358842:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6119 00000100:00100000:0.0:1746147195.358848:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464004992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.358857:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.358876:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 30 pid: 8481 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.358886:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 30 pid: 8481 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.358904:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.359367:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466501376:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.359387:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.359423:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501632:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.359433:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a200/0xb4b2209fbdac8093 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c9 expref: 30 pid: 8481 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.359446:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.359510:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004736 00000100:00100000:1.0:1746147195.359514:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004736 00002000:00100000:1.0:1746147195.359537:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1765375) req@ffff88012c9f2a00 x1830967464004736/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.359552:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967464004736 ext(1048576->1765375) 00010000:00010000:1.0:1746147195.359557:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.359567:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00002000:00010000:1.0:1746147195.359572:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f2a00 00000100:00100000:1.0:1746147195.359591:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1631 00000100:00100000:1.0:1746147195.359595:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967464004736:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:1.0:1746147195.360129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.360146:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464004864 00000100:00100000:1.0:1746147195.360149:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464004864 00010000:00010000:1.0:1746147195.360160:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 15 pid: 8478 timeout: 682 lvb_type: 1 00000100:00100000:1.0:1746147195.360174:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6120 00000100:00100000:1.0:1746147195.360178:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+15:1956:x1830967464004864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.360185:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.360195:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 15 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360203:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 15 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360216:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac81c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79b0 expref: 15 pid: 8478 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360228:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.360244:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967464004864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.360249:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6120 00000100:00100000:1.0:1746147195.360366:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466501248:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.360377:0:4444:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.360408:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090742300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466501888:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.360431:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090742d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8478:1830967466502016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.360441:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.360501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.360510:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005376 00000100:00100000:1.0:1746147195.360512:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005376 00010000:00010000:1.0:1746147195.360521:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 13 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:1.0:1746147195.360534:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6121 00000100:00100000:1.0:1746147195.360538:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967464005376:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.360555:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.360564:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 13 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360572:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 13 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360584:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.360601:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967464005376:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 62us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.360607:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6121 00000100:00100000:1.0:1746147195.360630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.360638:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005248 00000100:00100000:1.0:1746147195.360641:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005248 00010000:00010000:1.0:1746147195.360649:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 13 pid: 17548 timeout: 682 lvb_type: 1 00000100:00100000:1.0:1746147195.360660:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6122 00000100:00100000:1.0:1746147195.360664:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1959:x1830967464005248:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.360670:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.360677:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 13 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360685:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 13 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360695:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b8e00/0xb4b2209fbdac82ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a66 expref: 13 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:1.0:1746147195.360705:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.360716:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+12:1959:x1830967464005248:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.360724:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6122 00000100:00100000:1.0:1746147195.360750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.360758:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005888 00000100:00100000:1.0:1746147195.360760:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005888 00010000:00010000:1.0:1746147195.360768:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 21 pid: 8480 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.360778:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6123 00000100:00100000:1.0:1746147195.360782:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1959:x1830967464005888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.360788:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.360794:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 21 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.360801:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 21 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.360811:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f67fc00/0xb4b2209fbdac8276 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a43 expref: 21 pid: 8480 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.360820:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.360821:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.360825:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360832:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360850:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.360862:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967464005888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 79us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.360867:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6123 00010000:00010000:1.0:1746147195.360879:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360885:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360900:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360907:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360912:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360918:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a81b200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147195.360921:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.360927:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.360987:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967464004992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2138us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.360992:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6119 00000100:00100000:0.0:1746147195.361041:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502528:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.361049:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502656:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147195.361056:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466502784:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.361068:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.361120:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090743480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17530:1830967466503040:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.361133:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a81bc00/0xb4b2209fbdac832c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a97 expref: 44 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.361147:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a81bc00/0xb4b2209fbdac832c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a97 expref: 44 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.361157:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a81bc00, rc 0) 00000100:00100000:0.0:1746147195.361173:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464004480:12345-192.168.203.36@tcp:101:cat.0 Request processed in 10532us (10832us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.361179:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12255 00000100:00100000:0.0:1746147195.361192:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12256 00000100:00100000:0.0:1746147195.361197:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967464004608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.361205:0:17530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.361212:0:17530:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bb000/0xb4b2209fbdac8333 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7a9e expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.361233:0:17530:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bb000/0xb4b2209fbdac8333 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a9e expref: 43 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.361241:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bb000/0xb4b2209fbdac8333 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a9e expref: 43 pid: 17530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.361247:0:17530:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb000, rc 0) 00000100:00100000:0.0:1746147195.361260:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967464004608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 63us (10880us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.361265:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12256 00000100:00100000:0.0:1746147195.361286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.361295:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005504 00000100:00100000:0.0:1746147195.361297:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005504 00010000:00010000:0.0:1746147195.361306:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 28 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:0.0:1746147195.361318:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6124 00000100:00100000:0.0:1746147195.361322:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967464005504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.361328:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.361336:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 28 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361343:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 28 pid: 8481 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361354:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.361355:0:7120:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.361358:0:7120:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.361365:0:7120:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.361373:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.361384:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967464005504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 61us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.361389:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6124 00000100:00100000:0.0:1746147195.361410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.361417:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005760 00000100:00100000:0.0:1746147195.361420:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005760 00010000:00010000:0.0:1746147195.361428:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 682 lvb_type: 1 00000100:00100000:0.0:1746147195.361439:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6125 00000100:00100000:0.0:1746147195.361443:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+14:1956:x1830967464005760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.361448:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.361456:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361463:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361473:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b8c00/0xb4b2209fbdac82a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a5f expref: 14 pid: 17548 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361481:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.361491:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60817ea3-97af-43a7-ab2a-b628d12800db+13:1956:x1830967464005760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.361496:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6125 00000100:00100000:0.0:1746147195.361518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.361531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.361538:0:7120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005632 00000100:00100000:0.0:1746147195.361552:0:7120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005632 00010000:00010000:0.0:1746147195.361562:0:7120:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 28 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.361575:0:7120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6126 00000100:00100000:0.0:1746147195.361579:0:7120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1956:x1830967464005632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.361585:0:7120:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.361591:0:7120:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 28 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.361598:0:7120:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 28 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.361607:0:7120:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9000/0xb4b2209fbdac8261 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4943872->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a2e expref: 28 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.361615:0:7120:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.361628:0:7120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967464005632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 48us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.361633:0:7120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6126 00000100:00100000:0.0:1746147195.361647:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464005120 00000100:00100000:0.0:1746147195.361650:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464005120 00002000:00100000:0.0:1746147195.361664:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (864256->1048575) req@ffff88012c9f1f80 x1830967464005120/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.361672:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967464005120 ext(864256->1048575) 00010000:00010000:0.0:1746147195.361677:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.361685:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 29 pid: 17548 timeout: 682 lvb_type: 0 00002000:00010000:0.0:1746147195.361690:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1f80 00000100:00100000:0.0:1746147195.361701:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1632 00000100:00100000:0.0:1746147195.361705:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967464005120:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:0.0:1746147195.361909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.361918:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006016 00000100:00100000:0.0:1746147195.361921:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006016 00010000:00010000:0.0:1746147195.361930:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 42 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:0.0:1746147195.361960:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6127 00000100:00100000:0.0:1746147195.361964:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967464006016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.361970:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.361978:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 42 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361985:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 42 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:0.0:1746147195.361995:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.362005:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1956:x1830967464006016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 41us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.362010:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6127 00010000:00010000:3.0:1746147195.362194:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8c6a00/0xb4b2209fbdac80c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78fa expref: 41 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.362207:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502144:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.362216:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f075200/0xb4b2209fbdac81c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79a9 expref: 11 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.362223:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.362230:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466502400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.362243:0:8481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.362269:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466502912:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.362280:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f895e00/0xb4b2209fbdac8325 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a90 expref: 26 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.362288:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f895e00/0xb4b2209fbdac8325 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a90 expref: 26 pid: 21080 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.362295:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f895e00, rc 0) 00000100:00100000:3.0:1746147195.362314:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967464004352:12345-192.168.203.36@tcp:101:cat.0 Request processed in 11726us (12029us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.362319:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12254 00010000:00010000:2.0:1746147195.362401:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b95a400/0xb4b2209fbdac80cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7901 expref: 24 pid: 8481 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.362410:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466501504:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.362427:0:6881:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362434:0:6881:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362439:0:6881:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362454:0:6881:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362459:0:6881:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362468:0:6881:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362473:0:6881:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dfb9600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147195.362476:0:6881:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362481:0:6881:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362490:0:6881:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.362495:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9600/0xb4b2209fbdac8309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.362528:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:60817ea3-97af-43a7-ab2a-b628d12800db+12:1958:x1830967464003968:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 13083us (13800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.362534:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12251 00010000:00010000:1.0:1746147195.364438:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.364446:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a81b200/0xb4b2209fbdac8310 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.364715:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967464004224:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 15171us (15972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.364723:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12252 00000100:00100000:2.0:1746147195.364834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.366059:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006144 00000100:00100000:3.0:1746147195.366066:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006144 00010000:00010000:3.0:1746147195.366091:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 20 pid: 6881 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.366120:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6128 00000100:00100000:3.0:1746147195.366126:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1959:x1830967464006144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.366136:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.366152:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 20 pid: 6881 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.366161:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 20 pid: 6881 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.366176:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e200/0xb4b2209fbdac808c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e78c2 expref: 20 pid: 6881 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.366186:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.366188:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.366191:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366198:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366216:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.366252:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967464006144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.366258:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6128 00010000:00010000:3.0:1746147195.366276:0:8481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366283:0:8481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366299:0:8481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366304:0:8481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366310:0:8481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366315:0:8481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b9400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147195.366318:0:8481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366323:0:8481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366331:0:8481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.366336:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9400/0xb4b2209fbdac8317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.366372:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60817ea3-97af-43a7-ab2a-b628d12800db+9:1958:x1830967464003840:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 17449us (17703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.366378:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12248 00000100:00100000:2.0:1746147195.375490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.375549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.375556:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006272 00000100:00100000:3.0:1746147195.375564:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006272 00000100:00100000:2.0:1746147195.375568:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006400 00000100:00100000:2.0:1746147195.375571:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006400 00010000:00010000:2.0:1746147195.375594:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 31 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.375616:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12257 00000100:00100000:2.0:1746147195.375619:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6129 00000100:00100000:3.0:1746147195.375623:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29258:x1830967464006272:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:2.0:1746147195.375624:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967464006400:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.375635:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.375636:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.375648:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7aa5 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.375654:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 31 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.375663:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 31 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.375665:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.375669:0:8481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.375675:0:8481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147195.375675:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8a00/0xb4b2209fbdac823e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a0b expref: 31 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.375678:0:8481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.375689:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.375690:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.375691:0:8481:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.375693:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.375699:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.375700:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 25 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.375707:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f895a00, rc 0) 00010000:00010000:2.0:1746147195.375721:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.375749:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29258:x1830967464006272:12345-192.168.203.36@tcp:101:cat.0 Request processed in 120us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.375753:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12257 00000100:00100000:2.0:1746147195.375895:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967464006400:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 270us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.375901:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6129 00010000:00010000:0.0:1746147195.376697:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376707:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376729:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376737:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376743:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376749:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800904bac00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147195.376752:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376758:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376767:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.376772:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bac00/0xb4b2209fbdac831e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.376825:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60817ea3-97af-43a7-ab2a-b628d12800db+11:1958:x1830967464004096:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 26723us (28134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.376831:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12253 00000100:00100000:0.0:1746147195.381087:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464005120:12345-192.168.203.36@tcp:4:cat.0 Request processed in 19370us (19556us total) trans 21474840696 rc 0/0 00000100:00100000:0.0:1746147195.381098:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1632 00002000:00100000:0.0:1746147195.381107:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (864256->1048575) req@ffff88012c9f1f80 x1830967464005120/t21474840696(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.381115:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f1f80 with x1830967464005120 ext(864256->1048575) 00010000:00010000:0.0:1746147195.381124:0:21472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.381134:0:21472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00002000:00010000:0.0:1746147195.381141:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c9f1f80 00000100:00100000:1.0:1746147195.383441:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967464004736:12345-192.168.203.36@tcp:4:cat.0 Request processed in 23838us (24715us total) trans 17179873284 rc 0/0 00000100:00100000:1.0:1746147195.383451:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1631 00002000:00100000:1.0:1746147195.383458:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->1765375) req@ffff88012c9f2a00 x1830967464004736/t17179873284(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.383466:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2a00 with x1830967464004736 ext(1048576->1765375) 00010000:00010000:1.0:1746147195.383473:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.383485:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00002000:00010000:1.0:1746147195.383491:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c9f2a00 00000100:00100000:2.0:1746147195.383989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.384746:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006528 00000100:00100000:3.0:1746147195.384752:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006528 00010000:00010000:3.0:1746147195.384772:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.384799:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6130 00000100:00100000:3.0:1746147195.384806:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1957:x1830967464006528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.384814:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.384828:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.384836:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.384852:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9e00/0xb4b2209fbdac8222 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e79e1 expref: 30 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.384874:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.384875:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.384879:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.384885:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.384911:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.384932:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1957:x1830967464006528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 126us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.384951:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6130 00010000:00010000:1.0:1746147195.385005:0:4444:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385019:0:4444:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385121:0:4444:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385129:0:4444:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385136:0:4444:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385141:0:4444:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dfb9400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147195.385144:0:4444:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385151:0:4444:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385160:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.385161:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.385167:0:4444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385174:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.385202:0:4444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 24 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.385212:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466503168:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147195.385274:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.393205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.393854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.394096:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4444:1830967466503168:192.168.203.36@tcp:105: 00010000:00010000:1.0:1746147195.394114:0:4444:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.394122:0:4444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9400/0xb4b2209fbdac82fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.394462:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006784 00000100:00100000:3.0:1746147195.394468:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006784 00000100:00100000:1.0:1746147195.394520:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:60817ea3-97af-43a7-ab2a-b628d12800db+10:1958:x1830967464003584:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 45449us (45891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.394528:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12249 00000100:00100000:1.0:1746147195.394568:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464006912 00000100:00100000:1.0:1746147195.394571:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464006912 00010000:00010000:1.0:1746147195.394587:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.394604:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6131 00000100:00100000:1.0:1746147195.394610:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1957:x1830967464006912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.394619:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.394638:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.394648:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.394665:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8245 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1765375) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a12 expref: 19 pid: 17548 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.394675:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.394677:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.394680:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.394688:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.394875:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10627 00000100:00100000:3.0:1746147195.394882:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+325:29260:x1830967464006784:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147195.394898:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.394909:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895e00/0xb4b2209fbdac8341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7aac expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.394990:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.395002:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.395009:0:14048:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.395014:0:14048:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.395033:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.395043:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 24 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.395053:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466503296:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.395291:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147195.395460:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395468:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395491:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395498:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395504:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395510:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dfb8e00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147195.395512:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395519:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395532:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.395538:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac8302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.395866:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+18:1957:x1830967464006912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1253us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.395873:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6131 00010000:00010000:3.0:1746147195.395883:0:14048:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 24 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.395891:0:14048:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 24 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.395898:0:14048:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466503424:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.396123:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:60817ea3-97af-43a7-ab2a-b628d12800db+8:1958:x1830967464003712:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 46789us (47405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.396130:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12250 00000100:00100000:2.0:1746147195.396196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.396256:0:14048:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.396767:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464007168 00000100:00100000:0.0:1746147195.396772:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464007168 00002000:00100000:1.0:1746147195.397054:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d00700 x1830967464007168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.397063:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00700 with x1830967464007168 ext(0->1048575) 00002000:00010000:1.0:1746147195.397067:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00700 00000100:00100000:1.0:1746147195.397082:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4799 00000100:00100000:1.0:1746147195.397087:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967464007168:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.398710:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466503424:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.401510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.401628:0:14048:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14048:1830967466503296:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147195.401656:0:14048:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147195.401766:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464007424 00000100:00100000:3.0:1746147195.401774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.401776:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464007424 00010000:00010000:1.0:1746147195.401805:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.401835:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464007296 00000100:00100000:1.0:1746147195.401837:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464007296 00010000:00010000:1.0:1746147195.401845:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 26 pid: 16361 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.401868:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6132 00000100:00100000:1.0:1746147195.401875:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+26:1956:x1830967464007424:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.401885:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.401890:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 26 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.401898:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 26 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.401914:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac82ed lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a89 expref: 26 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.401927:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147195.401931:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147195.401963:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:1.0:1746147195.401968:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.402071:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6133 00000100:00100000:2.0:1746147195.402078:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+25:1956:x1830967464007296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.402085:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.402089:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.402097:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.402108:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfb9800/0xb4b2209fbdac82d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7a74 expref: 25 pid: 16361 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.402115:0:11078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.402118:0:11078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.402125:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.402131:0:11078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.402147:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.402168:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60817ea3-97af-43a7-ab2a-b628d12800db+24:1956:x1830967464007296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.402174:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6133 00010000:00010000:0.0:1746147195.402669:0:14048:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147195.402677:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60817ea3-97af-43a7-ab2a-b628d12800db+23:1956:x1830967464007424:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 800us (1176us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147195.402677:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:1.0:1746147195.402684:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6132 00000004:00200000:0.0:1746147195.402698:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:0.0:1746147195.402842:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895e00/0xb4b2209fbdac8341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aac expref: 328 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.402877:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aac expref: 327 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.402884:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147195.402887:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147195.402890:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f895800, rc 0) 00000100:00100000:0.0:1746147195.404391:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+327:29260:x1830967464006784:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 9501us (11183us total) trans 8589944403 rc 0/0 00000100:00100000:0.0:1746147195.404400:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10627 00000100:00100000:0.0:1746147195.407862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.407925:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464007680 00000100:00100000:2.0:1746147195.407962:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464007680 00000100:00100000:2.0:1746147195.408010:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10628 00000100:00100000:2.0:1746147195.408017:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464007680:12345-192.168.203.36@tcp:36:lfs.0 00000100:00100000:2.0:1746147195.408125:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464007680:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 107us (272us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147195.408130:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10628 00000100:00100000:3.0:1746147195.411808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.413167:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967464007168:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16075us (16965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.413176:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4799 00002000:00100000:1.0:1746147195.413185:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff880134d00700 x1830967464007168/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.413193:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d00700 with x1830967464007168 ext(0->1048575) 00002000:00010000:1.0:1746147195.413198:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d00700 00000100:00100000:2.0:1746147195.414031:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464007936 00000100:00100000:2.0:1746147195.414038:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464007936 00000100:00100000:2.0:1746147195.414067:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4240 00000100:00100000:2.0:1746147195.414073:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+23:29254:x1830967464007936:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147195.414221:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:60817ea3-97af-43a7-ab2a-b628d12800db+24:29254:x1830967464007936:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 147us (2419us total) trans 8589944404 rc 0/0 00000100:00100000:2.0:1746147195.414227:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4240 00000100:00100000:2.0:1746147195.420691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.420767:0:14050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464008192 00000100:00100000:3.0:1746147195.420774:0:14050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464008192 00000100:00100000:3.0:1746147195.420808:0:14050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4241 00000100:00100000:3.0:1746147195.420814:0:14050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+24:29254:x1830967464008192:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1746147195.420994:0:14050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60817ea3-97af-43a7-ab2a-b628d12800db+25:29254:x1830967464008192:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 179us (309us total) trans 8589944405 rc 0/0 00000100:00100000:3.0:1746147195.420999:0:14050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4241 00000100:00100000:0.0:1746147195.421995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.422056:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464008320 00000100:00100000:2.0:1746147195.422061:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464008320 00000100:00100000:2.0:1746147195.422095:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12258 00000100:00100000:2.0:1746147195.422101:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+41:29258:x1830967464008320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.422110:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.422126:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ab3 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147195.422148:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x821 00010000:00010000:2.0:1746147195.422161:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.422163:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.422169:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.422181:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.422189:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dd200, rc 0) 00000100:00100000:2.0:1746147195.422223:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:29258:x1830967464008320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 122us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.422228:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12258 00000100:00100000:3.0:1746147195.429076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.429145:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464008576 00000100:00100000:1.0:1746147195.429153:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464008576 00002000:00100000:1.0:1746147195.429185:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009ee5d180 x1830967464008576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.429193:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d180 with x1830967464008576 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.429197:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5d180 00000100:00100000:0.0:1746147195.430305:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4800 00000100:00100000:0.0:1746147195.430315:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967464008576:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.433727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.433796:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464008704 00000100:00100000:1.0:1746147195.433804:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464008704 00000100:00100000:1.0:1746147195.433846:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12259 00000100:00100000:1.0:1746147195.433853:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29260:x1830967464008704:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147195.433868:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.433883:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7aba expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147195.433902:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x821 00010000:00010000:1.0:1746147195.433917:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.433919:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.433924:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.433956:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.433965:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a81a800, rc 0) 00000100:00100000:1.0:1746147195.434006:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29260:x1830967464008704:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 153us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.434011:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12259 00000100:00100000:2.0:1746147195.436713:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967464008576:12345-192.168.203.36@tcp:3:cat.0 Request processed in 6393us (7637us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.436723:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4800 00002000:00100000:2.0:1746147195.436731:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff88009ee5d180 x1830967464008576/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.436740:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee5d180 with x1830967464008576 ext(1048576->2097151) 00002000:00010000:2.0:1746147195.436745:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee5d180 00000100:00100000:0.0:1746147195.446060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.446145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.446185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.446267:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464009344 00000100:00100000:2.0:1746147195.446275:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464009344 00000100:00100000:2.0:1746147195.446321:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12260 00000100:00100000:2.0:1746147195.446328:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+42:29258:x1830967464009344:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.446344:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.446361:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ac8 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147195.446381:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x68141778, atime: 0x68141778, ctime: 0x68141778, blocks: 0x81d 00010000:00010000:2.0:1746147195.446397:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.446398:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.446405:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.446418:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.446430:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb60000, rc 0) 00000100:00100000:2.0:1746147195.446466:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29258:x1830967464009344:12345-192.168.203.36@tcp:101:cat.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.446472:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12260 00000100:00100000:2.0:1746147195.446500:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464009216 00000100:00100000:2.0:1746147195.446503:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464009216 00000100:00100000:2.0:1746147195.446522:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10629 00000100:00100000:2.0:1746147195.446526:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136953050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+48:29262:x1830967464009216:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147195.446537:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.446555:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb61e00/0xb4b2209fbdac836b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ac1 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.446630:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446643:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446650:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446659:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446664:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446669:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446748:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60800/0xb4b2209fbdac8380 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446755:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60800/0xb4b2209fbdac8380 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446760:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60800/0xb4b2209fbdac8380 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:2.0:1746147195.446766:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:2.0:1746147195.446823:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446828:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446833:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446840:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb60600 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147195.446843:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446848:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446855:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147195.446857:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147195.446859:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446862:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60600/0xb4b2209fbdac8372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446874:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446879:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446883:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446886:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bb60200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147195.446887:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446891:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446895:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800949e8a00) 00010000:00010000:2.0:1746147195.446896:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147195.446898:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446902:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60200/0xb4b2209fbdac8379 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:2.0:1746147195.446928:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb61e00/0xb4b2209fbdac836b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac1 expref: 51 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.446966:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60800/0xb4b2209fbdac8380 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac1 expref: 50 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.446971:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.446972:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147195.446974:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bb60800, rc 0) 00000100:00100000:2.0:1746147195.446991:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136953050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+50:29262:x1830967464009216:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 465us (847us total) trans 8589944406 rc 0/0 00000100:00100000:2.0:1746147195.446996:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10629 00000100:00100000:3.0:1746147195.447814:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464008960 00000100:00100000:3.0:1746147195.447818:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464008960 00002000:00100000:3.0:1746147195.447841:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1900544->1904639) req@ffff88012c9f2d80 x1830967464008960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.447854:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2d80 with x1830967464008960 ext(1900544->1904639) 00002000:00010000:3.0:1746147195.447857:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2d80 00000100:00100000:3.0:1746147195.447869:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4801 00000100:00100000:3.0:1746147195.447874:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967464008960:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147195.447985:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1959:x1830967464008960:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 110us (1932us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147195.447990:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4801 00002000:00100000:3.0:1746147195.447994:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x418:0x0] (1900544->1904639) req@ffff88012c9f2d80 x1830967464008960/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.448000:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f2d80 with x1830967464008960 ext(1900544->1904639) 00002000:00010000:3.0:1746147195.448003:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f2d80 00000100:00100000:0.0:1746147195.452706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.452752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.452832:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464009472 00000100:00100000:1.0:1746147195.452839:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464009472 00000100:00100000:1.0:1746147195.452881:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12261 00000100:00100000:1.0:1746147195.452888:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+18:29262:x1830967464009472:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:1.0:1746147195.452903:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.452918:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7acf expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.452965:0:4444:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.452972:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.452974:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.452977:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1437696->1449983] (req 1437696->1449983) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.453001:0:4444:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 42 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.453012:0:4444:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 42 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.453023:0:4444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466503552:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147195.453086:0:4444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.453282:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464009600 00000100:00100000:2.0:1746147195.453285:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464009600 00000100:00100000:2.0:1746147195.453309:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 608 00000100:00100000:2.0:1746147195.453314:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+50:1959:x1830967464009600:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.453322:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.453336:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bb60800/0xb4b2209fbdac8380 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac1 expref: 50 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.453364:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.453368:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.453473:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+49:1959:x1830967464009600:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 158us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.453480:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 608 00000100:00100000:0.0:1746147195.458023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.458570:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464009728 00000100:00100000:3.0:1746147195.458577:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464009728 00000100:00100000:3.0:1746147195.458613:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12262 00000100:00100000:3.0:1746147195.458619:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+26:29260:x1830967464009728:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147195.458634:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.458648:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ad6 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147195.458671:0:4445:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4945696, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x1607 00010000:00010000:3.0:1746147195.458688:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.458690:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.458697:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.458715:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 27 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.458724:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075000, rc 0) 00000100:00100000:3.0:1746147195.458760:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+27:29260:x1830967464009728:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 142us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.458766:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12262 00000100:00100000:1.0:1746147195.458836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.459306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.459357:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464010112 00000100:00100000:2.0:1746147195.459361:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464010112 00002000:00100000:2.0:1746147195.459382:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090743b80 x1830967464010112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.459391:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743b80 with x1830967464010112 ext(1048576->2097151) 00010000:00010000:2.0:1746147195.459397:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.459407:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.459413:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090743b80 00000100:00100000:2.0:1746147195.459423:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464010240 00000100:00100000:2.0:1746147195.459426:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464010240 00002000:00100000:2.0:1746147195.459436:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1900543) req@ffff880090741180 x1830967464010240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.459442:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741180 with x1830967464010240 ext(1048576->1900543) 00002000:00010000:2.0:1746147195.459445:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741180 00000100:00100000:2.0:1746147195.459465:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1633 00000100:00100000:2.0:1746147195.459470:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464010112:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.461058:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4802 00000100:00100000:1.0:1746147195.461066:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967464010240:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.462584:0:4444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4444:1830967466503552:192.168.203.36@tcp:104: 00010000:00010000:1.0:1746147195.462602:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1437696->1449983] (req 1437696->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 19 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.462614:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a81a600, rc 0) 00000100:00100000:1.0:1746147195.463234:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+19:29262:x1830967464009472:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 10344us (10533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.463241:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12261 00000100:00100000:0.0:1746147195.468260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.469474:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464010496 00000100:00100000:3.0:1746147195.469485:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464010496 00002000:00100000:3.0:1746147195.469529:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2265088->2269183) req@ffff88012c9f0380 x1830967464010496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.469547:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967464010496 ext(2265088->2269183) 00002000:00010000:3.0:1746147195.469552:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0380 00000100:00100000:3.0:1746147195.469603:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4803 00000100:00100000:3.0:1746147195.469611:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967464010496:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147195.469800:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967464010496:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 189us (1549us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147195.469806:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4803 00002000:00100000:3.0:1746147195.469811:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (2265088->2269183) req@ffff88012c9f0380 x1830967464010496/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.469817:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c9f0380 with x1830967464010496 ext(2265088->2269183) 00002000:00010000:3.0:1746147195.469820:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c9f0380 00000100:00100000:2.0:1746147195.473523:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464010112:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 14044us (14677us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.473534:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1633 00002000:00100000:2.0:1746147195.473554:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090743b80 x1830967464010112/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.473562:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743b80 with x1830967464010112 ext(1048576->2097151) 00010000:00010000:2.0:1746147195.473570:0:26114:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.473583:0:26114:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00002000:00010000:2.0:1746147195.473588:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090743b80 00000100:00100000:2.0:1746147195.480043:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967464010240:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 18968us (20725us total) trans 0 rc 851968/851968 00000100:00100000:2.0:1746147195.480054:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4802 00002000:00100000:2.0:1746147195.480066:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->1900543) req@ffff880090741180 x1830967464010240/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 851968/851968 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.480075:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741180 with x1830967464010240 ext(1048576->1900543) 00002000:00010000:2.0:1746147195.480080:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741180 00000100:00100000:0.0:1746147195.485205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.485304:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464010624 00000100:00100000:2.0:1746147195.485311:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464010624 00010000:00010000:2.0:1746147195.485344:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.485366:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6134 00000100:00100000:2.0:1746147195.485372:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967464010624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.485734:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.485758:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.485769:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.485787:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bb60000/0xb4b2209fbdac8364 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ac8 expref: 43 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.485829:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.485831:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.485837:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.485843:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.485871:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 18 pid: 4444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.485881:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466503680:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.486523:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.492922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.492984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.492995:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464010880 00000100:00100000:3.0:1746147195.493005:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464010880 00000100:00100000:1.0:1746147195.493006:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464011136 00000100:00100000:1.0:1746147195.493009:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464011136 00002000:00100000:3.0:1746147195.493049:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2269184->3145727) req@ffff880090741c00 x1830967464010880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.493060:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741c00 with x1830967464010880 ext(2269184->3145727) 00002000:00010000:3.0:1746147195.493065:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741c00 00000100:00100000:3.0:1746147195.493082:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4804 00000100:00100000:3.0:1746147195.493087:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967464010880:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.493128:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466503680:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.493148:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.493192:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+42:1959:x1830967464010624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 7819us (7993us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.493200:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6134 00002000:00100000:1.0:1746147195.493347:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1437696->1441791) req@ffff880090742a00 x1830967464011136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.493364:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742a00 with x1830967464011136 ext(1437696->1441791) 00002000:00010000:1.0:1746147195.493368:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742a00 00000100:00100000:1.0:1746147195.493409:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4805 00000100:00100000:1.0:1746147195.493421:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967464011136:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.493588:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967464011136:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 172us (603us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.493594:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4805 00002000:00100000:1.0:1746147195.493599:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1437696->1441791) req@ffff880090742a00 x1830967464011136/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.493605:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742a00 with x1830967464011136 ext(1437696->1441791) 00002000:00010000:1.0:1746147195.493608:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090742a00 00000100:00100000:0.0:1746147195.496910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.497287:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464011392 00000100:00100000:1.0:1746147195.497295:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464011392 00002000:00100000:1.0:1746147195.497329:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1445888->1449983) req@ffff88012e2bb480 x1830967464011392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.497338:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967464011392 ext(1445888->1449983) 00002000:00010000:1.0:1746147195.497342:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00000100:00100000:1.0:1746147195.497369:0:26114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4806 00000100:00100000:1.0:1746147195.497376:0:26114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967464011392:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.497518:0:26114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1959:x1830967464011392:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 142us (615us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.497852:0:26114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4806 00002000:00100000:1.0:1746147195.497860:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x41d:0x0] (1445888->1449983) req@ffff88012e2bb480 x1830967464011392/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.497868:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb480 with x1830967464011392 ext(1445888->1449983) 00002000:00010000:1.0:1746147195.497871:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2bb480 00000100:00100000:0.0:1746147195.501556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.501664:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464011648 00000100:00100000:2.0:1746147195.501674:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464011648 00000100:00100000:2.0:1746147195.501869:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4242 00000100:00100000:2.0:1746147195.501878:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+49:29262:x1830967464011648:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147195.502677:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+50:29262:x1830967464011648:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 799us (1139us total) trans 8589944407 rc 0/0 00000100:00100000:2.0:1746147195.502684:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4242 00000100:00100000:3.0:1746147195.504303:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1958:x1830967464010880:12345-192.168.203.36@tcp:3:cat.0 Request processed in 11208us (11383us total) trans 0 rc 876544/876544 00000100:00100000:3.0:1746147195.504319:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4804 00002000:00100000:3.0:1746147195.504330:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2269184->3145727) req@ffff880090741c00 x1830967464010880/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.504340:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741c00 with x1830967464010880 ext(2269184->3145727) 00002000:00010000:3.0:1746147195.504347:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090741c00 00000100:00100000:0.0:1746147195.510685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.510786:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464011776 00000100:00100000:1.0:1746147195.510796:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464011776 00000100:00100000:1.0:1746147195.511221:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12263 00000100:00100000:1.0:1746147195.511230:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+42:29258:x1830967464011776:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147195.511248:0:4444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.511266:0:4444:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7add expref: -99 pid: 4444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147195.511287:0:4444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x1029 00010000:00010000:1.0:1746147195.511307:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.511309:0:4444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.511316:0:4444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 43 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.511329:0:4444:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 43 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.511337:0:4444:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9200, rc 0) 00000100:00100000:1.0:1746147195.511636:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29258:x1830967464011776:12345-192.168.203.36@tcp:101:cat.0 Request processed in 406us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.511642:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12263 00000100:00100000:0.0:1746147195.512390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.512528:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012032 00000100:00100000:3.0:1746147195.512534:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012032 00000100:00100000:3.0:1746147195.512589:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10630 00000100:00100000:3.0:1746147195.512596:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+50:29269:x1830967464012032:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.512612:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.512625:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f075200/0xb4b2209fbdac83a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ae4 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.512725:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512736:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512746:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512759:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512763:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512768:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512868:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac83b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512876:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac83b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.512882:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac83b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:3.0:1746147195.512890:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147195.513003:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513010:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513016:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513022:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f074200 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.513026:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513033:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513042:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147195.513045:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.513048:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513053:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f074200/0xb4b2209fbdac83aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513073:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513077:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513082:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513086:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094eb1800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.513088:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513091:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513096:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48d00) 00010000:00010000:3.0:1746147195.513098:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.513099:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513103:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1800/0xb4b2209fbdac83b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:3.0:1746147195.513138:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f075200/0xb4b2209fbdac83a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ae4 expref: 53 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.513147:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac83b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ae4 expref: 52 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.513153:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.513155:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147195.513157:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb1600, rc 0) 00000100:00100000:3.0:1746147195.513206:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+52:29269:x1830967464012032:12345-192.168.203.36@tcp:101:cat.0 Request processed in 610us (816us total) trans 8589944408 rc 0/0 00000100:00100000:3.0:1746147195.513212:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10630 00000100:00100000:0.0:1746147195.520021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.520059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.520089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.520111:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012160 00000100:00100000:0.0:1746147195.520120:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012160 00000100:00100000:0.0:1746147195.520168:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012416 00000100:00100000:0.0:1746147195.520170:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012416 00000100:00100000:0.0:1746147195.520186:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12264 00000100:00100000:0.0:1746147195.520192:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+29:1956:x1830967464012160:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:3.0:1746147195.520205:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12265 00010000:00010000:0.0:1746147195.520210:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147195.520213:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+19:1956:x1830967464012416:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.520222:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.520226:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904ba200/0xb4b2209fbdac83c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7aeb expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.520233:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac83cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7af2 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.520246:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.520246:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.520248:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.520248:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.520257:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac83cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7af2 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.520257:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800904ba200/0xb4b2209fbdac83c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aeb expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.520270:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac83cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7af2 expref: 20 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.520270:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904ba200/0xb4b2209fbdac83c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aeb expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.520279:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094eb0600, rc 0) 00010000:00010000:0.0:1746147195.520279:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904ba200, rc 0) 00000100:00100000:2.0:1746147195.520491:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012288 00000100:00100000:2.0:1746147195.520496:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012288 00000100:00100000:2.0:1746147195.520532:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 609 00000100:00100000:2.0:1746147195.520538:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+52:1957:x1830967464012288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.520557:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.520704:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094eb1600/0xb4b2209fbdac83b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ae4 expref: 52 pid: 16361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.520932:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464012160:12345-192.168.203.36@tcp:101:cat.0 Request processed in 739us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.520951:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12264 00000100:00100000:3.0:1746147195.520999:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967464012416:12345-192.168.203.36@tcp:101:cat.0 Request processed in 786us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.521004:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12265 00000100:00100000:0.0:1746147195.521050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147195.521126:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147195.521130:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.521137:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.521147:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012544 00000100:00100000:2.0:1746147195.521149:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+51:1957:x1830967464012288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 611us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.521150:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012544 00000100:00100000:2.0:1746147195.521155:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 609 00000100:00100000:0.0:1746147195.521160:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012672 00000100:00100000:0.0:1746147195.521162:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012672 00000100:00100000:0.0:1746147195.521170:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12266 00000100:00100000:0.0:1746147195.521174:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464012544:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.521181:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.521188:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac83d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7af9 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.521226:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466503808:192.168.203.36@tcp:106: 00000100:00100000:0.0:1746147195.521286:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.521325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.521341:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464012800 00000100:00100000:3.0:1746147195.521345:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464012800 00000100:00100000:3.0:1746147195.521364:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12267 00000100:00100000:3.0:1746147195.521369:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967464012672:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.521375:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.521382:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f075200/0xb4b2209fbdac83db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b00 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.521403:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466503936:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.521424:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.521442:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12268 00000100:00100000:3.0:1746147195.521446:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+20:1956:x1830967464012800:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.521452:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.521459:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b07 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.521468:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.521470:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.521474:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.521483:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.521494:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dc800, rc 0) 00000100:00100000:3.0:1746147195.521507:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1956:x1830967464012800:12345-192.168.203.36@tcp:101:cat.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.521512:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12268 00000100:00100000:0.0:1746147195.521573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.521589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.521610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.521624:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464013056 00000100:00100000:0.0:1746147195.521627:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464013056 00002000:00100000:0.0:1746147195.521653:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e1880 x1830967464013056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.521662:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967464013056 ext(2097152->3145727) 00002000:00010000:0.0:1746147195.521667:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:0.0:1746147195.521689:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464013312 00000100:00100000:0.0:1746147195.521692:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464013312 00000100:00100000:1.0:1746147195.521695:0:26114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464013568 00000100:00100000:1.0:1746147195.521698:0:26114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464013568 00002000:00100000:0.0:1746147195.521702:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800b52e1180 x1830967464013312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.521708:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967464013312 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.521711:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1180 00002000:00100000:1.0:1746147195.521712:0:26114:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e1500 x1830967464013568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.521718:0:26114:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1500 with x1830967464013568 ext(3145728->4194303) 00002000:00010000:1.0:1746147195.521722:0:26114:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1500 00000100:00100000:0.0:1746147195.521726:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4807 00000100:00100000:0.0:1746147195.521730:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967464013056:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.522019:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4808 00000100:00100000:1.0:1746147195.522025:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967464013312:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.522488:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4809 00000100:00100000:2.0:1746147195.522497:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967464013568:12345-192.168.203.36@tcp:3:cat.0 00002000:00010000:0.0:1746147195.524150:0:11147:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime: 1746147194 -> 1746147195 00002000:00010000:0.0:1746147195.524156:0:11147:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime: 1746147194 -> 1746147195 00002000:00010000:0.0:1746147195.524158:0:11147:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime: 1746147194 -> 1746147195 00000100:00100000:0.0:1746147195.524175:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466503808:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.524203:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac83d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7af9 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.524214:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904bb200/0xb4b2209fbdac83d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7af9 expref: 33 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.524226:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bb200, rc 0) 00000100:00100000:0.0:1746147195.524262:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967464012544:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3087us (3212us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147195.524269:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12266 00002000:00010000:3.0:1746147195.524841:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime: 1746147194 -> 1746147195 00002000:00010000:3.0:1746147195.524845:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime: 1746147194 -> 1746147195 00002000:00010000:3.0:1746147195.524847:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime: 1746147194 -> 1746147195 00000100:00100000:3.0:1746147195.524855:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466503936:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.524873:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f075200/0xb4b2209fbdac83db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b00 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.524883:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f075200/0xb4b2209fbdac83db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b00 expref: 31 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.524894:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f075200, rc 0) 00000100:00100000:3.0:1746147195.524913:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464012672:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3543us (3776us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.524918:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12267 00000100:00100000:2.0:1746147195.535086:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1959:x1830967464013568:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12580us (13465us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.535098:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4809 00002000:00100000:2.0:1746147195.535111:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e1500 x1830967464013568/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.535120:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1500 with x1830967464013568 ext(3145728->4194303) 00002000:00010000:2.0:1746147195.535126:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1500 00000100:00100000:0.0:1746147195.540019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.540120:0:21472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464013824 00000100:00100000:2.0:1746147195.540128:0:21472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464013824 00002000:00100000:2.0:1746147195.540162:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800b52e2300 x1830967464013824/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.540170:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2300 with x1830967464013824 ext(0->1048575) 00002000:00010000:2.0:1746147195.540174:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2300 00000100:00100000:2.0:1746147195.540201:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4810 00000100:00100000:2.0:1746147195.540208:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464013824:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.541912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.541967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.542039:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014080 00000100:00100000:3.0:1746147195.542050:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014080 00002000:00100000:3.0:1746147195.542091:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800b52e0380 x1830967464014080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.542100:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967464014080 ext(1048576->2097151) 00002000:00010000:3.0:1746147195.542104:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0380 00000100:00100000:3.0:1746147195.542129:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014336 00000100:00100000:3.0:1746147195.542131:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014336 00002000:00100000:3.0:1746147195.542141:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090741880 x1830967464014336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 504/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.542147:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741880 with x1830967464014336 ext(1048576->2097151) 00002000:00010000:3.0:1746147195.542150:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090741880 00000100:00100000:3.0:1746147195.542160:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4811 00000100:00100000:3.0:1746147195.542166:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967464014080:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.542247:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967464013312:12345-192.168.203.36@tcp:3:cat.0 Request processed in 20221us (20655us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.542256:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4808 00002000:00100000:1.0:1746147195.542265:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800b52e1180 x1830967464013312/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.542273:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1180 with x1830967464013312 ext(3145728->4194303) 00002000:00010000:1.0:1746147195.542277:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1180 00000100:00100000:1.0:1746147195.542297:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4812 00000100:00100000:1.0:1746147195.542305:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1956:x1830967464014336:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.549114:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967464013056:12345-192.168.203.36@tcp:3:cat.0 Request processed in 27375us (27533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.549124:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4807 00002000:00100000:3.0:1746147195.549133:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e1880 x1830967464013056/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.549141:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1880 with x1830967464013056 ext(2097152->3145727) 00002000:00010000:3.0:1746147195.549146:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e1880 00000100:00100000:1.0:1746147195.549408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.549421:0:21209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014464 00000100:00100000:2.0:1746147195.549428:0:21209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014464 00002000:00100000:2.0:1746147195.549457:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1437696->1449983) req@ffff880090740700 x1830967464014464/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 12776/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.549465:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740700 with x1830967464014464 ext(1437696->1449983) 00002000:00010000:2.0:1746147195.549469:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740700 00000100:00100000:2.0:1746147195.549483:0:21209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4813 00000100:00100000:2.0:1746147195.549489:0:21209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1957:x1830967464014464:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:2.0:1746147195.549778:0:21209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+27:1957:x1830967464014464:12345-192.168.203.36@tcp:4:cat.0 Request processed in 288us (371us total) trans 17179873285 rc 0/0 00000100:00100000:2.0:1746147195.549784:0:21209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4813 00002000:00100000:2.0:1746147195.549790:0:21209:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x41d:0x0] (1437696->1449983) req@ffff880090740700 x1830967464014464/t17179873285(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 12776/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.549797:0:21209:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090740700 with x1830967464014464 ext(1437696->1449983) 00002000:00010000:2.0:1746147195.549800:0:21209:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090740700 00000100:00100000:3.0:1746147195.550729:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:66a3cdf6-ed02-4a11-b851-60f72c886415+30:1956:x1830967464013824:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10518us (10713us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.550737:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4810 00002000:00100000:3.0:1746147195.550743:0:21472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x416:0x0] (0->1048575) req@ffff8800b52e2300 x1830967464013824/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.550749:0:21472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2300 with x1830967464013824 ext(0->1048575) 00002000:00010000:3.0:1746147195.550752:0:21472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2300 00000100:00100000:3.0:1746147195.557341:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967464014080:12345-192.168.203.36@tcp:3:cat.0 Request processed in 15167us (15425us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.557354:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4811 00002000:00100000:3.0:1746147195.557363:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41c:0x0] (1048576->2097151) req@ffff8800b52e0380 x1830967464014080/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.557370:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0380 with x1830967464014080 ext(1048576->2097151) 00002000:00010000:3.0:1746147195.557375:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0380 00000100:00100000:0.0:1746147195.558824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.559028:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014592 00000100:00100000:3.0:1746147195.559034:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014592 00000100:00100000:3.0:1746147195.559075:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12269 00000100:00100000:3.0:1746147195.559081:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967464014592:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.559094:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.559107:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac83e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b0e expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.559229:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466504064:192.168.203.36@tcp:106: 00000100:00100000:3.0:1746147195.559366:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.561486:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967464014336:12345-192.168.203.36@tcp:3:cat.0 Request processed in 19176us (19513us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746147195.561507:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4812 00002000:00100000:1.0:1746147195.561516:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff880090741880 x1830967464014336/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 504/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.561524:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090741880 with x1830967464014336 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.561529:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090741880 00002000:00010000:3.0:1746147195.565168:0:4445:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime: 1746147192 -> 1746147195 00002000:00010000:3.0:1746147195.565174:0:4445:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime: 1746147192 -> 1746147195 00002000:00010000:3.0:1746147195.565176:0:4445:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime: 1746147192 -> 1746147195 00000100:00100000:3.0:1746147195.565206:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466504064:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.565233:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac83e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b0e expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.565244:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9600/0xb4b2209fbdac83e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b0e expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.565509:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9600, rc 0) 00000100:00100000:3.0:1746147195.565572:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1959:x1830967464014592:12345-192.168.203.36@tcp:101:cat.0 Request processed in 6488us (6749us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.565579:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12269 00000100:00100000:0.0:1746147195.578335:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.578468:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014720 00000100:00100000:3.0:1746147195.578476:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014720 00000100:00100000:3.0:1746147195.578516:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12270 00000100:00100000:3.0:1746147195.578522:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+30:29269:x1830967464014720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.578536:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.578561:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b15 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.578585:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.578592:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.578594:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.578597:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.578619:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 26 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.578629:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 26 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.578644:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466504192:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.578726:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.579806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.580006:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4445:1830967466504192:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.580024:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.580035:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9800, rc 0) 00000100:00100000:3.0:1746147195.580060:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29269:x1830967464014720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1538us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.580066:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12270 00000100:00100000:1.0:1746147195.580194:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464014976 00000100:00100000:1.0:1746147195.580199:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464014976 00002000:00100000:1.0:1746147195.580223:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800b52e1c00 x1830967464014976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.580231:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967464014976 ext(4194304->4947967) 00002000:00010000:1.0:1746147195.580235:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:1.0:1746147195.580247:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4814 00000100:00100000:1.0:1746147195.580253:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967464014976:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.582528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.582579:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015104 00000100:00100000:3.0:1746147195.582586:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015104 00002000:00100000:3.0:1746147195.582613:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1900544->2097151) req@ffff8800b52e2d80 x1830967464015104/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.582621:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967464015104 ext(1900544->2097151) 00010000:00010000:3.0:1746147195.582627:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.582638:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00002000:00010000:3.0:1746147195.582644:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e2d80 00000100:00100000:3.0:1746147195.582701:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1634 00000100:00100000:3.0:1746147195.582708:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1957:x1830967464015104:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147195.590146:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967464015104:12345-192.168.203.36@tcp:4:cat.0 Request processed in 7431us (7616us total) trans 21474840697 rc 0/0 00000100:00100000:3.0:1746147195.590156:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1634 00002000:00100000:3.0:1746147195.590164:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1900544->2097151) req@ffff8800b52e2d80 x1830967464015104/t21474840697(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.590172:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2d80 with x1830967464015104 ext(1900544->2097151) 00010000:00010000:3.0:1746147195.590181:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 30 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:1.0:1746147195.590183:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967464014976:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9929us (10377us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746147195.590190:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4814 00010000:00010000:3.0:1746147195.590193:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 30 pid: 4444 timeout: 682 lvb_type: 0 00002000:00100000:1.0:1746147195.590196:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff8800b52e1c00 x1830967464014976/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746147195.590199:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e2d80 00002000:00100000:1.0:1746147195.590203:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1c00 with x1830967464014976 ext(4194304->4947967) 00002000:00010000:1.0:1746147195.590206:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1c00 00000100:00100000:1.0:1746147195.596450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.596486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.596491:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015232 00000100:00100000:2.0:1746147195.596500:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015232 00000100:00100000:1.0:1746147195.596523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1746147195.596529:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.596621:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6135 00000100:00100000:2.0:1746147195.596628:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967464015232:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.596640:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.596660:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.596669:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.596686:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a81a800/0xb4b2209fbdac835d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aba expref: 29 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.596706:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015360 00010000:00010000:2.0:1746147195.596707:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.596708:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147195.596710:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015360 00000100:00100000:0.0:1746147195.596712:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015488 00010000:00010000:2.0:1746147195.596715:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.596716:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015488 00010000:00010000:2.0:1746147195.596722:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.596731:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12271 00000100:00100000:3.0:1746147195.596736:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464015360:12345-192.168.203.36@tcp:101:cat.0 00000100:00100000:0.0:1746147195.596736:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12272 00000100:00100000:0.0:1746147195.596741:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967464015488:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.596747:0:4445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.596747:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.596753:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.596755:0:4445:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac83fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b1c expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.596755:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b23 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.596763:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466504320:192.168.203.36@tcp:105: 00010000:00010000:0.0:1746147195.596765:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.596766:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.596769:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147195.596778:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466504448:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.596779:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.596785:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67f800, rc 0) 00000100:00100000:2.0:1746147195.596821:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.596828:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.596886:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967464015488:12345-192.168.203.36@tcp:101:cat.0 Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.596891:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12272 00000100:00100000:2.0:1746147195.598079:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466504320:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.598091:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.598119:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1959:x1830967464015232:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1492us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.598124:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6135 00000100:00100000:3.0:1746147195.600382:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466504448:192.168.203.36@tcp:106: 00010000:00010000:3.0:1746147195.600410:0:4445:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac83fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b1c expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.600425:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac83fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b1c expref: 44 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147195.600448:0:4445:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9a00, rc 0) 00000100:00100000:3.0:1746147195.600504:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464015360:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3766us (4015us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147195.600510:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12271 00000100:00100000:0.0:1746147195.601663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.603252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.603306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.603324:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015872 00000100:00100000:0.0:1746147195.603326:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016000 00000100:00100000:2.0:1746147195.603331:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015872 00000100:00100000:0.0:1746147195.603331:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016000 00000100:00100000:0.0:1746147195.603365:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12273 00000100:00100000:0.0:1746147195.603372:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+29:29271:x1830967464015872:12345-192.168.203.36@tcp:101:multiop.0 00000100:00100000:2.0:1746147195.603378:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12274 00000100:00100000:2.0:1746147195.603384:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464016000:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1746147195.603384:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.603391:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.603395:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b2a expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.603400:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094761e00/0xb4b2209fbdac840c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b31 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.603416:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 30 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.603420:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.603424:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.603425:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.603427:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1662976->1925119] (req 1662976->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.603434:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466504576:192.168.203.36@tcp:106: 00010000:00010000:0.0:1746147195.603438:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.603445:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:0.0:1746147195.603450:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504704:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.603459:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464015744 00000100:00100000:3.0:1746147195.603464:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464015744 00002000:00100000:3.0:1746147195.603487:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800b52e0700 x1830967464015744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.603496:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967464015744 ext(1048576->2097151) 00010000:00010000:3.0:1746147195.603501:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.603510:0:8485:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147195.603516:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0700 00010000:00010000:0.0:1746147195.603516:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.603518:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147195.603523:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.603531:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b52e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.603536:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1635 00000100:00100000:3.0:1746147195.603553:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464015744:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.603557:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.604798:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8481:1830967466504576:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.604806:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504704:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.604819:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094761e00/0xb4b2209fbdac840c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b31 expref: 44 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.604835:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094761e00/0xb4b2209fbdac840c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b31 expref: 44 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.604846:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094761e00, rc 0) 00000100:00100000:2.0:1746147195.604871:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1957:x1830967464016000:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1487us (1564us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.604877:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12274 00000100:00100000:2.0:1746147195.606491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.606525:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b52e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504832:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.606553:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016128 00000100:00100000:3.0:1746147195.606559:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016128 00010000:00010000:0.0:1746147195.606562:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [1662976->1925119] (req 1662976->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.606576:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f67e600, rc 0) 00010000:00010000:3.0:1746147195.606586:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 31 pid: 11147 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.606614:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6136 00000100:00100000:0.0:1746147195.606614:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+31:29271:x1830967464015872:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3242us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.606620:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12273 00000100:00100000:3.0:1746147195.606621:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967464016128:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.606631:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.606646:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.606655:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.606676:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f67f800/0xb4b2209fbdac83f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b23 expref: 30 pid: 11147 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.606685:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.606702:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967464016128:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.606707:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6136 00000100:00100000:3.0:1746147195.612835:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464015744:12345-192.168.203.36@tcp:3:cat.0 Request processed in 9274us (11166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.612846:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1635 00002000:00100000:3.0:1746147195.612857:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff8800b52e0700 x1830967464015744/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.612867:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0700 with x1830967464015744 ext(1048576->2097151) 00010000:00010000:3.0:1746147195.612875:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.612889:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00002000:00010000:3.0:1746147195.612895:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b52e0700 00000100:00100000:0.0:1746147195.633723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.633778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.633817:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016256 00000100:00100000:2.0:1746147195.633825:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016256 00000100:00100000:3.0:1746147195.633829:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016384 00000100:00100000:3.0:1746147195.633833:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016384 00010000:00010000:3.0:1746147195.633853:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 32 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.633869:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6137 00000100:00100000:2.0:1746147195.633871:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12275 00000100:00100000:3.0:1746147195.633873:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967464016384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147195.633877:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+32:29269:x1830967464016256:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1746147195.633882:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.633889:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.633897:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 32 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.633901:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b38 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.633905:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 32 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.633917:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac83f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b15 expref: 33 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.633921:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.633927:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.633929:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.633929:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147195.633930:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.633932:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.633933:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.633959:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.633972:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 28 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.633972:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 28 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.633980:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466505088:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.633985:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 28 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.633993:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504960:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147195.634043:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.634243:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.638517:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466505088:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.638556:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.638615:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967464016384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4738us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.638627:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6137 00000100:00100000:2.0:1746147195.639457:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466504960:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.639480:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.639497:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094761e00, rc 0) 00000100:00100000:2.0:1746147195.639530:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29269:x1830967464016256:12345-192.168.203.36@tcp:101:cat.0 Request processed in 5653us (5814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.639537:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12275 00000100:00100000:1.0:1746147195.639598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.639676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.639739:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016512 00000100:00100000:0.0:1746147195.639747:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016512 00002000:00100000:0.0:1746147195.639782:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2269183) req@ffff880090743480 x1830967464016512/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.639791:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743480 with x1830967464016512 ext(2097152->2269183) 00010000:00010000:0.0:1746147195.639798:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 29 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:0.0:1746147195.639810:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 29 pid: 4445 timeout: 682 lvb_type: 0 00002000:00010000:0.0:1746147195.639816:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090743480 00000100:00100000:0.0:1746147195.639838:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464016768 00000100:00100000:0.0:1746147195.639841:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464016768 00002000:00100000:0.0:1746147195.639851:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1662976->1667071) req@ffff880090742680 x1830967464016768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.639858:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742680 with x1830967464016768 ext(1662976->1667071) 00002000:00010000:0.0:1746147195.639862:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090742680 00000100:00100000:0.0:1746147195.639873:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1636 00000100:00100000:0.0:1746147195.639879:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1958:x1830967464016512:12345-192.168.203.36@tcp:4:cat.0 00000100:00100000:3.0:1746147195.639978:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4815 00000100:00100000:3.0:1746147195.639985:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967464016768:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.640120:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967464016768:12345-192.168.203.36@tcp:3:cat.0 Request processed in 135us (443us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147195.640125:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4815 00002000:00100000:3.0:1746147195.640130:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x418:0x0] (1662976->1667071) req@ffff880090742680 x1830967464016768/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.640137:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090742680 with x1830967464016768 ext(1662976->1667071) 00002000:00010000:3.0:1746147195.640139:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090742680 00000100:00100000:1.0:1746147195.645120:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1958:x1830967464016512:12345-192.168.203.36@tcp:4:cat.0 Request processed in 5230us (5511us total) trans 21474840698 rc 0/0 00000100:00100000:1.0:1746147195.645132:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1636 00002000:00100000:1.0:1746147195.645145:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->2269183) req@ffff880090743480 x1830967464016512/t21474840698(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.645154:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090743480 with x1830967464016512 ext(2097152->2269183) 00010000:00010000:1.0:1746147195.645164:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:1.0:1746147195.645178:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00002000:00010000:1.0:1746147195.645184:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090743480 00000100:00100000:0.0:1746147195.645993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.646052:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464017024 00000100:00100000:1.0:1746147195.646060:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464017024 00002000:00100000:1.0:1746147195.646086:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1921024->1925119) req@ffff8800b52e2680 x1830967464017024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.646094:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2680 with x1830967464017024 ext(1921024->1925119) 00002000:00010000:1.0:1746147195.646098:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2680 00000100:00100000:1.0:1746147195.646124:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4816 00000100:00100000:1.0:1746147195.646130:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967464017024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:1.0:1746147195.646226:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1957:x1830967464017024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 95us (234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.646231:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4816 00002000:00100000:1.0:1746147195.646235:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1921024->1925119) req@ffff8800b52e2680 x1830967464017024/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.646242:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e2680 with x1830967464017024 ext(1921024->1925119) 00002000:00010000:1.0:1746147195.646245:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e2680 00000100:00100000:0.0:1746147195.653418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.653591:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464017152 00000100:00100000:3.0:1746147195.653602:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464017152 00010000:00010000:3.0:1746147195.653649:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00000100:00100000:3.0:1746147195.654036:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6138 00000100:00100000:3.0:1746147195.654045:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967464017152:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.654060:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.654353:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.654366:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.654388:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f075000/0xb4b2209fbdac8395 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2269183) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ad6 expref: 31 pid: 4445 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.654470:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.654473:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.654481:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.654490:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.654523:0:16058:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.654535:0:16058:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466505216:192.168.203.36@tcp:105: 00000100:00100000:3.0:1746147195.654635:0:16058:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.656433:0:16058:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16058:1830967466505216:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.656458:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.656492:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1956:x1830967464017152:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2447us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.656500:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6138 00000100:00100000:0.0:1746147195.664642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.664673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.664694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.664717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.664761:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464017664 00000100:00100000:0.0:1746147195.664769:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464017664 00002000:00100000:0.0:1746147195.664811:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800b52e3480 x1830967464017664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.664821:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967464017664 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.664826:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3480 00000100:00100000:0.0:1746147195.664841:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464017536 00000100:00100000:0.0:1746147195.664843:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464017536 00002000:00100000:0.0:1746147195.664851:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e0a80 x1830967464017536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.664857:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0a80 with x1830967464017536 ext(2097152->3145727) 00002000:00010000:0.0:1746147195.664859:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0a80 00000100:00100000:0.0:1746147195.664864:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464017920 00000100:00100000:0.0:1746147195.664865:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464017920 00002000:00100000:0.0:1746147195.664873:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800b52e1f80 x1830967464017920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.664880:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967464017920 ext(2097152->3145727) 00002000:00010000:0.0:1746147195.664883:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:0.0:1746147195.665040:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464018048 00000100:00100000:0.0:1746147195.665042:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464018048 00002000:00100000:0.0:1746147195.665052:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e3800 x1830967464018048/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.665058:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967464018048 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.665061:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e3800 00000100:00100000:1.0:1746147195.665117:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4817 00000100:00100000:1.0:1746147195.665127:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+24:1956:x1830967464017664:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.666667:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4818 00000100:00100000:2.0:1746147195.666678:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967464017536:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.666943:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4819 00000100:00100000:3.0:1746147195.666953:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1956:x1830967464017920:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1746147195.668279:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4820 00000100:00100000:0.0:1746147195.668288:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967464018048:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.679445:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:66a3cdf6-ed02-4a11-b851-60f72c886415+25:1956:x1830967464017664:12345-192.168.203.36@tcp:3:cat.0 Request processed in 14308us (14800us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.679457:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4817 00002000:00100000:2.0:1746147195.679470:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (3145728->4194303) req@ffff8800b52e3480 x1830967464017664/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.679480:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3480 with x1830967464017664 ext(3145728->4194303) 00002000:00010000:2.0:1746147195.679485:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e3480 00000100:00100000:3.0:1746147195.688822:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1956:x1830967464017920:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21860us (24115us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.688833:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4819 00002000:00100000:3.0:1746147195.688846:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff8800b52e1f80 x1830967464017920/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.688855:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e1f80 with x1830967464017920 ext(2097152->3145727) 00002000:00010000:3.0:1746147195.688860:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e1f80 00000100:00100000:1.0:1746147195.689297:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464018048:12345-192.168.203.36@tcp:3:cat.0 Request processed in 21009us (24577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.689304:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4820 00002000:00100000:1.0:1746147195.689310:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff8800b52e3800 x1830967464018048/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.689317:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e3800 with x1830967464018048 ext(3145728->4194303) 00002000:00010000:1.0:1746147195.689320:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b52e3800 00000100:00100000:2.0:1746147195.692348:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1956:x1830967464017536:12345-192.168.203.36@tcp:3:cat.0 Request processed in 25664us (27664us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.692360:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4818 00002000:00100000:2.0:1746147195.692370:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41e:0x0] (2097152->3145727) req@ffff8800b52e0a80 x1830967464017536/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.692379:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b52e0a80 with x1830967464017536 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.692384:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b52e0a80 00000100:00100000:0.0:1746147195.698122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.698215:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464018304 00000100:00100000:2.0:1746147195.698224:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464018304 00000100:00100000:2.0:1746147195.698269:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12276 00000100:00100000:2.0:1746147195.698277:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967464018304:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.698295:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.698312:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac841a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b3f expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.698362:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505344:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.699372:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.702807:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505344:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.702844:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac841a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b3f expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.702858:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9a00/0xb4b2209fbdac841a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b3f expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.702873:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9a00, rc 0) 00000100:00100000:2.0:1746147195.702933:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967464018304:12345-192.168.203.36@tcp:101:cat.0 Request processed in 4656us (4820us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.702966:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12276 00000100:00100000:0.0:1746147195.706378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.706453:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464018560 00000100:00100000:2.0:1746147195.706462:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464018560 00002000:00100000:2.0:1746147195.706503:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88012e2ba300 x1830967464018560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.706513:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967464018560 ext(4194304->4947967) 00002000:00010000:2.0:1746147195.706518:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:2.0:1746147195.706553:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4821 00000100:00100000:2.0:1746147195.706560:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464018560:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.717076:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464018560:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10504us (10695us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746147195.717089:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4821 00002000:00100000:2.0:1746147195.717101:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88012e2ba300 x1830967464018560/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.717112:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba300 with x1830967464018560 ext(4194304->4947967) 00002000:00010000:2.0:1746147195.717118:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba300 00000100:00100000:1.0:1746147195.725895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.726049:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464018688 00000100:00100000:2.0:1746147195.726059:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464018688 00000100:00100000:2.0:1746147195.726114:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12277 00000100:00100000:2.0:1746147195.726121:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464018688:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.726140:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.726158:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac8421 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b46 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.726218:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505472:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.726314:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.728786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.729480:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505472:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.729514:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac8421 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b46 expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.729527:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9000/0xb4b2209fbdac8421 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b46 expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.729552:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9000, rc 0) 00000100:00100000:2.0:1746147195.729594:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464018688:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3472us (3710us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.729602:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12277 00000100:00100000:3.0:1746147195.730404:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464018944 00000100:00100000:3.0:1746147195.730412:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464018944 00000100:00100000:3.0:1746147195.730914:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10631 00000100:00100000:3.0:1746147195.730923:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+51:29275:x1830967464018944:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:3.0:1746147195.730961:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147195.731535:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac8428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b4d expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.731664:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731679:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731690:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731703:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731708:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731712:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731819:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac843d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731827:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac843d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731832:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac843d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147195.731840:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147195.731918:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731925:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731931:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731956:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b9e00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.731960:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731966:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731977:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:3.0:1746147195.731980:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.731983:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.731988:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9e00/0xb4b2209fbdac842f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732009:0:14048:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732013:0:14048:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732017:0:14048:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732021:0:14048:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d7b9800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:3.0:1746147195.732023:0:14048:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732027:0:14048:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732033:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134f48f00) 00010000:00010000:3.0:1746147195.732035:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147195.732038:0:14048:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732042:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9800/0xb4b2209fbdac8436 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147195.732075:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9c00/0xb4b2209fbdac8428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b4d expref: 54 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.732084:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac843d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b4d expref: 53 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.732091:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.732092:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147195.732095:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b9a00, rc 0) 00000100:00100000:3.0:1746147195.732146:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+53:29275:x1830967464018944:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1224us (3366us total) trans 8589944409 rc 0/0 00000100:00100000:3.0:1746147195.732153:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10631 00000100:00100000:0.0:1746147195.732596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.732816:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019072 00000100:00100000:2.0:1746147195.732823:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019072 00000100:00100000:2.0:1746147195.732851:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12278 00000100:00100000:2.0:1746147195.732856:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464019072:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.732866:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.732878:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac844b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b54 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.732917:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505600:192.168.203.36@tcp:106: 00000100:00100000:2.0:1746147195.733873:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.734656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.734809:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019200 00000100:00100000:3.0:1746147195.734817:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019200 00000100:00100000:3.0:1746147195.734861:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 610 00000100:00100000:3.0:1746147195.734867:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+53:1958:x1830967464019200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.734880:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.734902:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b9a00/0xb4b2209fbdac843d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b4d expref: 53 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.734918:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147195.734921:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.734982:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a3cdf6-ed02-4a11-b851-60f72c886415+52:1958:x1830967464019200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.734989:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 610 00000100:00100000:2.0:1746147195.735993:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505600:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.736022:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac844b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b54 expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.736035:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8e00/0xb4b2209fbdac844b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b54 expref: 32 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.736043:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8e00, rc 0) 00000100:00100000:2.0:1746147195.736072:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1958:x1830967464019072:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3215us (3477us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.736078:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12278 00000100:00100000:0.0:1746147195.738077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.738164:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019328 00000100:00100000:2.0:1746147195.738171:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019328 00000100:00100000:2.0:1746147195.738212:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12279 00000100:00100000:2.0:1746147195.738219:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+31:29275:x1830967464019328:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147195.738236:0:11147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.738250:0:11147:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b5b expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.738274:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.738280:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.738282:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.738285:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2801664->2822143] (req 2801664->2822143) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.738311:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.738322:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.738332:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505728:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.739045:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009381b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.739429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.739564:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019584 00000100:00100000:2.0:1746147195.739568:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019584 00000100:00100000:2.0:1746147195.739606:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4243 00000100:00100000:2.0:1746147195.739612:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+52:29269:x1830967464019584:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1746147195.739796:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+53:29269:x1830967464019584:12345-192.168.203.36@tcp:35:cat.0 Request processed in 183us (367us total) trans 8589944410 rc 0/0 00000100:00100000:2.0:1746147195.739802:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4243 00000100:00100000:3.0:1746147195.739967:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11147:1830967466505728:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147195.739987:0:11147:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2801664->2822143] (req 2801664->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 32 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.739999:0:11147:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8800, rc 0) 00000100:00100000:3.0:1746147195.740030:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+32:29275:x1830967464019328:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 1812us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.740036:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12279 00000100:00100000:0.0:1746147195.744622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.744727:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019712 00000100:00100000:2.0:1746147195.744736:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019712 00010000:00010000:2.0:1746147195.744772:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.745215:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6139 00000100:00100000:2.0:1746147195.745224:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1957:x1830967464019712:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.745237:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.745258:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.745270:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.745293:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094761e00/0xb4b2209fbdac8413 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b38 expref: 32 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.745307:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.745308:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.745315:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.745323:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.745357:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 31 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.745369:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466505856:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.745480:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132d24e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.746789:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466505856:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.746805:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.746834:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1957:x1830967464019712:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1611us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.746842:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6139 00000100:00100000:0.0:1746147195.747090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.747471:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464019968 00000100:00100000:2.0:1746147195.747477:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464019968 00002000:00100000:2.0:1746147195.747511:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2801664->2805759) req@ffff88012e2b8e00 x1830967464019968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.747526:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967464019968 ext(2801664->2805759) 00002000:00010000:2.0:1746147195.747530:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8e00 00000100:00100000:2.0:1746147195.747813:0:31324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4822 00000100:00100000:2.0:1746147195.747820:0:31324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464019968:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147195.748004:0:31324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1956:x1830967464019968:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 184us (915us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147195.748010:0:31324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4822 00002000:00100000:2.0:1746147195.748015:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x419:0x0] (2801664->2805759) req@ffff88012e2b8e00 x1830967464019968/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.748021:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8e00 with x1830967464019968 ext(2801664->2805759) 00002000:00010000:2.0:1746147195.748024:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2b8e00 00000100:00100000:0.0:1746147195.752082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.752180:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020224 00000100:00100000:1.0:1746147195.752190:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020224 00002000:00100000:1.0:1746147195.752239:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2818048->2822143) req@ffff88012e2ba680 x1830967464020224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.752250:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba680 with x1830967464020224 ext(2818048->2822143) 00002000:00010000:1.0:1746147195.752256:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba680 00000100:00100000:1.0:1746147195.752283:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4823 00000100:00100000:1.0:1746147195.752291:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967464020224:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.752459:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967464020224:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 168us (1922us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.752466:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4823 00002000:00100000:1.0:1746147195.752471:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x419:0x0] (2818048->2822143) req@ffff88012e2ba680 x1830967464020224/t0(0) o3->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.752484:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2ba680 with x1830967464020224 ext(2818048->2822143) 00002000:00010000:1.0:1746147195.752487:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2ba680 00000100:00100000:0.0:1746147195.754820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.755241:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020480 00000100:00100000:2.0:1746147195.755250:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020480 00000100:00100000:2.0:1746147195.755289:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4244 00000100:00100000:2.0:1746147195.755296:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a524e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+53:29275:x1830967464020480:12345-192.168.203.36@tcp:35:multiop.0 00000100:00100000:2.0:1746147195.755724:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a524e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+54:29275:x1830967464020480:12345-192.168.203.36@tcp:35:multiop.0 Request processed in 427us (909us total) trans 8589944411 rc 0/0 00000100:00100000:2.0:1746147195.755730:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4244 00000100:00100000:0.0:1746147195.834814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.834874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147195.834967:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020736 00000100:00100000:1.0:1746147195.834977:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020736 00000100:00100000:1.0:1746147195.835025:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020608 00000100:00100000:1.0:1746147195.835027:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020608 00000100:00100000:1.0:1746147195.835043:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12280 00000100:00100000:1.0:1746147195.835050:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967464020736:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147195.835068:0:8481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.835086:0:8481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac8459 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b69 expref: -99 pid: 8481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.835138:0:8481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466505984:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.835221:0:8481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.835246:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12281 00000100:00100000:1.0:1746147195.835252:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967464020608:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1746147195.835259:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.835268:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5178600/0xb4b2209fbdac8460 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b62 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.835290:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506112:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.835309:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.838067:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506112:192.168.203.36@tcp:106: 00000100:00100000:1.0:1746147195.838067:0:8481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8481:1830967466505984:192.168.203.36@tcp:106: 00010000:00010000:2.0:1746147195.838097:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5178600/0xb4b2209fbdac8460 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b62 expref: 44 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.838097:0:8481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac8459 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b69 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.838111:0:6881:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5178600/0xb4b2209fbdac8460 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b62 expref: 44 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.838111:0:8481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0xb4b2209fbdac8459 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b69 expref: 31 pid: 8481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.838125:0:8481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5600, rc 0) 00010000:00010000:2.0:1746147195.838126:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5178600, rc 0) 00000100:00100000:1.0:1746147195.838166:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1959:x1830967464020736:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3115us (3362us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.838174:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12280 00000100:00100000:2.0:1746147195.838580:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:1958:x1830967464020608:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3325us (3702us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147195.838585:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12281 00000100:00100000:0.0:1746147195.845876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.846084:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020864 00000100:00100000:2.0:1746147195.846092:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020864 00000100:00100000:2.0:1746147195.846197:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12282 00000100:00100000:2.0:1746147195.846205:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+43:29280:x1830967464020864:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.846221:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.846234:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b70 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.846259:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.846266:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.846267:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.846270:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 44 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.846294:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 22 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.846303:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 22 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.846318:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506240:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.846827:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.849753:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506240:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.849779:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 44 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.849793:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8400, rc 0) 00000100:00100000:2.0:1746147195.849839:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:29280:x1830967464020864:12345-192.168.203.36@tcp:101:cat.0 Request processed in 3634us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.849847:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12282 00000100:00100000:0.0:1746147195.851428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.851501:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464020992 00000100:00100000:2.0:1746147195.851507:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464020992 00010000:00010000:2.0:1746147195.851543:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 23 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.851578:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6140 00000100:00100000:2.0:1746147195.851585:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1957:x1830967464020992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.851597:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.851616:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 23 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.851625:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 23 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.851648:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a81a600/0xb4b2209fbdac838e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->1449983) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7acf expref: 23 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.851671:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.851673:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.851679:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.851685:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.851710:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 43 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.851719:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466506368:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.851784:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147195.856580:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147195.856722:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7119:1830967466506368:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.856740:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.857077:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5846050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967464020992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5491us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.857086:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6140 00000100:00100000:0.0:1746147195.861348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.861395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.861631:0:31324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464021248 00000100:00100000:2.0:1746147195.861639:0:31324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464021248 00000100:00100000:1.0:1746147195.861642:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464021504 00000100:00100000:1.0:1746147195.861646:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464021504 00002000:00100000:2.0:1746147195.861672:0:31324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012e2b8000 x1830967464021248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.861672:0:25531:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012e2bb800 x1830967464021504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 504/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.861680:0:25531:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967464021504 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.861684:0:25531:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bb800 00002000:00100000:2.0:1746147195.861686:0:31324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8000 with x1830967464021248 ext(1048576->2097151) 00002000:00010000:2.0:1746147195.861689:0:31324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8000 00000100:00100000:2.0:1746147195.861726:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4824 00000100:00100000:2.0:1746147195.861734:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967464021504:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.861820:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4825 00000100:00100000:3.0:1746147195.861828:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967464021248:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.874858:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967464021504:12345-192.168.203.36@tcp:3:cat.0 Request processed in 13117us (13455us total) trans 0 rc 786432/786432 00000100:00100000:2.0:1746147195.874868:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4824 00002000:00100000:2.0:1746147195.874878:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1048576->2097151) req@ffff88012e2bb800 x1830967464021504/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 504/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.874887:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2bb800 with x1830967464021504 ext(1048576->2097151) 00002000:00010000:2.0:1746147195.874892:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e2bb800 00000100:00100000:3.0:1746147195.878052:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1956:x1830967464021248:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16217us (16702us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.878062:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4825 00002000:00100000:3.0:1746147195.878071:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41d:0x0] (1048576->2097151) req@ffff88012e2b8000 x1830967464021248/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.878080:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2b8000 with x1830967464021248 ext(1048576->2097151) 00002000:00010000:3.0:1746147195.878084:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e2b8000 00000100:00100000:0.0:1746147195.895077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.895170:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464021632 00000100:00100000:2.0:1746147195.895178:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464021632 00000100:00100000:2.0:1746147195.895229:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12283 00000100:00100000:2.0:1746147195.895236:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+30:29280:x1830967464021632:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1746147195.895251:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.895264:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b77 expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.895294:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.895301:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.895303:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147195.895306:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.895331:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 30 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.895341:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 30 pid: 11147 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.895351:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466506496:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.895432:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.897335:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:6881:1830967466506496:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.897357:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 31 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.897371:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb9c00, rc 0) 00000100:00100000:2.0:1746147195.897415:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+31:29280:x1830967464021632:12345-192.168.203.36@tcp:101:cat.0 Request processed in 2179us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.897422:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12283 00000100:00100000:0.0:1746147195.897434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.897524:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464021760 00000100:00100000:3.0:1746147195.897530:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464021760 00002000:00100000:3.0:1746147195.897570:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2801664->2822143) req@ffff88012e2baa00 x1830967464021760/t0(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.897578:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967464021760 ext(2801664->2822143) 00010000:00010000:3.0:1746147195.897585:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 31 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.897605:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 31 pid: 11147 timeout: 682 lvb_type: 0 00002000:00010000:3.0:1746147195.897611:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2baa00 00000100:00100000:3.0:1746147195.897653:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1637 00000100:00100000:3.0:1746147195.897915:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+31:1959:x1830967464021760:12345-192.168.203.36@tcp:4:multiop.0 00000100:00100000:3.0:1746147195.899072:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1959:x1830967464021760:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 1410us (1636us total) trans 21474840699 rc 0/0 00000100:00100000:3.0:1746147195.899079:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1637 00002000:00100000:3.0:1746147195.899085:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2801664->2822143) req@ffff88012e2baa00 x1830967464021760/t21474840699(0) o4->66a3cdf6-ed02-4a11-b851-60f72c886415@192.168.203.36@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.899093:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e2baa00 with x1830967464021760 ext(2801664->2822143) 00010000:00010000:3.0:1746147195.899099:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:3.0:1746147195.899109:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00002000:00010000:3.0:1746147195.899114:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e2baa00 00000100:00100000:0.0:1746147195.900848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.900910:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464021888 00000100:00100000:2.0:1746147195.900918:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464021888 00010000:00010000:2.0:1746147195.900974:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.901007:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6141 00000100:00100000:2.0:1746147195.901015:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+33:1959:x1830967464021888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.901030:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.901046:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.901057:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.901074:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb8800/0xb4b2209fbdac8452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->2822143) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b5b expref: 33 pid: 11147 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.901105:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.901107:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.901113:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.901120:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.901146:0:7119:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 30 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147195.901156:0:7119:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466506624:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.901219:0:7119:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.903371:0:7119:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7119:1830967466506624:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147195.903388:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147195.903420:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1959:x1830967464021888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2405us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.903428:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6141 00000100:00100000:0.0:1746147195.908634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147195.908680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.908797:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464022272 00000100:00100000:3.0:1746147195.908805:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464022272 00002000:00100000:3.0:1746147195.908842:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f730e00 x1830967464022272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.908856:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967464022272 ext(3145728->4194303) 00002000:00010000:3.0:1746147195.908861:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730e00 00000100:00100000:3.0:1746147195.908876:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464022144 00000100:00100000:3.0:1746147195.908878:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464022144 00002000:00100000:3.0:1746147195.908887:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f731180 x1830967464022144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.908893:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967464022144 ext(2097152->3145727) 00002000:00010000:3.0:1746147195.908896:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:3.0:1746147195.909010:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4826 00000100:00100000:3.0:1746147195.909018:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967464022272:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.909147:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4827 00000100:00100000:2.0:1746147195.909155:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+32:1956:x1830967464022144:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1746147195.920030:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+33:1956:x1830967464022144:12345-192.168.203.36@tcp:3:cat.0 Request processed in 10868us (11340us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147195.920040:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4827 00002000:00100000:2.0:1746147195.920050:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x419:0x0] (2097152->3145727) req@ffff88009f731180 x1830967464022144/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.920058:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f731180 with x1830967464022144 ext(2097152->3145727) 00002000:00010000:2.0:1746147195.920063:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f731180 00000100:00100000:3.0:1746147195.925865:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967464022272:12345-192.168.203.36@tcp:3:cat.0 Request processed in 16840us (17231us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147195.925874:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4826 00002000:00100000:3.0:1746147195.925883:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (3145728->4194303) req@ffff88009f730e00 x1830967464022272/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.925891:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f730e00 with x1830967464022272 ext(3145728->4194303) 00002000:00010000:3.0:1746147195.925896:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f730e00 00000100:00100000:0.0:1746147195.941363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.944009:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464022656 00000100:00100000:3.0:1746147195.944019:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464022656 00002000:00100000:3.0:1746147195.944059:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009f732680 x1830967464022656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.944067:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830967464022656 ext(4194304->4947967) 00002000:00010000:3.0:1746147195.944072:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732680 00000100:00100000:3.0:1746147195.944108:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4828 00000100:00100000:3.0:1746147195.944114:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967464022656:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:3.0:1746147195.957017:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+31:1956:x1830967464022656:12345-192.168.203.36@tcp:3:cat.0 Request processed in 12895us (15653us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746147195.957027:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4828 00002000:00100000:3.0:1746147195.957037:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x419:0x0] (4194304->4947967) req@ffff88009f732680 x1830967464022656/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.957045:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f732680 with x1830967464022656 ext(4194304->4947967) 00002000:00010000:3.0:1746147195.957050:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f732680 00000100:00100000:0.0:1746147195.976231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.976579:0:6881:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464022784 00000100:00100000:2.0:1746147195.976586:0:6881:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464022784 00000100:00100000:2.0:1746147195.976984:0:6881:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12284 00000100:00100000:2.0:1746147195.976992:0:6881:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+44:29282:x1830967464022784:12345-192.168.203.36@tcp:101:multiop.0 00010000:00010000:2.0:1746147195.977006:0:6881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147195.977020:0:6881:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b7e expref: -99 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.977040:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.977048:0:6881:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.977057:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.977058:0:6881:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147195.977061:0:6881:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3301376->4038655] (req 3301376->4038655) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 45 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.977081:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 21 pid: 6881 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147195.977091:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 21 pid: 6881 timeout: 682 lvb_type: 1 00000100:00100000:2.0:1746147195.977101:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506752:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.977173:0:6881:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.977179:0:6881:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.977185:0:6881:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506880:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.977199:0:6881:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ae1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147195.980359:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506752:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147195.980370:0:6881:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:6881:1830967466506880:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147195.980393:0:6881:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3301376->4038655] (req 3301376->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 45 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.980412:0:6881:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfb8200, rc 0) 00000100:00100000:2.0:1746147195.980455:0:6881:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+45:29282:x1830967464022784:12345-192.168.203.36@tcp:101:multiop.0 Request processed in 3463us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.980462:0:6881:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12284 00000100:00100000:0.0:1746147195.985241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.985469:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464022912 00000100:00100000:2.0:1746147195.985477:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464022912 00010000:00010000:2.0:1746147195.985505:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:2.0:1746147195.985580:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6142 00000100:00100000:2.0:1746147195.985587:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+45:1959:x1830967464022912:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147195.985597:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147195.985616:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.985625:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 682 lvb_type: 0 00010000:00010000:2.0:1746147195.985642:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb9200/0xb4b2209fbdac839c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7add expref: 45 pid: 4444 timeout: 682 lvb_type: 0 00000100:00100000:0.0:1746147195.985670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.985703:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023040 00000100:00100000:3.0:1746147195.985706:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023040 00010000:00010000:3.0:1746147195.985720:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 22 pid: 6881 timeout: 682 lvb_type: 1 00000100:00100000:3.0:1746147195.985731:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6143 00000100:00100000:3.0:1746147195.985736:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1957:x1830967464023040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147195.985741:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147195.985750:0:7121:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 22 pid: 6881 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.985757:0:7121:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 22 pid: 6881 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.985768:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dc800/0xb4b2209fbdac83e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b07 expref: 22 pid: 6881 timeout: 682 lvb_type: 1 00010000:00010000:3.0:1746147195.985784:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.985786:0:7121:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147195.985791:0:7121:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 44 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147195.985798:0:7121:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 44 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147195.985836:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147195.985873:0:7121:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 44 pid: 6881 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147195.985888:0:7121:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466507008:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147195.985981:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967464022912:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 393us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147195.985987:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6142 00000100:00100000:3.0:1746147195.985995:0:7121:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b8edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147195.987573:0:7121:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7121:1830967466507008:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147195.987587:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147195.987626:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+21:1957:x1830967464023040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1888us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147195.987632:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6143 00000100:00100000:0.0:1746147195.987805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147195.988080:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023296 00000100:00100000:3.0:1746147195.988085:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023296 00002000:00100000:3.0:1746147195.988110:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3301376->3305471) req@ffff88009f733b80 x1830967464023296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.988118:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830967464023296 ext(3301376->3305471) 00002000:00010000:3.0:1746147195.988122:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f733b80 00000100:00100000:3.0:1746147195.988208:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4829 00000100:00100000:3.0:1746147195.988215:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967464023296:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:3.0:1746147195.988334:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1958:x1830967464023296:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 118us (529us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147195.988339:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4829 00002000:00100000:3.0:1746147195.988343:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3301376->3305471) req@ffff88009f733b80 x1830967464023296/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147195.988350:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733b80 with x1830967464023296 ext(3301376->3305471) 00002000:00010000:3.0:1746147195.988353:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f733b80 00000100:00100000:0.0:1746147195.996378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147195.997070:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023552 00000100:00100000:2.0:1746147195.997078:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023552 00002000:00100000:2.0:1746147195.997115:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (4034560->4038655) req@ffff88009f733100 x1830967464023552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.997124:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967464023552 ext(4034560->4038655) 00002000:00010000:2.0:1746147195.997128:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f733100 00000100:00100000:2.0:1746147195.997157:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4830 00000100:00100000:2.0:1746147195.997164:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967464023552:12345-192.168.203.36@tcp:3:multiop.0 00000100:00100000:2.0:1746147195.997385:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+44:1959:x1830967464023552:12345-192.168.203.36@tcp:3:multiop.0 Request processed in 221us (1015us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147195.997391:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4830 00002000:00100000:2.0:1746147195.997396:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x41e:0x0] (4034560->4038655) req@ffff88009f733100 x1830967464023552/t0(0) o3->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147195.997403:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f733100 with x1830967464023552 ext(4034560->4038655) 00002000:00010000:2.0:1746147195.997405:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f733100 00000001:00080000:2.0:1746147196.451442:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944403 is committed 00000001:00080000:2.0:1746147196.451452:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944396 is committed 00000001:00080000:2.0:1746147196.451459:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944368 is committed 00000001:00080000:2.0:1746147196.451510:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944411 is committed 00000001:00080000:2.0:1746147196.451521:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944404 is committed 00000001:00080000:2.0:1746147196.451619:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944405 is committed 00000100:00100000:0.0:1746147196.479684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.479717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.479829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.479905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.479921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.479961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.480154:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023808 00000100:00100000:0.0:1746147196.480163:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023808 00000100:00100000:1.0:1746147196.480531:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024064 00000100:00100000:1.0:1746147196.480552:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024064 00000100:00100000:0.0:1746147196.480568:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024320 00000100:00100000:0.0:1746147196.480572:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024320 00000100:00100000:1.0:1746147196.480604:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023680 00000100:00100000:3.0:1746147196.480614:0:11147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464023936 00000100:00100000:1.0:1746147196.480615:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023680 00000100:00100000:3.0:1746147196.480617:0:11147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464023936 00000100:00100000:1.0:1746147196.480630:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024192 00000100:00100000:1.0:1746147196.480632:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024192 00000100:00100000:3.0:1746147196.480643:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12285 00000100:00100000:3.0:1746147196.480650:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967464023808:12345-192.168.203.36@tcp:16:kworker.0 00000100:00100000:1.0:1746147196.480684:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12286 00000100:00100000:1.0:1746147196.480691:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1958:x1830967464024064:12345-192.168.203.36@tcp:16:kworker.0 00000100:00100000:3.0:1746147196.480712:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12287 00000100:00100000:3.0:1746147196.480716:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967464024320:12345-192.168.203.36@tcp:16:kworker.0 00000100:00100000:1.0:1746147196.480747:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12288 00000100:00100000:1.0:1746147196.480752:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1958:x1830967464023680:12345-192.168.203.36@tcp:16:kworker.0 00000100:00100000:1.0:1746147196.480771:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12289 00000100:00100000:1.0:1746147196.480776:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967464023936:12345-192.168.203.36@tcp:16:kworker.0 00000100:00100000:1.0:1746147196.480811:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12290 00000100:00100000:1.0:1746147196.480816:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+34:1958:x1830967464024192:12345-192.168.203.36@tcp:16:kworker.0 00000001:00080000:3.0:1746147196.594151:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840696 is committed 00000100:00100000:0.0:1746147196.594163:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66a3cdf6-ed02-4a11-b851-60f72c886415+32:1958:x1830967464024064:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 113466us (114438us total) trans 0 rc 0/0 00000001:00080000:3.0:1746147196.594171:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840698 is committed 00000100:00100000:0.0:1746147196.594176:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12286 00000001:00080000:3.0:1746147196.594227:0:415:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840699 is committed 00000100:00100000:0.0:1746147196.594229:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66a3cdf6-ed02-4a11-b851-60f72c886415+17:1958:x1830967464023680:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 113476us (114323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.594235:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12288 00000100:00100000:0.0:1746147196.594272:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1958:x1830967464024192:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 113455us (114310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.594277:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12290 00000100:00100000:2.0:1746147196.594917:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66a3cdf6-ed02-4a11-b851-60f72c886415+23:1958:x1830967464023808:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 114266us (115240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.594924:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12285 00000100:00100000:2.0:1746147196.594989:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:66a3cdf6-ed02-4a11-b851-60f72c886415+22:1958:x1830967464024320:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 114270us (115159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.594998:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12287 00000001:00080000:2.0:1746147196.595017:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873284 is committed 00000001:00080000:2.0:1746147196.595025:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873282 is committed 00000001:00080000:2.0:1746147196.595054:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873285 is committed 00000001:00080000:2.0:1746147196.595059:0:2317:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873283 is committed 00000100:00100000:1.0:1746147196.595180:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1958:x1830967464023936:12345-192.168.203.36@tcp:16:kworker.0 Request processed in 114402us (115257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.595187:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12289 00000100:00100000:0.0:1746147196.610092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147196.610141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147196.610170:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024576 00000100:00100000:3.0:1746147196.610181:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024576 00000100:00100000:2.0:1746147196.610186:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024448 00000100:00100000:2.0:1746147196.610189:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024448 00000100:00100000:2.0:1746147196.610243:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 611 00000100:00100000:2.0:1746147196.610251:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+16:1957:x1830967464024448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147196.610256:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 612 00000100:00100000:3.0:1746147196.610260:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+16:1959:x1830967464024576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147196.610266:0:7121:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147196.610266:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147196.610284:0:7121:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f66cc00/0xb4b2209fbdabdbb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e1461 expref: 16 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147196.610284:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012e1b6200/0xb4b2209fbdabdbbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e148b expref: 16 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147196.610304:0:7121:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147196.610430:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147196.610930:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+14:1959:x1830967464024576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 667us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147196.610958:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 612 00000100:00100000:2.0:1746147196.611063:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+13:1957:x1830967464024448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 812us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.611068:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 611 00000100:00100000:1.0:1746147196.612059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147196.612104:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464024960 00000100:00100000:2.0:1746147196.612111:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464024960 00000100:00100000:2.0:1746147196.612151:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12291 00000100:00100000:2.0:1746147196.612157:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+7:1955:x1830967464024960:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:2.0:1746147196.612186:0:8480:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdbdb 00000020:00010000:2.0:1746147196.612193:0:8480:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880095354000: total 0 00000100:00080000:2.0:1746147196.612198:0:8480:0:(import.c:66:import_set_state_nolock()) ffff8800a46e8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147196.612245:0:8480:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873285 00000020:00010000:3.0:1746147196.612247:0:9895:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880095354000: total 0 00010000:00010000:3.0:1746147196.612279:0:9895:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880095354000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746147196.612322:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094eb0600/0xb4b2209fbdac83cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7af2 expref: 6 pid: 4445 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147196.612344:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4513a00/0xb4b2209fbdac4487 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5281 expref: 5 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147196.612352:0:9895:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880095354000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746147196.612360:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147196.612362:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147196.612363:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147196.612477:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+2:1955:x1830967464024960:12345-192.168.203.36@tcp:9:umount.0 Request processed in 319us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.612487:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12291 00000100:00100000:0.0:1746147196.612675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147196.613328:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464025088 00000100:00100000:2.0:1746147196.613333:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464025088 00000100:00100000:2.0:1746147196.613361:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 613 00000100:00100000:2.0:1746147196.613366:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+13:1956:x1830967464025088:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147196.613374:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147196.613384:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880130aeb200/0xb4b2209fbdabdbc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e1492 expref: 13 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147196.613394:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147196.613416:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1956:x1830967464025088:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 49us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.613421:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 613 00000100:00100000:0.0:1746147196.628751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147196.628847:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464025344 00000100:00100000:2.0:1746147196.628860:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464025344 00000100:00100000:2.0:1746147196.628927:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12292 00000100:00100000:2.0:1746147196.628963:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+6:1955:x1830967464025344:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:2.0:1746147196.628998:0:8480:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdbd4 00000020:00010000:2.0:1746147196.629007:0:8480:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008dbec800: total 0 00000100:00080000:2.0:1746147196.629010:0:8480:0:(import.c:66:import_set_state_nolock()) ffff88009f53b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147196.629059:0:8480:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840699 00000020:00010000:3.0:1746147196.629268:0:7123:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008dbec800: total 0 00010000:00010000:3.0:1746147196.629273:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147196.629305:0:7123:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008dbec800, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1746147196.629333:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+4:1955:x1830967464025344:12345-192.168.203.36@tcp:9:umount.0 Request processed in 398us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147196.629340:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12292 00010000:00010000:3.0:1746147196.629357:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904ba200/0xb4b2209fbdac83c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aeb expref: 3 pid: 11147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147196.629383:0:7123:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008dbec800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746147196.629392:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147196.629393:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746147196.629395:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147196.634471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147196.634742:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464025728 00000100:00100000:3.0:1746147196.634751:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464025728 00000100:00100000:3.0:1746147196.634807:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10632 00000100:00100000:3.0:1746147196.634815:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+8:1955:x1830967464025728:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:3.0:1746147196.634849:0:14048:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdbcd 00000020:00010000:3.0:1746147196.634862:0:14048:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880129f05800: total 0 00000100:00080000:0.0:1746147196.634863:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746147196.634865:0:14048:0:(import.c:66:import_set_state_nolock()) ffff88009d042800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147196.634887:0:14048:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944411 00000020:00010000:2.0:1746147196.634928:0:7122:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880129f05800: total 0 00010000:00010000:2.0:1746147196.634998:0:7122:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880129f05800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746147196.635033:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147196.635036:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147196.635047:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f8c00/0xb4b2209fbdac7890 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e73ba expref: 7 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147196.635081:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:2.0:1746147196.635084:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746147196.635087:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e32000/0xb4b2209fbdabdc91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e153a expref: 6 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147196.635107:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147196.635108:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147196.635111:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d607c00/0xb4b2209fbdac761a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71e5 expref: 5 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147196.635121:0:7122:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880129f05800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746147196.635130:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147196.635132:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147196.635134:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147196.635991:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66a3cdf6-ed02-4a11-b851-60f72c886415+3:1955:x1830967464025728:12345-192.168.203.36@tcp:39:umount.0 Request processed in 1174us (1776us total) trans 8589944412 rc 0/0 00000100:00100000:3.0:1746147196.635999:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10632 00010000:00010000:3.0:1746147196.857243:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147197.034674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.036246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.036268:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464025856 00000100:00100000:2.0:1746147197.036281:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464025856 00000100:00100000:2.0:1746147197.036352:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 614 00000100:00100000:2.0:1746147197.036360:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1957:x1830967464025856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.036377:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.036397:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f66c000/0xb4b2209fbdabdbe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e14bc expref: 12 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.036417:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147197.036733:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464026112 00000100:00100000:3.0:1746147197.036737:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464026112 00000100:00100000:3.0:1746147197.036758:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 615 00000100:00100000:3.0:1746147197.036762:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1957:x1830967464026112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147197.036770:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147197.036862:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+12:1957:x1830967464025856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 501us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.036870:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 614 00010000:00010000:3.0:1746147197.036872:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f66dc00/0xb4b2209fbdabdbf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e14ed expref: 12 pid: 14046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.036884:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147197.037035:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+10:1957:x1830967464026112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 271us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.037040:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 615 00000100:00100000:1.0:1746147197.037275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.037313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.037371:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464025984 00000100:00100000:3.0:1746147197.037374:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464025984 00000100:00100000:3.0:1746147197.037392:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 616 00000100:00100000:3.0:1746147197.037397:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+10:1957:x1830967464025984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147197.037407:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147197.037416:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4f21200/0xb4b2209fbdabdbe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e14e6 expref: 10 pid: 14045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.037423:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147197.037442:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d36a1c7b-354e-4b7a-ad9f-f73d073cfff0+9:1957:x1830967464025984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.037447:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 616 00000100:00100000:2.0:1746147197.037493:0:8480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464026624 00000100:00100000:2.0:1746147197.037497:0:8480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464026624 00000100:00100000:2.0:1746147197.037543:0:8480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12293 00000100:00100000:2.0:1746147197.037548:0:8480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+8:1955:x1830967464026624:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:2.0:1746147197.037573:0:8480:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdbfe 00000020:00010000:2.0:1746147197.037579:0:8480:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a46ea000: total 0 00000100:00080000:2.0:1746147197.037583:0:8480:0:(import.c:66:import_set_state_nolock()) ffff8800a46ea800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147197.037614:0:8480:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873285 00000100:00100000:2.0:1746147197.037752:0:8480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60817ea3-97af-43a7-ab2a-b628d12800db+6:1955:x1830967464026624:12345-192.168.203.36@tcp:9:umount.0 Request processed in 202us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.037758:0:8480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12293 00000020:00010000:2.0:1746147197.037777:0:7123:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a46ea000: total 0 00000100:00080000:3.0:1746147197.037868:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147197.037927:0:7123:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a46ea000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746147197.037983:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc9a000/0xb4b2209fbdac43bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5218 expref: 5 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.038012:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f065200/0xb4b2209fbdac22d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3f09 expref: 4 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.038032:0:7123:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e0400/0xb4b2209fbdac43ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e520a expref: 3 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.038050:0:7123:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a46ea000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746147197.038060:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147197.038062:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147197.038065:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147197.042299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.042388:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464027392 00000100:00100000:3.0:1746147197.042395:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464027392 00000100:00080000:0.0:1746147197.042447:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147197.042479:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12294 00000100:00100000:3.0:1746147197.042487:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+10:1955:x1830967464027392:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:3.0:1746147197.042550:0:21080:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdc05 00000020:00010000:3.0:1746147197.042557:0:21080:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a54b1800: total 0 00000100:00080000:3.0:1746147197.042560:0:21080:0:(import.c:66:import_set_state_nolock()) ffff880095325800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147197.042604:0:21080:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840699 00000100:00100000:3.0:1746147197.042767:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:60817ea3-97af-43a7-ab2a-b628d12800db+8:1955:x1830967464027392:12345-192.168.203.36@tcp:9:umount.0 Request processed in 280us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.042774:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12294 00000020:00010000:2.0:1746147197.042825:0:7122:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a54b1800: total 0 00010000:00010000:2.0:1746147197.042829:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147197.042853:0:7122:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a54b1800, canceled 0 locks, left on hash table 5. 00010000:00010000:2.0:1746147197.042896:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac43d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5226 expref: 7 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.042929:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e0e00/0xb4b2209fbdac43e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5234 expref: 6 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.042969:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9a800/0xb4b2209fbdac43b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5211 expref: 5 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.042986:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc9ae00/0xb4b2209fbdac43df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e522d expref: 4 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.043001:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f064e00/0xb4b2209fbdac22a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e3ee6 expref: 3 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.043011:0:7122:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a54b1800, canceled 5 locks, left on hash table 0. 00010000:00010000:2.0:1746147197.043019:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147197.043021:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147197.043022:0:7122:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147197.050057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.050400:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464027648 00000100:00100000:3.0:1746147197.050410:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464027648 00000100:00100000:3.0:1746147197.050487:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10633 00000100:00100000:3.0:1746147197.050496:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+6:1955:x1830967464027648:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:3.0:1746147197.050543:0:14048:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb4b2209fbdabdbf7 00000020:00010000:3.0:1746147197.050551:0:14048:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a46e9000: total 0 00000100:00080000:3.0:1746147197.050555:0:14048:0:(import.c:66:import_set_state_nolock()) ffff8800a46e9800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1746147197.050587:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1746147197.050781:0:14048:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944412 00000100:00100000:3.0:1746147197.050983:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60817ea3-97af-43a7-ab2a-b628d12800db+5:1955:x1830967464027648:12345-192.168.203.36@tcp:39:umount.0 Request processed in 487us (936us total) trans 8589944413 rc 0/0 00000100:00100000:3.0:1746147197.050991:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10633 00000020:00010000:0.0:1746147197.051126:0:9895:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a46e9000: total 0 00010000:00010000:0.0:1746147197.051167:0:9895:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a46e9000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746147197.051199:0:9895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012db13a00) 00010000:00010000:0.0:1746147197.051202:0:9895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147197.051208:0:9895:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5378800/0xb4b2209fbdabdc13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e1517 expref: 4 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.051243:0:9895:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a46e9000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746147197.051254:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147197.051256:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147197.051258:0:9895:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147197.079824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.079916:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464027904 00000100:00100000:2.0:1746147197.080090:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464027904 00000100:00100000:2.0:1746147197.080186:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4245 00000100:00100000:2.0:1746147197.080195:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+305:29326:x1830967464027904:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1746147197.080381:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29326:x1830967464027904:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 186us (562us total) trans 8589944414 rc 0/0 00000100:00100000:2.0:1746147197.080389:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4245 00000100:00080000:3.0:1746147197.080527:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147197.084525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.084781:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028160 00000100:00100000:3.0:1746147197.084791:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028160 00000100:00100000:3.0:1746147197.084842:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10634 00000100:00100000:3.0:1746147197.084849:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29326:x1830967464028160:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.085058:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.085062:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746147197.085088:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f895800/0xb4b2209fbdac8348 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aac expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.085124:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486e00/0xb4b2209fbdac4dcc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e5846 expref: 305 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.085133:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147197.085138:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147197.085149:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac847c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b85 expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.085241:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147197.085252:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147197.085259:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000004:00200000:3.0:1746147197.085273:0:14048:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00010000:00010000:3.0:1746147197.085373:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac847c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b85 expref: 307 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.085384:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b85 expref: 306 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.085391:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147197.085393:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147197.085395:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5de00, rc 0) 00000100:00100000:3.0:1746147197.085455:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29326:x1830967464028160:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 606us (1136us total) trans 8589944415 rc 0/0 00000100:00100000:3.0:1746147197.085461:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10634 00000100:00100000:0.0:1746147197.087274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.087406:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028288 00000100:00100000:0.0:1746147197.087413:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028288 00000100:00100000:0.0:1746147197.087447:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028544 00000100:00100000:0.0:1746147197.087449:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028544 00000100:00100000:0.0:1746147197.087462:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028800 00000100:00100000:0.0:1746147197.087464:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028800 00000100:00100000:0.0:1746147197.087478:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028416 00000100:00100000:0.0:1746147197.087480:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028416 00000100:00100000:0.0:1746147197.087488:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028672 00000100:00100000:0.0:1746147197.087489:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028672 00000100:00100000:0.0:1746147197.087495:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464028928 00000100:00100000:0.0:1746147197.087496:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464028928 00000100:00100000:0.0:1746147197.087505:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12295 00000100:00100000:0.0:1746147197.087515:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464028288:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.087557:0:8478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746147197.087567:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746147197.087571:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147197.087574:0:8478:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.087582:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.087584:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.087587:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.087590:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12296 00000100:00100000:3.0:1746147197.087597:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464028544:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.087615:0:8478:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 17 pid: 8481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087617:0:21080:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087628:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.087629:0:8478:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 17 pid: 8481 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.087633:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.087635:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.087637:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.087642:0:8478:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466507136:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.087656:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087664:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 24 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:3.0:1746147197.087673:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466507264:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147197.087718:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12297 00000100:00100000:3.0:1746147197.087724:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464028800:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1746147197.087740:0:17548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087749:0:17548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087754:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.087755:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.087757:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087771:0:17548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 17 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.087778:0:17548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 17 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:3.0:1746147197.087790:0:17548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466507392:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147197.087814:0:11147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12298 00000100:00100000:2.0:1746147197.087829:0:11147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464028416:12345-192.168.203.36@tcp:1:lfs.0 00000100:00100000:1.0:1746147197.087836:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12299 00000100:00100000:1.0:1746147197.087845:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464028672:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:1.0:1746147197.087861:0:17530:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.087870:0:11147:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.087872:0:17530:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.087878:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147197.087879:0:17530:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147197.087881:0:17530:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.087885:0:11147:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.087891:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.087893:0:11147:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.087895:0:17530:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 17 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.087896:0:11147:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.087908:0:17530:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 17 pid: 11147 timeout: 684 lvb_type: 0 00000100:00100000:1.0:1746147197.087916:0:17530:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466507520:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147197.087920:0:11147:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 24 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.087930:0:11147:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 24 pid: 4445 timeout: 684 lvb_type: 0 00000100:00100000:2.0:1746147197.087968:0:11147:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466507648:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147197.088196:0:8478:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db8eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.088218:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12300 00000100:00100000:0.0:1746147197.088224:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464028928:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.088241:0:4445:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.088250:0:4445:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.088255:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147197.088256:0:4445:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746147197.088307:0:17530:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f0403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.088313:0:11147:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147197.088323:0:17548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.088349:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00010000:00010000:0.0:1746147197.088377:0:4445:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.088395:0:4445:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 24 pid: 6881 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.088403:0:4445:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 24 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:0.0:1746147197.088411:0:4445:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466507776:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147197.088496:0:4445:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db8e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.094276:0:4445:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4445:1830967466507776:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147197.094306:0:4445:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.095270:0:8478:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8478:1830967466507136:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147197.095287:0:8478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.095720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.095734:0:17548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17548:1830967466507392:192.168.203.36@tcp:104: 00000100:00100000:1.0:1746147197.095737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1746147197.095748:0:17548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.095806:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029312 00000100:00100000:2.0:1746147197.095812:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029312 00000100:00100000:0.0:1746147197.095841:0:17530:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17530:1830967466507520:192.168.203.36@tcp:104: 00010000:00010000:0.0:1746147197.095855:0:17530:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.095906:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029056 00000100:00100000:1.0:1746147197.095910:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029056 00000100:00100000:3.0:1746147197.096023:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466507264:192.168.203.36@tcp:104: 00002000:00100000:2.0:1746147197.096031:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1662976->1925119) req@ffff8800a044b100 x1830967464029312/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147197.096034:0:21080:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147197.096040:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b100 with x1830967464029312 ext(1662976->1925119) 00010000:00010000:2.0:1746147197.096048:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 18 pid: 11147 timeout: 684 lvb_type: 0 00010000:00010000:2.0:1746147197.096059:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 18 pid: 11147 timeout: 684 lvb_type: 0 00000100:00100000:3.0:1746147197.096065:0:11147:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11147:1830967466507648:192.168.203.36@tcp:104: 00002000:00010000:2.0:1746147197.096065:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044b100 00010000:00010000:3.0:1746147197.096076:0:11147:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.096101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.096120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.096148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.096179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.096197:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029184 00000100:00100000:0.0:1746147197.096200:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029184 00010000:00010000:0.0:1746147197.096218:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 19 pid: 8481 timeout: 684 lvb_type: 0 00000100:00100000:3.0:1746147197.096232:0:11078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029440 00000100:00100000:0.0:1746147197.096232:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029568 00000100:00100000:3.0:1746147197.096234:0:11078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029440 00000100:00100000:0.0:1746147197.096234:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029568 00010000:00010000:0.0:1746147197.096241:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 27 pid: 4445 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096243:0:11078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 27 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:0.0:1746147197.096253:0:16058:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029696 00000100:00100000:0.0:1746147197.096255:0:16058:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029696 00000100:00100000:3.0:1746147197.096259:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6144 00010000:00010000:0.0:1746147197.096261:0:16058:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 20 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:3.0:1746147197.096265:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1958:x1830967464029184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147197.096275:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6145 00010000:00010000:3.0:1746147197.096277:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147197.096279:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967464029568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.096285:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147197.096297:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 20 pid: 8481 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096297:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 27 pid: 4445 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096305:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 20 pid: 8481 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096305:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 27 pid: 4445 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096324:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f895a00/0xb4b2209fbdac833a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7aa5 expref: 20 pid: 8481 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096324:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dd200/0xb4b2209fbdac8356 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ab3 expref: 27 pid: 4445 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096339:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.096339:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.096341:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.096341:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.096345:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096345:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096352:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096352:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096367:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147197.096367:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147197.096521:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1958:x1830967464029184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 256us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.096521:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967464029568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 242us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.096536:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6144 00000100:00100000:0.0:1746147197.096539:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6145 00000100:00100000:0.0:1746147197.096551:0:16058:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6146 00000100:00100000:3.0:1746147197.096554:0:11078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6147 00000100:00100000:0.0:1746147197.096556:0:16058:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1958:x1830967464029440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147197.096557:0:11078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1958:x1830967464029696:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147197.096563:0:11078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.096563:0:16058:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147197.096570:0:16058:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746147197.096571:0:11078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 18 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096574:0:16058:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 25 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096579:0:11078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 18 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096581:0:16058:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 25 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096592:0:11078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac846e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b77 expref: 18 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.096592:0:16058:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8400/0xb4b2209fbdac8467 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b70 expref: 25 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096600:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.096600:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.096601:0:11078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.096601:0:16058:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.096603:0:11078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096603:0:16058:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096609:0:11078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096609:0:16058:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096619:0:11078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.096619:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1638 00010000:00010000:0.0:1746147197.096620:0:16058:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147197.096622:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3301376->4038655) req@ffff8800a0448000 x1830967464029056/t0(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147197.096625:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967464029312:12345-192.168.203.36@tcp:4:multiop.0 00002000:00100000:1.0:1746147197.096631:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967464029056 ext(3301376->4038655) 00000100:00100000:3.0:1746147197.096632:0:11078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1958:x1830967464029696:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.096632:0:16058:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1958:x1830967464029440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 76us (512us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147197.096637:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 24 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:0.0:1746147197.096637:0:16058:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6146 00000100:00100000:3.0:1746147197.096639:0:11078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6147 00010000:00010000:1.0:1746147197.096646:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:3.0:1746147197.096652:0:17548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147197.096652:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0448000 00010000:00010000:3.0:1746147197.096658:0:17548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.096666:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1639 00000100:00100000:1.0:1746147197.096671:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967464029056:12345-192.168.203.36@tcp:4:multiop.0 00010000:00010000:3.0:1746147197.096675:0:17548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096681:0:17548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096692:0:17548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096698:0:17548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5dc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.096701:0:17548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096708:0:17548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096717:0:17548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096722:0:17548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5dc00/0xb4b2209fbdac849f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096748:0:8478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096755:0:8478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.096760:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1956:x1830967464028800:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9036us (9432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.096767:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12297 00010000:00010000:0.0:1746147197.096772:0:8478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096778:0:8478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096783:0:8478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096785:0:11147:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096788:0:8478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aaa0a00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.096791:0:11147:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096791:0:8478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096796:0:8478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096802:0:11147:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096803:0:8478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096808:0:11147:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.096809:0:8478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aaa0a00/0xb4b2209fbdac8491 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096814:0:11147:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096817:0:11147:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f865600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.096820:0:11147:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096825:0:11147:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096833:0:11147:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.096833:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1956:x1830967464028288:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9319us (9564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.096838:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12295 00010000:00010000:3.0:1746147197.096839:0:11147:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f865600/0xb4b2209fbdac84ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.096865:0:11147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1956:x1830967464028416:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9041us (9522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.096870:0:11147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12298 00010000:00010000:3.0:1746147197.096882:0:21080:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096888:0:21080:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096900:0:21080:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096906:0:21080:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096913:0:21080:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096918:0:21080:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5d200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.096920:0:21080:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096926:0:21080:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096934:0:21080:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.096952:0:21080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d200/0xb4b2209fbdac8498 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.096993:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1956:x1830967464028544:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 9397us (9685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.096998:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12296 00000100:00100000:2.0:1746147197.103870:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967464029312:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 7235us (8142us total) trans 21474840700 rc 0/0 00000100:00100000:2.0:1746147197.103884:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1638 00002000:00100000:2.0:1746147197.103896:0:11283:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x418:0x0] (1662976->1925119) req@ffff8800a044b100 x1830967464029312/t21474840700(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:573/0 lens 488/448 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147197.103905:0:11283:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a044b100 with x1830967464029312 ext(1662976->1925119) 00010000:00010000:2.0:1746147197.103917:0:11283:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00010000:00010000:2.0:1746147197.103934:0:11283:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00002000:00010000:2.0:1746147197.103970:0:11283:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a044b100 00000100:00100000:1.0:1746147197.112666:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967464029056:12345-192.168.203.36@tcp:4:multiop.0 Request processed in 15986us (16918us total) trans 17179873286 rc 0/0 00000100:00100000:1.0:1746147197.112676:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1639 00002000:00100000:1.0:1746147197.112687:0:8485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x41e:0x0] (3301376->4038655) req@ffff8800a0448000 x1830967464029056/t17179873286(0) o4->56f09401-e89b-4631-94a7-0dc8c90129f6@192.168.203.36@tcp:573/0 lens 488/448 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.112696:0:8485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0448000 with x1830967464029056 ext(3301376->4038655) 00010000:00010000:1.0:1746147197.112705:0:8485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:1.0:1746147197.112717:0:8485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00002000:00010000:1.0:1746147197.112723:0:8485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0448000 00000100:00100000:3.0:1746147197.113162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.113241:0:7119:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029824 00000100:00100000:0.0:1746147197.113253:0:7119:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029824 00010000:00010000:0.0:1746147197.113287:0:7119:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00000100:00100000:0.0:1746147197.115480:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6148 00000100:00100000:0.0:1746147197.115495:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1957:x1830967464029824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.115512:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.115553:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.115567:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.115590:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e600/0xb4b2209fbdac8405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b2a expref: 16 pid: 11147 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.115608:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.115610:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.115615:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.115622:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.115646:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147197.115695:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+15:1957:x1830967464029824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.115702:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6148 00000100:00100000:1.0:1746147197.115974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.117218:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464029952 00000100:00100000:3.0:1746147197.117226:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464029952 00010000:00010000:3.0:1746147197.117253:0:7121:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00000100:00100000:0.0:1746147197.117315:0:7119:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6149 00000100:00100000:0.0:1746147197.117323:0:7119:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967464029952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.117333:0:7119:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147197.117348:0:7119:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147194 -> 1746147195 00002000:00010000:0.0:1746147197.117351:0:7119:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147194 -> 1746147195 00010000:00010000:0.0:1746147197.117355:0:7119:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.117367:0:7119:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.117382:0:7119:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb8200/0xb4b2209fbdac8475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3301376->4038655) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b7e expref: 23 pid: 6881 timeout: 684 lvb_type: 0 00010000:00010000:0.0:1746147197.117394:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.117395:0:7119:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.117399:0:7119:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.117405:0:7119:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.117421:0:7119:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147197.117456:0:7119:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+22:1957:x1830967464029952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.117462:0:7119:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6149 00010000:00010000:1.0:1746147197.118025:0:4445:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118034:0:4445:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118059:0:4445:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118065:0:4445:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118072:0:4445:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118078:0:4445:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1b6200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147197.118082:0:4445:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118089:0:4445:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118102:0:4445:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118108:0:4445:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1b6200/0xb4b2209fbdac84b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4445 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.118170:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967464028928:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 29944us (30778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.118176:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12300 00010000:00010000:1.0:1746147197.118216:0:17530:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118222:0:17530:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118239:0:17530:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118245:0:17530:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118250:0:17530:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118256:0:17530:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed76600 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147197.118258:0:17530:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118264:0:17530:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118273:0:17530:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.118278:0:17530:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed76600/0xb4b2209fbdac84a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.118307:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+14:1956:x1830967464028672:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 30464us (30942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.118312:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12299 00000100:00100000:0.0:1746147197.124616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.124681:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030208 00000100:00100000:3.0:1746147197.124692:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030208 00000100:00100000:3.0:1746147197.124745:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10635 00000100:00100000:3.0:1746147197.124753:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+306:29326:x1830967464030208:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1746147197.124793:0:14048:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746147197.124813:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f31c600/0xb4b2209fbdac7a5e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7503 expref: 306 pid: 14125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.124847:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea34600/0xb4b2209fbdac75e2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71b4 expref: 305 pid: 23726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.124859:0:14048:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e48cc00/0xb4b2209fbdac7613 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e71de expref: 304 pid: 14047 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.124873:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147197.124877:0:14048:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147197.124901:0:14048:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147197.124911:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00010000:00010000:3.0:1746147197.124918:0:14048:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000040:00080000:3.0:1746147197.126259:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2933, 88 off243816 00000004:00080000:3.0:1746147197.126267:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113329355ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126318:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2883, 88 off239416 00000004:00080000:3.0:1746147197.126323:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113385339ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126354:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2884, 88 off239504 00000004:00080000:3.0:1746147197.126357:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113419881ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126364:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2934, 88 off243904 00000004:00080000:3.0:1746147197.126367:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113429991ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126374:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2935, 88 off243992 00000004:00080000:3.0:1746147197.126376:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113438715ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126382:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2885, 88 off239592 00000004:00080000:3.0:1746147197.126384:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113446922ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126390:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2886, 88 off239680 00000004:00080000:3.0:1746147197.126392:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113455024ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126398:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2887, 88 off239768 00000004:00080000:3.0:1746147197.126400:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113463124ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126406:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2936, 88 off244080 00000004:00080000:3.0:1746147197.126408:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113471175ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126414:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2888, 88 off239856 00000004:00080000:3.0:1746147197.126417:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113479491ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126422:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2937, 88 off244168 00000004:00080000:3.0:1746147197.126425:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113487416ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126430:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2889, 88 off239944 00000004:00080000:3.0:1746147197.126432:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113495290ns, next at 537465048041ns, rc = 0 00000040:00080000:3.0:1746147197.126438:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2938, 88 off244256 00000004:00080000:3.0:1746147197.126440:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113503221ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126446:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2939, 88 off244344 00000004:00080000:3.0:1746147197.126449:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113511830ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126455:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2940, 88 off244432 00000004:00080000:3.0:1746147197.126457:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113520209ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126463:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2941, 88 off244520 00000004:00080000:3.0:1746147197.126465:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584113527995ns, next at 537464818071ns, rc = 0 00000040:00080000:3.0:1746147197.126471:0:14048:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2890, 88 off240032 00000004:00080000:3.0:1746147197.126473:0:14048:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584113535882ns, next at 537465048041ns, rc = 0 00000001:00080000:2.0:1746147197.151795:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944414 is committed 00000001:00080000:2.0:1746147197.151806:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944416 is committed 00000004:00080000:2.0:1746147197.151809:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:2.0:1746147197.151814:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2078 committed 00000004:00080000:2.0:1746147197.151819:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2077 committed 00000004:00080000:2.0:1746147197.151820:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2076 committed 00000004:00080000:2.0:1746147197.151821:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2075 committed 00000004:00080000:2.0:1746147197.151822:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000004:00080000:2.0:1746147197.151824:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2074 committed 00000004:00080000:2.0:1746147197.151825:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000004:00080000:2.0:1746147197.151826:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2073 committed 00000004:00080000:2.0:1746147197.151828:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:2.0:1746147197.151829:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000004:00080000:2.0:1746147197.151831:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00000004:00080000:2.0:1746147197.151832:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2072 committed 00000004:00080000:2.0:1746147197.151833:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2071 committed 00000004:00080000:2.0:1746147197.151835:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:2.0:1746147197.151836:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:2.0:1746147197.151838:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2070 committed 00000001:00100000:2.0:1746147197.151843:0:14137:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 60817ea3-97af-43a7-ab2a-b628d12800db 00000001:00080000:2.0:1746147197.151846:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944413 is committed 00000020:00000080:2.0:1746147197.151849:0:14137:0:(genops.c:904:class_export_put()) final put ffff8800a46e9000/60817ea3-97af-43a7-ab2a-b628d12800db 00000001:00100000:2.0:1746147197.151858:0:14137:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66a3cdf6-ed02-4a11-b851-60f72c886415 00000001:00080000:2.0:1746147197.151862:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944412 is committed 00000020:00000080:2.0:1746147197.151864:0:14137:0:(genops.c:904:class_export_put()) final put ffff880129f05800/66a3cdf6-ed02-4a11-b851-60f72c886415 00000100:00100000:2.0:1746147197.152024:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152075:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152115:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152134:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152145:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152167:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152191:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746147197.152195:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466507904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152218:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152246:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152257:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152266:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152291:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152303:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152310:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152328:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152337:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152343:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152353:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152360:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746147197.152363:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508288:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746147197.152417:0:14048:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d49aa00 reply state ffff88012db87c00 transno 8589944416 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147197.152426:0:14048:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147197.152487:0:14048:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147197.152497:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29326:x1830967464030208:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 27744us (27890us total) trans 8589944416 rc 0/0 00000100:00100000:3.0:1746147197.152504:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10635 00000020:00000080:3.0:1746147197.152524:0:18871:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a46e9000/60817ea3-97af-43a7-ab2a-b628d12800db for lustre-MDT0000 00010000:00010000:0.0:1746147197.152575:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14048 initiator: MDT0 00000020:00000080:3.0:1746147197.152576:0:18871:0:(genops.c:863:class_export_destroy()) destroying export ffff880129f05800/66a3cdf6-ed02-4a11-b851-60f72c886415 for lustre-MDT0000 00010000:00010000:0.0:1746147197.152582:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147197.152588:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147197.152592:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5d800 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147197.152595:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14048 initiator: MDT0 00000020:00000080:3.0:1746147197.152596:0:18871:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a46e9800 for lustre-MDT0000 00000020:00000080:3.0:1746147197.152599:0:18871:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009d042800 for lustre-MDT0000 00010000:00010000:0.0:1746147197.152600:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14048 initiator: MDT0 00010000:00010000:0.0:1746147197.152611:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00000100:00100000:3.0:1746147197.152612:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508032 00010000:00010000:0.0:1746147197.152614:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147197.152616:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147197.152617:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508032 00010000:00010000:0.0:1746147197.152621:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5d800/0xb4b2209fbdac84bb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14048 initiator: MDT0 00000100:00100000:3.0:1746147197.152642:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508544 00000100:00100000:3.0:1746147197.152644:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508544 00000100:00100000:3.0:1746147197.152649:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509056 00000100:00100000:3.0:1746147197.152650:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509056 00000100:00100000:3.0:1746147197.152658:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509568 00000100:00100000:3.0:1746147197.152659:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509568 00000100:00100000:3.0:1746147197.152663:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466507904 00000100:00100000:3.0:1746147197.152665:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466507904 00000100:00100000:3.0:1746147197.152669:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508416 00000100:00100000:3.0:1746147197.152670:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508416 00000100:00100000:3.0:1746147197.152674:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508928 00000100:00100000:3.0:1746147197.152676:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508928 00000100:00100000:3.0:1746147197.152679:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509440 00000100:00100000:3.0:1746147197.152680:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509440 00000100:00100000:3.0:1746147197.152684:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508160 00000100:00100000:3.0:1746147197.152686:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508160 00000100:00100000:3.0:1746147197.152689:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508672 00000100:00100000:3.0:1746147197.152690:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508672 00000100:00100000:3.0:1746147197.152694:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509184 00000100:00100000:3.0:1746147197.152695:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509184 00000100:00100000:3.0:1746147197.152699:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509696 00000100:00100000:3.0:1746147197.152700:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509696 00000100:00100000:3.0:1746147197.152706:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12301 00000100:00100000:3.0:1746147197.152710:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830967466508032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152878:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.152881:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1830967466508032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (806us total) trans 17179873287 rc 0/0 00000100:00100000:3.0:1746147197.152885:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12301 00000100:00100000:2.0:1746147197.152886:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.152894:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508288 00000100:00100000:3.0:1746147197.152896:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508288 00000100:00100000:2.0:1746147197.152903:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.152904:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12302 00000100:00100000:3.0:1746147197.152908:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1830967466508544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.152910:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152921:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152927:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.152964:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.152992:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466508800 00000100:00100000:2.0:1746147197.152995:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466508800 00000100:00100000:2.0:1746147197.153005:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509312 00000100:00100000:2.0:1746147197.153007:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509312 00000100:00100000:2.0:1746147197.153013:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509824 00000100:00100000:2.0:1746147197.153014:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509824 00000100:00100000:2.0:1746147197.153021:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12303 00000100:00100000:2.0:1746147197.153025:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466509056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.153035:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466508544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (900us total) trans 17179873288 rc 0/0 00000100:00100000:3.0:1746147197.153039:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12302 00000100:00100000:3.0:1746147197.153047:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12304 00000100:00100000:3.0:1746147197.153051:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466509568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.153122:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ececa80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466509056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (962us total) trans 21474840701 rc 0/0 00000100:00100000:2.0:1746147197.153127:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12303 00000100:00100000:3.0:1746147197.153129:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466509568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (951us total) trans 21474840702 rc 0/0 00000100:00100000:3.0:1746147197.153133:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12304 00000100:00100000:2.0:1746147197.153136:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:3.0:1746147197.153140:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12306 00000100:00100000:2.0:1746147197.153140:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466507904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.153144:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466508416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.153163:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12307 00000100:00100000:2.0:1746147197.153167:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830967466508928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.153233:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466508416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1001us total) trans 17179873289 rc 0/0 00000100:00100000:3.0:1746147197.153238:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12306 00000100:00100000:2.0:1746147197.153241:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466508928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (982us total) trans 21474840703 rc 0/0 00000100:00100000:2.0:1746147197.153245:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12307 00000100:00100000:3.0:1746147197.154561:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12308 00000100:00100000:2.0:1746147197.154582:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12309 00000100:00100000:2.0:1746147197.154597:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466508160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.154602:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12310 00000100:00100000:1.0:1746147197.154617:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466508672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.154620:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12311 00000100:00100000:0.0:1746147197.154626:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466509184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.154748:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466508672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (2426us total) trans 17179873290 rc 0/0 00000100:00100000:0.0:1746147197.154752:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466509184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (2409us total) trans 21474840704 rc 0/0 00000100:00100000:1.0:1746147197.154753:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12310 00000100:00100000:0.0:1746147197.154757:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12311 00000100:00100000:1.0:1746147197.154765:0:17530:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12312 00000100:00100000:1.0:1746147197.154769:0:17530:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466509696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.154846:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466508160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (2542us total) trans 17179873291 rc 0/0 00000100:00100000:1.0:1746147197.154855:0:17530:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466509696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (2501us total) trans 21474840705 rc 0/0 00000100:00100000:3.0:1746147197.154877:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466509440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.154993:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466509440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (2715us total) trans 21474840706 rc 0/0 00000100:00100000:0.0:1746147197.155270:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:0.0:1746147197.155277:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466508288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.155321:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12309 00000100:00100000:2.0:1746147197.155334:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12314 00000100:00100000:2.0:1746147197.155338:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830967466508800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.155446:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466508800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (2541us total) trans 17179873292 rc 0/0 00000100:00100000:2.0:1746147197.155451:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12314 00000100:00100000:2.0:1746147197.155460:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:2.0:1746147197.155465:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967466509312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.155576:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967466509312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (2653us total) trans 21474840707 rc 0/0 00000100:00100000:2.0:1746147197.155581:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000100:00100000:2.0:1746147197.155590:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12316 00000100:00100000:2.0:1746147197.155594:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1830967466509824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.155686:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1830967466509824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (2721us total) trans 21474840708 rc 0/0 00000100:00100000:2.0:1746147197.155690:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12316 00000100:00100000:1.0:1746147197.155809:0:17530:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12312 00000100:00100000:3.0:1746147197.155991:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12308 00000100:00080000:3.0:1746147197.156019:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746147197.156022:0:7131:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147197.156438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00080000:1.0:1746147197.156470:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02300/2, rc 0, transno 17179873292 00000100:00100000:1.0:1746147197.156475:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147197.156483:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03480/2, rc 0, transno 21474840707 00000100:00100000:1.0:1746147197.156489:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147197.156494:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f732d80/2, rc 0, transno 21474840708 00000100:00100000:1.0:1746147197.156496:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147197.156502:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01500/2, rc 0, transno 17179873291 00000100:00100000:1.0:1746147197.156504:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147197.156509:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00a80/2, rc 0, transno 17179873290 00000100:00100000:1.0:1746147197.156511:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147197.156515:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03100/2, rc 0, transno 21474840704 00000100:00100000:1.0:1746147197.156517:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147197.156522:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e2b8380/2, rc 0, transno 21474840705 00000100:00100000:1.0:1746147197.156524:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466509696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147197.156576:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02680/2, rc 0, transno 17179873289 00000100:00100000:3.0:1746147197.156579:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.156585:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d03800/2, rc 0, transno 21474840703 00000100:00100000:3.0:1746147197.156587:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147197.156592:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01f80/2, rc 0, transno 21474840706 00000100:00100000:3.0:1746147197.156594:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147197.156600:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01880/2, rc 0, transno 17179873287 00000100:00100000:3.0:1746147197.156602:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.156607:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00000/2, rc 0, transno 17179873288 00000100:00100000:3.0:1746147197.156609:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466508544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.156614:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d01c00/2, rc 0, transno 21474840701 00000100:00100000:3.0:1746147197.156617:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147197.156623:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00380/2, rc 0, transno 21474840702 00000100:00100000:3.0:1746147197.156625:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.156640:0:14048:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030336 00000100:00100000:3.0:1746147197.156644:0:14048:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030336 00000100:00100000:3.0:1746147197.156671:0:14048:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10636 00000100:00100000:3.0:1746147197.156676:0:14048:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+301:29326:x1830967464030336:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.156688:0:14048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.156701:0:14048:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b8c expref: -99 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.156741:0:14048:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.156752:0:14048:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 302 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.156767:0:14048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:3.0:1746147197.156769:0:14048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147197.156772:0:14048:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5da00, rc 0) 00000100:00100000:3.0:1746147197.156800:0:14048:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29326:x1830967464030336:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.156806:0:14048:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10636 00002000:00010000:0.0:1746147197.157017:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147197.157021:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:0.0:1746147197.157023:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147197.157024:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746147197.157026:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1746147197.157053:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830967466508288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1777us (4174us total) trans 17179873293 rc 0/0 00000100:00100000:0.0:1746147197.157058:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00000004:00080000:1.0:1746147197.157254:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d02a00/2, rc 0, transno 17179873293 00000100:00100000:1.0:1746147197.157257:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466508288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.158320:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466507904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5178us (6109us total) trans 17179873294 rc 0/0 00000100:00100000:2.0:1746147197.158326:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00000004:00080000:3.0:1746147197.158565:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d00e00/2, rc 0, transno 17179873294 00000100:00100000:3.0:1746147197.158569:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466507904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.158576:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147197.158582:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.158607:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.159128:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466509952 00000100:00100000:2.0:1746147197.159133:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466509952 00000100:00100000:2.0:1746147197.159166:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12317 00000100:00100000:2.0:1746147197.159172:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1830967466509952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.159893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.159955:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030464 00000100:00100000:0.0:1746147197.159959:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030464 00000100:00100000:2.0:1746147197.159960:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1830967466509952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 787us (1352us total) trans 21474840709 rc 0/0 00000100:00100000:2.0:1746147197.159965:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12317 00000004:00080000:3.0:1746147197.160031:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047b80/2, rc 0, transno 21474840709 00000100:00100000:3.0:1746147197.160035:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466509952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.160101:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10637 00000100:00100000:0.0:1746147197.160108:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29326:x1830967464030464:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.160117:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.160129:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d600/0xb4b2209fbdac84c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b93 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.160180:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.160194:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.160203:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00200000:0.0:1746147197.160222:0:16361:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x398:0x0]: returning size 9140000 00000004:00200000:0.0:1746147197.160226:0:16361:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147197.160236:0:16361:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.160255:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d600/0xb4b2209fbdac84c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b93 expref: 304 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.160269:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b93 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.160275:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147197.160278:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147197.160280:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f68d800, rc 0) 00000100:00100000:0.0:1746147197.160317:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29326:x1830967464030464:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 209us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.160321:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10637 00000100:00100000:3.0:1746147197.164184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.164322:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030592 00000100:00100000:2.0:1746147197.164326:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030848 00000100:00100000:3.0:1746147197.164328:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030592 00000100:00100000:2.0:1746147197.164329:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030848 00000100:00100000:3.0:1746147197.164352:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464031104 00000100:00100000:3.0:1746147197.164354:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464031104 00000100:00100000:2.0:1746147197.164360:0:8478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030720 00000100:00100000:2.0:1746147197.164361:0:8478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030720 00000100:00100000:3.0:1746147197.164362:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464030976 00000100:00100000:3.0:1746147197.164363:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464030976 00000100:00100000:3.0:1746147197.164369:0:17548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464031232 00000100:00100000:3.0:1746147197.164371:0:17548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464031232 00000100:00100000:2.0:1746147197.164374:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12318 00000100:00100000:3.0:1746147197.164380:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12319 00000100:00100000:2.0:1746147197.164380:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967464030592:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147197.164383:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967464030848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.164393:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147197.164393:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.164408:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ba8 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.164408:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7b9a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147197.164427:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 2097152, mtime: 0x6814177b, atime: 0x68141778, ctime: 0x6814177b, blocks: 0x821 00002000:00010000:2.0:1746147197.164427:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 1048576, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x7f7 00010000:00010000:3.0:1746147197.164440:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164440:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.164441:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164441:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164447:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164448:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147197.164459:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164460:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164468:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af400, rc 0) 00010000:00010000:2.0:1746147197.164470:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1b7400, rc 0) 00000100:00100000:2.0:1746147197.164500:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967464030592:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.164505:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12318 00000100:00100000:3.0:1746147197.164514:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967464030848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.164518:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12320 00000100:00100000:3.0:1746147197.164520:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12319 00000100:00100000:2.0:1746147197.164522:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967464031104:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147197.164537:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147197.164538:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12321 00000100:00100000:3.0:1746147197.164543:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967464030720:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147197.164544:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bb6 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.164551:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147197.164553:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 4945696, mtime: 0x6814177b, atime: 0x6814177b, ctime: 0x6814177b, blocks: 0x1607 00010000:00010000:3.0:1746147197.164557:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7ba1 expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.164560:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164561:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164564:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147197.164565:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x821 00010000:00010000:3.0:1746147197.164570:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.164571:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164573:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164574:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147197.164579:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5d400, rc 0) 00010000:00010000:3.0:1746147197.164581:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164586:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afa00, rc 0) 00000100:00100000:2.0:1746147197.164593:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967464031104:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 71us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.164595:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967464030720:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.164597:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12320 00000100:00100000:3.0:1746147197.164602:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12321 00000100:00100000:2.0:1746147197.164605:0:8478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12322 00000100:00100000:3.0:1746147197.164608:0:17548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12323 00000100:00100000:2.0:1746147197.164609:0:8478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+16:1959:x1830967464030976:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:3.0:1746147197.164612:0:17548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1959:x1830967464031232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147197.164614:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.164615:0:17548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.164621:0:17548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bbd expref: -99 pid: 17548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.164621:0:8478:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7baf expref: -99 pid: 8478 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147197.164629:0:17548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 4194304, mtime: 0x6814177b, atime: 0x6814177a, ctime: 0x6814177b, blocks: 0x1029 00002000:00010000:2.0:1746147197.164629:0:8478:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 2097152, mtime: 0x6814177b, atime: 0x6814177b, ctime: 0x6814177b, blocks: 0x821 00010000:00010000:3.0:1746147197.164634:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164634:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.164636:0:17548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.164636:0:8478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.164639:0:17548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147197.164639:0:8478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164646:0:17548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 24 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147197.164646:0:8478:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 17 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.164652:0:17548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af600, rc 0) 00010000:00010000:2.0:1746147197.164652:0:8478:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb5c800, rc 0) 00000100:00100000:3.0:1746147197.164664:0:17548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1959:x1830967464031232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 52us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.164664:0:8478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1959:x1830967464030976:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 54us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.164668:0:17548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12323 00000100:00100000:2.0:1746147197.164670:0:8478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12322 00000100:00100000:0.0:1746147197.178997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.179378:0:8485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464031488 00000100:00100000:1.0:1746147197.179389:0:8485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464031488 00000100:00100000:1.0:1746147197.179551:0:8485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4831 00000100:00100000:1.0:1746147197.179560:0:8485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967464031488:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.179601:0:8485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.179615:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.179617:0:8485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.179622:0:8485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.179635:0:8485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.181103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.181202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.181250:0:11283:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464031872 00000100:00100000:2.0:1746147197.181256:0:11283:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464031872 00000100:00100000:2.0:1746147197.181304:0:11283:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4832 00000100:00100000:2.0:1746147197.181311:0:11283:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967464031872:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147197.181337:0:11283:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.181348:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.181349:0:11283:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.181353:0:11283:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.181365:0:11283:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.182871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.182909:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464031744 00000100:00100000:0.0:1746147197.182914:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464031744 00000100:00100000:0.0:1746147197.182972:0:25531:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464032256 00000100:00100000:0.0:1746147197.182975:0:25531:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464032256 00000100:00100000:0.0:1746147197.182996:0:25531:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4833 00000100:00100000:0.0:1746147197.183003:0:25531:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967464031744:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147197.183028:0:25531:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.183038:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.183039:0:25531:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.183043:0:25531:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.183056:0:25531:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.183517:0:21472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4834 00000100:00100000:3.0:1746147197.183537:0:21472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967464032256:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:3.0:1746147197.183555:0:21472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.183567:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.183569:0:21472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.183571:0:21472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.183578:0:21472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.184873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.184895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.184907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.184971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.184992:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464032768 00000100:00100000:1.0:1746147197.184998:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464032768 00000100:00100000:1.0:1746147197.185032:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464032384 00000100:00100000:1.0:1746147197.185035:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464032384 00000100:00100000:1.0:1746147197.185047:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033024 00000100:00100000:1.0:1746147197.185049:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033024 00000100:00100000:1.0:1746147197.185060:0:8486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033152 00000100:00100000:1.0:1746147197.185062:0:8486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033152 00000100:00100000:1.0:1746147197.185072:0:8486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4835 00000100:00100000:1.0:1746147197.185078:0:8486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967464032768:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.185100:0:8486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.185110:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.185113:0:8486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.185115:0:8486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.185124:0:8486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.185929:0:21471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4836 00000100:00100000:2.0:1746147197.185953:0:21471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967464032384:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147197.185972:0:21471:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.185981:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.185982:0:21471:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.185986:0:21471:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.185994:0:21471:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.186648:0:21470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4837 00000100:00100000:0.0:1746147197.186657:0:21470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967464033024:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:0.0:1746147197.186675:0:21470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.186683:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.186684:0:21470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.186687:0:21470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.186695:0:21470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.187302:0:1351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4838 00000100:00100000:2.0:1746147197.187310:0:1351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+29:1956:x1830967464033152:12345-192.168.203.36@tcp:3:lfs.0 00010000:00010000:2.0:1746147197.187327:0:1351:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.187335:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.187337:0:1351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.187340:0:1351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.187349:0:1351:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.203929:0:8485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.203991:0:8485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.203999:0:8485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.204005:0:8485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f67e200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147197.204010:0:8485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.204017:0:8485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.204038:0:8485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.204044:0:8485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f67e200/0xb4b2209fbdac8501 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.204154:0:8485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:56f09401-e89b-4631-94a7-0dc8c90129f6+23:1957:x1830967464031488:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 24590us (25163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.204165:0:8485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4831 00010000:00010000:3.0:1746147197.210870:0:11283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210887:0:11283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210894:0:11283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210901:0:11283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5d800 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.210905:0:11283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210913:0:11283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210931:0:11283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.210959:0:11283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5d800/0xb4b2209fbdac8508 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.211805:0:11283:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:56f09401-e89b-4631-94a7-0dc8c90129f6+30:1957:x1830967464031872:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 30489us (30703us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147197.211816:0:11283:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4832 00010000:00010000:1.0:1746147197.214307:0:25531:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214324:0:25531:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214332:0:25531:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214337:0:25531:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f68dc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147197.214341:0:25531:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214348:0:25531:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214365:0:25531:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.214371:0:25531:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f68dc00/0xb4b2209fbdac850f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25531 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.216957:0:25531:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:56f09401-e89b-4631-94a7-0dc8c90129f6+28:1957:x1830967464031744:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 33925us (35725us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.216972:0:25531:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4833 00010000:00010000:3.0:1746147197.228194:0:21471:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228214:0:21471:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228222:0:21471:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228229:0:21471:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb5c200 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.228233:0:21471:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228241:0:21471:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228260:0:21471:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.228265:0:21471:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c200/0xb4b2209fbdac8524 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.228387:0:21471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:56f09401-e89b-4631-94a7-0dc8c90129f6+21:1956:x1830967464032384:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 42445us (43485us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147197.228399:0:21471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4836 00010000:00010000:1.0:1746147197.231974:0:8486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.231991:0:8486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.231999:0:8486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.232004:0:8486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dfb9c00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:1.0:1746147197.232007:0:8486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.232014:0:8486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.232029:0:8486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.232033:0:8486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfb9c00/0xb4b2209fbdac851d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.234439:0:8486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967464032768:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 47028us (47238us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.234453:0:8486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4835 00010000:00010000:2.0:1746147197.237598:0:1351:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237616:0:1351:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237625:0:1351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237632:0:1351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edad400 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:2.0:1746147197.237636:0:1351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237644:0:1351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237663:0:1351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.237670:0:1351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edad400/0xb4b2209fbdac8532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1351 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.238294:0:1351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967464033152:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 50979us (53317us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147197.238305:0:1351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4838 00010000:00010000:3.0:1746147197.241811:0:21472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241827:0:21472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241834:0:21472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241840:0:21472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4ae000 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:3.0:1746147197.241843:0:21472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241849:0:21472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241864:0:21472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.241870:0:21472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac8516 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147197.241969:0:21472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464032256:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 58441us (59097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147197.241979:0:21472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4834 00010000:00010000:0.0:1746147197.243624:0:21470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243637:0:21470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243644:0:21470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243650:0:21470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f68cc00 already unused, calling callback (ffffffffa07dcd70) 00010000:00010000:0.0:1746147197.243654:0:21470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243662:0:21470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243676:0:21470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.243683:0:21470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f68cc00/0xb4b2209fbdac852b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.243735:0:21470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464033024:12345-192.168.203.36@tcp:3:lfs.0 Request processed in 57078us (58824us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147197.243745:0:21470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4837 00000100:00100000:0.0:1746147197.250734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.250920:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033536 00000100:00100000:2.0:1746147197.250932:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033536 00000100:00100000:2.0:1746147197.251029:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10638 00000100:00100000:2.0:1746147197.251038:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29326:x1830967464033536:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1746147197.251091:0:16361:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.251118:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f68d800/0xb4b2209fbdac84d0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x398:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b93 expref: 303 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.251146:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147197.251151:0:16361:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147197.251187:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.251198:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.251206:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000004:00010000:2.0:1746147197.251390:0:16361:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d499180 reply state ffff880094563000 transno 8589944417 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147197.251397:0:16361:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147197.251481:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+304:29326:x1830967464033536:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 443us (756us total) trans 8589944417 rc 0/0 00000100:00100000:2.0:1746147197.251487:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10638 00010000:00010000:0.0:1746147197.253320:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.253332:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.253339:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147197.253340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1746147197.253345:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a8000 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147197.253349:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.253355:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.253371:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147197.253375:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147197.253378:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:0.0:1746147197.253382:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a8000/0xb4b2209fbdac8539 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:3.0:1746147197.253541:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033664 00000100:00100000:3.0:1746147197.253550:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033664 00000100:00100000:3.0:1746147197.253596:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12324 00000100:00100000:3.0:1746147197.253602:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29326:x1830967464033664:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.253616:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.253630:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bc4 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.253655:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.253662:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.253664:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.253668:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bc4 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.253695:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.253707:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:3.0:1746147197.253718:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466510080:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147197.254209:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147197.256349:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466510080:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.256379:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bc4 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.256401:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4aec00, rc 0) 00000100:00100000:3.0:1746147197.256442:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29326:x1830967464033664:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2840us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.256449:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12324 00000100:00100000:0.0:1746147197.258913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.259061:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033792 00000100:00100000:2.0:1746147197.259070:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033792 00010000:00010000:2.0:1746147197.259105:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:2.0:1746147197.259145:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6150 00000100:00100000:2.0:1746147197.259151:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967464033792:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.259166:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.259185:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.259196:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.259217:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1b7400/0xb4b2209fbdac84d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b9a expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.259231:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.259233:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.259239:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bc4 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.259247:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bc4 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.259274:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0xb4b2209fbdac8540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bc4 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.259284:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466510208:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147197.259370:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.262515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.262552:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464033920 00000100:00100000:0.0:1746147197.262560:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464033920 00000100:00100000:0.0:1746147197.262602:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12325 00000100:00100000:0.0:1746147197.262609:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29326:x1830967464033920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.262627:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.262645:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bcb expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.262674:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.262682:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.262683:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.262687:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bcb expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.262715:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.262727:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:0.0:1746147197.262744:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466510336:192.168.203.36@tcp:104: 00000100:00100000:0.0:1746147197.262812:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.263354:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466510208:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147197.263374:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.263412:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464033792:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4260us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.263420:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6150 00000100:00100000:2.0:1746147197.265977:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466510336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147197.266008:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bcb expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.266025:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095371c00, rc 0) 00000100:00100000:2.0:1746147197.266064:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29326:x1830967464033920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3455us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.266072:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12325 00000100:00100000:0.0:1746147197.266594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.266657:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034048 00000100:00100000:2.0:1746147197.266663:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034048 00010000:00010000:2.0:1746147197.266688:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:2.0:1746147197.266720:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6151 00000100:00100000:2.0:1746147197.266727:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967464034048:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.266741:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.266759:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.266771:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.266799:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac84ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba1 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.266810:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.266812:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.266819:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bcb expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.266827:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bcb expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.266855:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095371c00/0xb4b2209fbdac8547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bcb expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.266866:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466510464:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147197.266927:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.270497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.270569:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034176 00000100:00100000:3.0:1746147197.270578:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034176 00000100:00100000:3.0:1746147197.270629:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12326 00000100:00100000:3.0:1746147197.270636:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29326:x1830967464034176:12345-192.168.203.36@tcp:101:lfs.0 00000100:00100000:2.0:1746147197.270651:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466510464:192.168.203.36@tcp:105: 00010000:00010000:3.0:1746147197.270656:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.270674:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bd2 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.270674:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147197.270701:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.270707:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.270709:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.270712:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd2 expref: 26 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.270738:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 26 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.270753:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 26 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:3.0:1746147197.270771:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466510592:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147197.271272:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967464034048:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4541us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.271282:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6151 00000100:00100000:3.0:1746147197.271375:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147197.273171:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466510592:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.273194:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd2 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.273211:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af800, rc 0) 00000100:00100000:3.0:1746147197.273326:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29326:x1830967464034176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2689us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.273332:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12326 00000100:00100000:0.0:1746147197.275241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.275417:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034304 00000100:00100000:2.0:1746147197.275426:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034304 00010000:00010000:2.0:1746147197.275459:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:2.0:1746147197.275503:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6152 00000100:00100000:2.0:1746147197.275511:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967464034304:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.275534:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.275557:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.275570:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.275595:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af400/0xb4b2209fbdac84de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7ba8 expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.275611:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.275613:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.275621:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd2 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.275630:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd2 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.275677:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0xb4b2209fbdac854e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd2 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.275690:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466510720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147197.277071:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.277695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.277726:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466510720:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147197.277752:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.277799:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464034304:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2288us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.277809:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6152 00000100:00100000:3.0:1746147197.277877:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034432 00000100:00100000:3.0:1746147197.277884:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034432 00000100:00100000:3.0:1746147197.277927:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12327 00000100:00100000:3.0:1746147197.277934:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29326:x1830967464034432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.277969:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.277986:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bd9 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.278013:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.278020:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.278021:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.278025:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd9 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.278054:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.278066:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:3.0:1746147197.278076:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466510848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147197.278120:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.280993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.281097:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466510848:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.281126:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd9 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.281142:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae800, rc 0) 00000100:00100000:3.0:1746147197.281182:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29326:x1830967464034432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3248us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.281189:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12327 00000100:00100000:2.0:1746147197.281267:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034560 00000100:00100000:2.0:1746147197.281273:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034560 00010000:00010000:2.0:1746147197.281298:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:2.0:1746147197.281600:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6153 00000100:00100000:2.0:1746147197.281608:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1956:x1830967464034560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.281622:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.281643:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.281654:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.281676:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5c800/0xb4b2209fbdac84f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7baf expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.281687:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.281688:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.281695:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd9 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.281707:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd9 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.281734:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae800/0xb4b2209fbdac8555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bd9 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.281746:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466510976:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147197.281801:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.283749:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466510976:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147197.283770:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.283799:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1956:x1830967464034560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2192us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.283807:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6153 00000100:00100000:0.0:1746147197.284201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.284380:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034688 00000100:00100000:3.0:1746147197.284387:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034688 00000100:00100000:3.0:1746147197.284429:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12328 00000100:00100000:3.0:1746147197.284435:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+17:29326:x1830967464034688:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.284453:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.284469:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7be0 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.284498:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.284505:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.284506:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.284510:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be0 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.284545:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.284555:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:3.0:1746147197.284565:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466511104:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147197.284631:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147197.287600:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21080:1830967466511104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.287635:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be0 expref: 18 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.287652:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ae000, rc 0) 00000100:00100000:3.0:1746147197.287710:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+18:29326:x1830967464034688:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3273us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.287718:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12328 00000100:00100000:0.0:1746147197.288614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.288717:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034816 00000100:00100000:2.0:1746147197.288726:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034816 00010000:00010000:2.0:1746147197.288757:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00000100:00100000:2.0:1746147197.288790:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6154 00000100:00100000:2.0:1746147197.288797:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967464034816:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.288811:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.288831:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.288847:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.288871:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb5d400/0xb4b2209fbdac84e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bb6 expref: 18 pid: 8478 timeout: 684 lvb_type: 1 00010000:00010000:2.0:1746147197.288894:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.288896:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147197.288903:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be0 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.288911:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be0 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.288960:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4ae000/0xb4b2209fbdac855c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be0 expref: 17 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147197.289446:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466511232:192.168.203.36@tcp:105: 00000100:00100000:2.0:1746147197.289916:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.291751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.291852:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8494:1830967466511232:192.168.203.36@tcp:105: 00010000:00010000:2.0:1746147197.291874:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.291910:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d49b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967464034816:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 3113us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.291920:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6154 00000100:00100000:3.0:1746147197.292694:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464034944 00000100:00100000:3.0:1746147197.292702:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464034944 00000100:00100000:3.0:1746147197.292752:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12329 00000100:00100000:3.0:1746147197.292760:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:29326:x1830967464034944:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1746147197.292777:0:21080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147197.292794:0:21080:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7be7 expref: -99 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.292818:0:21080:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.292826:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.292827:0:21080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147197.292830:0:21080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be7 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.292856:0:21080:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147197.292866:0:21080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:3.0:1746147197.292877:0:21080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466511360:192.168.203.36@tcp:104: 00000100:00100000:3.0:1746147197.292978:0:21080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1946900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.298206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1746147197.298313:0:21080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21080:1830967466511360:192.168.203.36@tcp:104: 00010000:00010000:3.0:1746147197.298347:0:21080:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be7 expref: 25 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147197.298369:0:21080:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afa00, rc 0) 00000100:00100000:3.0:1746147197.298432:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:29326:x1830967464034944:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5672us (6687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147197.298440:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12329 00000100:00100000:0.0:1746147197.299046:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035072 00000100:00100000:0.0:1746147197.299053:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035072 00010000:00010000:0.0:1746147197.299080:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00000100:00100000:0.0:1746147197.299105:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6155 00000100:00100000:0.0:1746147197.299110:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1957:x1830967464035072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.299122:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.299142:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:0.0:1746147197.299152:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:0.0:1746147197.299172:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af600/0xb4b2209fbdac84fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bbd expref: 25 pid: 17548 timeout: 684 lvb_type: 1 00010000:00010000:0.0:1746147197.299191:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.299193:0:8494:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.299199:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be7 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.299205:0:8494:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be7 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.299230:0:8494:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4afa00/0xb4b2209fbdac8563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7be7 expref: 24 pid: 21080 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.299239:0:8494:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466511488:192.168.203.36@tcp:105: 00000100:00100000:0.0:1746147197.299296:0:8494:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b206c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.303177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.303224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.303298:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035200 00000100:00100000:1.0:1746147197.303308:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035200 00000100:00100000:2.0:1746147197.303343:0:8494:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d498700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8494:1830967466511488:192.168.203.36@tcp:105: 00000100:00100000:1.0:1746147197.303352:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12330 00000100:00100000:1.0:1746147197.303359:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+17:1957:x1830967464035200:12345-192.168.203.36@tcp:2:lfs.0 00010000:00010000:2.0:1746147197.303364:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.303408:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1957:x1830967464035072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4296us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.303417:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6155 00000100:00100000:3.0:1746147197.303576:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035328 00002000:00010000:1.0:1746147197.303577:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746147197.303580:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035328 00002000:00010000:1.0:1746147197.303581:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147194 -> 1746147195 00002000:00010000:1.0:1746147197.303583:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147194 -> 1746147195 00002000:00010000:1.0:1746147197.303585:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147194 -> 1746147197 00002000:00010000:1.0:1746147197.303586:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:3.0:1746147197.303603:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12331 00000100:00100000:3.0:1746147197.303609:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+24:1956:x1830967464035328:12345-192.168.203.36@tcp:2:lfs.0 00000100:00100000:1.0:1746147197.303612:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:56f09401-e89b-4631-94a7-0dc8c90129f6+18:1957:x1830967464035200:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 253us (446us total) trans 21474840710 rc 0/0 00000100:00100000:1.0:1746147197.303618:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12330 00002000:00010000:3.0:1746147197.303728:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147197.303730:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147194 -> 1746147195 00002000:00010000:3.0:1746147197.303732:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147194 -> 1746147195 00002000:00010000:3.0:1746147197.303734:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147194 -> 1746147197 00002000:00010000:3.0:1746147197.303735:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147197.303769:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:56f09401-e89b-4631-94a7-0dc8c90129f6+25:1956:x1830967464035328:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 159us (544us total) trans 17179873295 rc 0/0 00000100:00100000:3.0:1746147197.303775:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12331 00000100:00100000:0.0:1746147197.305900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.305962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.305988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1746147197.306015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.306144:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035456 00000100:00100000:2.0:1746147197.306154:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035456 00000100:00100000:2.0:1746147197.306192:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035712 00000100:00100000:2.0:1746147197.306194:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035712 00000100:00100000:2.0:1746147197.306205:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035584 00000100:00100000:2.0:1746147197.306207:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035584 00000100:00100000:2.0:1746147197.306217:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464035840 00000100:00100000:2.0:1746147197.306218:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464035840 00000100:00100000:2.0:1746147197.306230:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12332 00000100:00100000:2.0:1746147197.306237:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1957:x1830967464035456:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147197.306431:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147197.306434:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306435:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147192 -> 1746147195 00002000:00010000:2.0:1746147197.306437:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147195 -> 1746147197 00002000:00010000:2.0:1746147197.306439:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147197.306496:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1957:x1830967464035456:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 259us (605us total) trans 17179873296 rc 0/0 00000100:00100000:2.0:1746147197.306503:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12332 00000100:00100000:2.0:1746147197.306516:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12333 00000100:00100000:2.0:1746147197.306521:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1957:x1830967464035712:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147197.306622:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4945696 -> 4945696 00002000:00010000:2.0:1746147197.306629:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306632:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306634:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147195 -> 1746147197 00002000:00010000:2.0:1746147197.306636:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5639 -> 5639 00000100:00100000:2.0:1746147197.306653:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1957:x1830967464035712:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 131us (717us total) trans 21474840711 rc 0/0 00000100:00100000:2.0:1746147197.306658:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12333 00000100:00100000:2.0:1746147197.306668:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12334 00000100:00100000:2.0:1746147197.306672:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+19:1956:x1830967464035584:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147197.306734:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147197.306737:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306739:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306740:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147195 -> 1746147197 00002000:00010000:2.0:1746147197.306742:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147197.306759:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+20:1956:x1830967464035584:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 85us (770us total) trans 21474840712 rc 0/0 00000100:00100000:2.0:1746147197.306764:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12334 00000100:00100000:2.0:1746147197.306772:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12335 00000100:00100000:2.0:1746147197.306776:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+26:1956:x1830967464035840:12345-192.168.203.36@tcp:2:lfs.0 00002000:00010000:2.0:1746147197.306830:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147197.306833:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.306834:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147194 -> 1746147195 00002000:00010000:2.0:1746147197.306836:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147195 -> 1746147197 00002000:00010000:2.0:1746147197.306838:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147197.306854:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:56f09401-e89b-4631-94a7-0dc8c90129f6+27:1956:x1830967464035840:12345-192.168.203.36@tcp:2:lfs.0 Request processed in 77us (839us total) trans 17179873297 rc 0/0 00000100:00100000:2.0:1746147197.306861:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12335 00000100:00100000:0.0:1746147197.308471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.308570:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464036096 00000100:00100000:2.0:1746147197.308579:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464036096 00000100:00100000:2.0:1746147197.308626:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10639 00000100:00100000:2.0:1746147197.308633:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29326:x1830967464036096:12345-192.168.203.36@tcp:55:lfs.0 00010000:00010000:2.0:1746147197.308697:0:16361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308712:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308723:0:16361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308746:0:16361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308752:0:16361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308759:0:16361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308764:0:16361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d445400 already unused, calling callback (ffffffffa136d690) 00010000:00010000:2.0:1746147197.308768:0:16361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308775:0:16361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308786:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147197.308789:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746147197.308793:0:16361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00010000:00010000:2.0:1746147197.308797:0:16361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d445400/0xb4b2209fbdac856a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16361 initiator: MDT0 00000100:00100000:2.0:1746147197.308878:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29326:x1830967464036096:12345-192.168.203.36@tcp:55:lfs.0 Request processed in 244us (411us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746147197.308884:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10639 00000100:00100000:0.0:1746147197.310279:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.310347:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464036352 00000100:00100000:2.0:1746147197.310375:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464036352 00000100:00100000:2.0:1746147197.310421:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4246 00000100:00100000:2.0:1746147197.310427:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+303:29326:x1830967464036352:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:2.0:1746147197.310475:0:16157:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x398:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b85 expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.310522:0:16157:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16157 initiator: MDT0 00010000:00010000:2.0:1746147197.310543:0:16157:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.310549:0:16157:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16157 initiator: MDT0 00010000:00010000:2.0:1746147197.310578:0:16157:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 303 pid: 14048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.310590:0:16157:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 303 pid: 14048 timeout: 684 lvb_type: 0 00000100:00100000:2.0:1746147197.310606:0:16157:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16157:1830967466511616:192.168.203.36@tcp:104: 00000100:00100000:2.0:1746147197.310698:0:16157:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094987e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147197.312790:0:16157:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16157:1830967466511616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1746147197.312815:0:16157:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00000100:00100000:0.0:1746147197.313536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.313821:0:8494:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464036480 00000100:00100000:2.0:1746147197.313827:0:8494:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464036480 00010000:00010000:2.0:1746147197.313857:0:8494:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 304 pid: 14048 timeout: 684 lvb_type: 0 00000100:00100000:2.0:1746147197.313893:0:8494:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6156 00000100:00100000:2.0:1746147197.313901:0:8494:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+304:1956:x1830967464036480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147197.313915:0:8494:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147197.313921:0:8494:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 304 pid: 14048 timeout: 684 lvb_type: 0 00010000:00010000:2.0:1746147197.313932:0:8494:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 304 pid: 14048 timeout: 684 lvb_type: 0 00010000:00010000:2.0:1746147197.313977:0:8494:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5da00/0xb4b2209fbdac84c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b8c expref: 304 pid: 14048 timeout: 684 lvb_type: 0 00010000:00010000:2.0:1746147197.313990:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:2.0:1746147197.313995:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00010000:00010000:2.0:1746147197.314007:0:8494:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16157 initiator: MDT0 00010000:00010000:2.0:1746147197.314013:0:8494:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16157 initiator: MDT0 00010000:00010000:2.0:1746147197.314036:0:8494:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147197.314088:0:8494:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56f09401-e89b-4631-94a7-0dc8c90129f6+303:1956:x1830967464036480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 187us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.314095:0:8494:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6156 00010000:00010000:0.0:1746147197.314145:0:16157:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.314150:0:16157:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00000040:00080000:0.0:1746147197.314847:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2942, 88 off244608 00000004:00080000:0.0:1746147197.314853:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584301915598ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.314893:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2891, 88 off240120 00000004:00080000:0.0:1746147197.314896:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584301958648ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.314921:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2892, 88 off240208 00000004:00080000:0.0:1746147197.314924:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584301987252ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.314932:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2943, 88 off244696 00000004:00080000:0.0:1746147197.314934:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584301996701ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.314964:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2944, 88 off244784 00000004:00080000:0.0:1746147197.314967:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302029505ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.314974:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2893, 88 off240296 00000004:00080000:0.0:1746147197.314977:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302039881ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.314982:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2894, 88 off240384 00000004:00080000:0.0:1746147197.314985:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302047718ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.314991:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2895, 88 off240472 00000004:00080000:0.0:1746147197.314993:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302055667ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.314999:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2945, 88 off244872 00000004:00080000:0.0:1746147197.315001:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302063745ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315007:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2896, 88 off240560 00000004:00080000:0.0:1746147197.315008:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302071328ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.315014:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2946, 88 off244960 00000004:00080000:0.0:1746147197.315016:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302078975ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315022:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2897, 88 off240648 00000004:00080000:0.0:1746147197.315025:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302087407ns, next at 537465048041ns, rc = 0 00000040:00080000:0.0:1746147197.315030:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2947, 88 off245048 00000004:00080000:0.0:1746147197.315032:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302095182ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315039:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2948, 88 off245136 00000004:00080000:0.0:1746147197.315041:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302104155ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315048:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2949, 88 off245224 00000004:00080000:0.0:1746147197.315050:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302112712ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315056:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2950, 88 off245312 00000004:00080000:0.0:1746147197.315058:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584302120780ns, next at 537464818071ns, rc = 0 00000040:00080000:0.0:1746147197.315064:0:16157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2898, 88 off240736 00000004:00080000:0.0:1746147197.315067:0:16157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584302129501ns, next at 537465048041ns, rc = 0 00000001:00080000:2.0:1746147197.351779:0:14137:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944418 is committed 00000004:00080000:2.0:1746147197.351788:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000004:00080000:2.0:1746147197.351795:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2087 committed 00000004:00080000:2.0:1746147197.351801:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2086 committed 00000004:00080000:2.0:1746147197.351802:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2085 committed 00000004:00080000:2.0:1746147197.351803:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2084 committed 00000004:00080000:2.0:1746147197.351805:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00000004:00080000:2.0:1746147197.351806:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2083 committed 00000004:00080000:2.0:1746147197.351808:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:2.0:1746147197.351810:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2082 committed 00000004:00080000:2.0:1746147197.351811:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:2.0:1746147197.351812:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:2.0:1746147197.351814:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:2.0:1746147197.351816:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2081 committed 00000004:00080000:2.0:1746147197.351817:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2080 committed 00000004:00080000:2.0:1746147197.351819:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:2.0:1746147197.351820:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:2.0:1746147197.351821:0:14137:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2079 committed 00000100:00100000:0.0:1746147197.351913:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147197.351931:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466511744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.352015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746147197.352402:0:16157:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4faf100 reply state ffff880132e5bc00 transno 8589944418 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16157 initiator: MDT0 00000100:00100000:1.0:1746147197.352413:0:16157:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147197.352422:0:16157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:1.0:1746147197.352425:0:16157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147197.352432:0:16157:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb5de00/0xb4b2209fbdac8483 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x398:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7b85 expref: 301 pid: 14048 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746147197.352518:0:16157:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147197.352539:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:29326:x1830967464036352:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 42101us (42253us total) trans 8589944418 rc 0/0 00000100:00100000:1.0:1746147197.352548:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4246 00000100:00100000:2.0:1746147197.352656:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147197.352683:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.352703:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.352716:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.352727:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147197.352730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466511872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.352742:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.352753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.352765:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147197.352786:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466511744 00000100:00100000:2.0:1746147197.352793:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466511744 00000100:00100000:2.0:1746147197.352821:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512000 00000100:00100000:2.0:1746147197.352822:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512000 00000100:00100000:2.0:1746147197.352833:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512512 00000100:00100000:2.0:1746147197.352834:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512512 00000100:00100000:2.0:1746147197.352842:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466511872 00000100:00100000:2.0:1746147197.352843:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466511872 00000100:00100000:2.0:1746147197.352851:0:8481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512384 00000100:00100000:2.0:1746147197.352852:0:8481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512384 00000100:00100000:2.0:1746147197.352863:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12336 00000100:00100000:2.0:1746147197.352869:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3293:x1830967466511744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147197.353067:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147197.353070:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353073:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353074:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:2.0:1746147197.353076:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 2039 -> 2039 00000100:00100000:2.0:1746147197.353098:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1830967466511744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (1083us total) trans 21474840713 rc 0/0 00000100:00100000:2.0:1746147197.353103:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12336 00000100:00100000:2.0:1746147197.353113:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12337 00000100:00100000:2.0:1746147197.353118:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830967466512000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147197.353213:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147197.353216:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353218:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353220:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:2.0:1746147197.353222:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147197.353242:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3296:x1830967466512000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (558us total) trans 17179873298 rc 0/0 00000100:00100000:2.0:1746147197.353247:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12337 00000100:00100000:2.0:1746147197.353256:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12338 00000100:00100000:2.0:1746147197.353260:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466512512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.353339:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466512512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (622us total) trans 21474840714 rc 0/0 00000100:00100000:2.0:1746147197.353345:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12338 00000100:00100000:2.0:1746147197.353352:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12339 00000100:00100000:2.0:1746147197.353356:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466511872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147197.353417:0:8481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147197.353419:0:8481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353421:0:8481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:2.0:1746147197.353422:0:8481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:2.0:1746147197.353424:0:8481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147197.353441:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466511872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (698us total) trans 21474840715 rc 0/0 00000100:00100000:2.0:1746147197.353446:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12339 00000100:00100000:2.0:1746147197.353455:0:8481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12340 00000100:00100000:2.0:1746147197.353459:0:8481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830967466512384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147197.353546:0:8481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830967466512384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (779us total) trans 21474840716 rc 0/0 00000100:00100000:2.0:1746147197.353551:0:8481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12340 00000004:00080000:2.0:1746147197.353603:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045880/2, rc 0, transno 21474840715 00000100:00100000:2.0:1746147197.353612:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466511872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147197.353619:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046d80/2, rc 0, transno 21474840716 00000100:00100000:2.0:1746147197.353622:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147197.353628:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5f800/2, rc 0, transno 17179873298 00000100:00100000:2.0:1746147197.353631:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147197.353636:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044380/2, rc 0, transno 21474840714 00000100:00100000:2.0:1746147197.353639:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830967466512512:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147197.353817:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353826:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353833:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353838:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e03aa00 already unused, calling callback (ffffffffa136d690) 00010000:00010000:0.0:1746147197.353843:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353849:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353863:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff88009f98fe00) 00010000:00010000:0.0:1746147197.353866:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147197.353869:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16157 initiator: MDT0 00010000:00010000:0.0:1746147197.353878:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e03aa00/0xb4b2209fbdac8571 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16157 initiator: MDT0 00000100:00100000:0.0:1746147197.353905:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.353930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.353975:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.353992:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147197.354011:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046680/2, rc 0, transno 21474840713 00000100:00100000:0.0:1746147197.354014:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466511744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354022:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147197.354027:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354041:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.354052:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.354081:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512128 00000100:00100000:0.0:1746147197.354085:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512128 00000100:00100000:0.0:1746147197.354102:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512640 00000100:00100000:0.0:1746147197.354104:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512640 00000100:00100000:0.0:1746147197.354112:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512256 00000100:00100000:0.0:1746147197.354113:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512256 00000100:00100000:0.0:1746147197.354120:0:4444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512768 00000100:00100000:0.0:1746147197.354121:0:4444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512768 00000100:00100000:0.0:1746147197.354129:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12341 00000100:00100000:0.0:1746147197.354133:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466512128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147197.354221:0:4444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 4945696 -> 4945696 00002000:00010000:0.0:1746147197.354224:0:4444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:0.0:1746147197.354225:0:4444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:0.0:1746147197.354228:0:4444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:0.0:1746147197.354229:0:4444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 5639 -> 5639 00000100:00100000:0.0:1746147197.354250:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466512128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (320us total) trans 21474840717 rc 0/0 00000100:00100000:0.0:1746147197.354255:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12341 00000100:00100000:0.0:1746147197.354265:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12342 00000100:00100000:0.0:1746147197.354269:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466512640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354348:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466512640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (355us total) trans 21474840718 rc 0/0 00000100:00100000:0.0:1746147197.354353:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12342 00000100:00100000:0.0:1746147197.354361:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12343 00000100:00100000:0.0:1746147197.354365:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466512256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354433:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466512256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (391us total) trans 21474840719 rc 0/0 00000100:00100000:0.0:1746147197.354438:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12343 00000100:00100000:0.0:1746147197.354446:0:4444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12344 00000100:00100000:0.0:1746147197.354449:0:4444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830967466512768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.354515:0:4444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830967466512768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (448us total) trans 21474840720 rc 0/0 00000100:00100000:0.0:1746147197.354519:0:4444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12344 00000004:00080000:0.0:1746147197.354553:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046a00/2, rc 0, transno 21474840719 00000100:00100000:0.0:1746147197.354556:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.354562:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045c00/2, rc 0, transno 21474840720 00000100:00100000:0.0:1746147197.354564:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.354569:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045180/2, rc 0, transno 21474840717 00000100:00100000:0.0:1746147197.354571:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.354576:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 21474840718 00000100:00100000:0.0:1746147197.354578:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830967466512640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147197.354870:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.354895:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.354909:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.354921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.354932:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147197.354951:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.354965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.354975:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.354987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147197.355006:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513280 00000100:00100000:3.0:1746147197.355008:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513280 00000100:00100000:3.0:1746147197.355024:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513792 00000100:00100000:3.0:1746147197.355025:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513792 00000100:00100000:3.0:1746147197.355031:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513152 00000100:00100000:3.0:1746147197.355032:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513152 00000100:00100000:3.0:1746147197.355038:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12345 00000100:00100000:3.0:1746147197.355042:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3294:x1830967466513280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147197.355149:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147197.355152:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1746147175 -> 1746147175 00002000:00010000:3.0:1746147197.355154:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147197.355155:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746147197.355157:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1746147197.355177:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466513280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (280us total) trans 17179873299 rc 0/0 00000100:00100000:3.0:1746147197.355181:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12345 00000100:00100000:3.0:1746147197.355189:0:21080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513664 00000100:00100000:3.0:1746147197.355191:0:21080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513664 00000100:00100000:3.0:1746147197.355200:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12346 00000100:00100000:3.0:1746147197.355203:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466513792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.355283:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466513792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (359us total) trans 17179873300 rc 0/0 00000100:00100000:3.0:1746147197.355287:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12346 00000100:00100000:3.0:1746147197.355296:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12347 00000100:00100000:3.0:1746147197.355300:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466513152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147197.355365:0:21080:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147197.355367:0:21080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:3.0:1746147197.355369:0:21080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:3.0:1746147197.355371:0:21080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:3.0:1746147197.355372:0:21080:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147197.355388:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466513152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (422us total) trans 17179873301 rc 0/0 00000100:00100000:3.0:1746147197.355392:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12347 00000100:00100000:3.0:1746147197.355400:0:21080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12348 00000100:00100000:3.0:1746147197.355404:0:21080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3294:x1830967466513664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147197.355477:0:21080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3294:x1830967466513664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (488us total) trans 17179873302 rc 0/0 00000100:00100000:3.0:1746147197.355481:0:21080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12348 00000004:00080000:3.0:1746147197.355579:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c000/2, rc 0, transno 17179873301 00000100:00100000:3.0:1746147197.355583:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.355588:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c700/2, rc 0, transno 17179873302 00000100:00100000:3.0:1746147197.355590:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.355595:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5ea00/2, rc 0, transno 17179873299 00000100:00100000:3.0:1746147197.355598:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147197.355603:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5c380/2, rc 0, transno 17179873300 00000100:00100000:3.0:1746147197.355605:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830967466513792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.355767:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466512896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.355793:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.355816:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.355830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.355842:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147197.355846:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.355860:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.355866:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.355881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.355900:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466512896 00000100:00100000:1.0:1746147197.355902:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466512896 00000100:00100000:1.0:1746147197.355915:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513408 00000100:00100000:1.0:1746147197.355917:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513408 00000100:00100000:1.0:1746147197.355921:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513024 00000100:00100000:1.0:1746147197.355922:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513024 00000100:00100000:1.0:1746147197.355927:0:4445:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967466513536 00000100:00100000:1.0:1746147197.355928:0:4445:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967466513536 00000100:00100000:1.0:1746147197.355934:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12349 00000100:00100000:1.0:1746147197.355961:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3295:x1830967466512896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.356071:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830967466512896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (277us total) trans 21474840721 rc 0/0 00000100:00100000:1.0:1746147197.356076:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12349 00000100:00100000:1.0:1746147197.356089:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:1.0:1746147197.356093:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466513408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.356171:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466513408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (340us total) trans 17179873303 rc 0/0 00000100:00100000:1.0:1746147197.356176:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00100000:1.0:1746147197.356185:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:1.0:1746147197.356189:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466513024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.356254:0:4445:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.356256:0:4445:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1746147195 -> 1746147195 00002000:00010000:1.0:1746147197.356258:0:4445:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1746147195 -> 1746147195 00002000:00010000:1.0:1746147197.356260:0:4445:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.356262:0:4445:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147197.356279:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a044ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466513024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (418us total) trans 17179873304 rc 0/0 00000100:00100000:1.0:1746147197.356285:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:1.0:1746147197.356296:0:4445:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:1.0:1746147197.356300:0:4445:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a059d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3295:x1830967466513536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.356375:0:4445:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a059d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1830967466513536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (493us total) trans 17179873305 rc 0/0 00000100:00100000:1.0:1746147197.356380:0:4445:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000004:00080000:1.0:1746147197.356487:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5ce00/2, rc 0, transno 17179873304 00000100:00100000:1.0:1746147197.356491:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147197.356496:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5dc00/2, rc 0, transno 17179873305 00000100:00100000:1.0:1746147197.356498:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147197.356505:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047480/2, rc 0, transno 21474840721 00000100:00100000:1.0:1746147197.356507:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466512896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147197.356512:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee5d500/2, rc 0, transno 17179873303 00000100:00100000:1.0:1746147197.356514:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830967466513408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.362635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1746147197.364738:0:16361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464036608 00000100:00100000:2.0:1746147197.364752:0:16361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464036608 00000100:00100000:2.0:1746147197.364813:0:16361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10640 00000100:00100000:2.0:1746147197.364822:0:16361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+300:29326:x1830967464036608:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1746147197.364847:0:16361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147197.364867:0:16361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac8578 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x398:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78010fb7949e7bee expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.364926:0:16361:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac8578 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bee expref: 301 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.365141:0:16361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e0800/0xb4b2209fbdac8578 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x398:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0x78010fb7949e7bee expref: 301 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147197.365165:0:16361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x398:0x0].0x0 (ffff8800928bda00) 00010000:00010000:2.0:1746147197.365168:0:16361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147197.365171:0:16361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e0800, rc 0) 00000100:00100000:2.0:1746147197.365237:0:16361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:56f09401-e89b-4631-94a7-0dc8c90129f6+301:29326:x1830967464036608:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 416us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147197.365243:0:16361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10640 00000100:00100000:0.0:1746147197.369290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1746147197.369554:0:16157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967464036864 00000100:00100000:1.0:1746147197.369564:0:16157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967464036864 00000100:00100000:1.0:1746147197.369605:0:16157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4247 00000100:00100000:1.0:1746147197.369613:0:16157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+301:29326:x1830967464036864:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1746147197.369887:0:16157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:56f09401-e89b-4631-94a7-0dc8c90129f6+302:29326:x1830967464036864:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 274us (603us total) trans 8589944419 rc 0/0 00000100:00100000:1.0:1746147197.369894:0:16157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4247 00010000:00010000:2.0:1746147197.859142:0:7123:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746147198.056164:0:4546:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed Debug log: 68683 lines, 68683 kept, 0 dropped, 0 bad.